flume1.6 installation of Hadoop

Flume 1.6 Installation
1. Unzip

2. Copying

CP Conf/flume-conf.properties.template conf/flume.conf

CP Conf/flume-env.sh.template conf/flume-env.sh

3. Modify Java_home

flume-env.sh

4. Inspection and Installation

Flume-ng version

5. Start Flume agent Agent1

Flume-ng Agent--conf conf-f/bigdata/flume-1.6/conf/agent1.conf-n agent1-dlume.root.logger=debug,console

6. Create the specified file

echo "Hello World" >/home/hadoop/flume-1.5.0-bin/log.00

7. Sending files using Avro-client

Flume-ng avro-client-c. -H localhost-p 41414-f/bigdata/flume-1.6/log.00

8. The Agent1 console will see the relevant information

More detailed configuration
Http://www.aboutyun.com/thread-8917-1-1.html

Two. Collecting UDP

Udp.conf

　　

# Name The components in this agenta1.sources=r1a1.sinks=K1a1.channels=C1a1.sources.r1.type=Syslogudpa1.sources.r1.port=8283A1.sources.r1.host=Cdh101a1.sources.r1.channels=C1 #HDFS Path#a1.sinks.k1.hdfs.path= HDFs://nameservice:8020/user/root/udp/%y%m%d/hour=%h#HDFS thread Numbersa1.sinks.k1.hdfs.threadsPoolSize= -# HDFS The Sink#a1.sinks.k1.type=Hdfsa1.sinks.k1.type=Loggera1.sinks.k1.hdfs.useLocalTimeStamp=trueA1.sinks.k1.hdfs.filePrefix=Udpa1.sinks.k1.hdfs.rollInterval=0a1.sinks.k1.hdfs.rollSize=118435456A1.sinks.k1.hdfs.rollCount=0A1.sinks.k1.hdfs.idleTimeout= +A1.sinks.k1.hdfs.fileType=DataStream a1.sinks.k1.hdfs.rollTimerPoolSize=1#memory Sizea1.channels.c1.type=memorya1.channels.c1.transactionCapacity=100000a1.channels.c1.capacity=268435456# Bind The source and sink to the Channela1.sources.r1.channels=C1a1.sinks.k1.channel= C1

flume1.6 installation of Hadoop