Flume Installation ConfigurationOne: Download
: http://www.apache.org/dyn/closer.lua/flume/1.8.0/apache-flume-1.8.0-bin.tar.gz
Two: Unzip
[[Email protected] ~] # TAR-ZXVF apache-flume-1.8.0-bin.tar.gz-c/usr/local/
Renamed Flume convenient for later operation
[[email protected] local] # pwd/usr/local[root@s100 Local]# lsapache-flume-1.8.0-bin etc Hadoop Hive include Lib libexec sharebin Games hbase Hive.bak java lib64 sbin src[root@s100 Local]# mv Apache-flume-1.8.0-bin Flume
Three: Configure environment variables
[[email protected] conf] # Vim/etc/profile
# Flume export flume_home=/usr/local/flume export PATH=$PATH:$FLUME _home/bin
Perform:
[[email protected] conf] # Source/etc/profile
Four: Configure Flume
[[email protected] conf] # pwd/usr/local/flume/conf[root@s100 conf]# lsflume-conf.properties.template flume-env.sh.templateflume-env.ps1.template log4j.properties
There is a flume-conf.properties.template file under the Flume configuration file, which is a template for flume configuration
Based on the template file, we configure a netcat and use flume to collect logs
[[email protected] conf] # Vim r_nc.conf
Depending on the template content, the configuration information is as follows:
# The configuration file needs to define the sources, # the channels and the sinks.# sources, channels and sinks is Defin Ed per agent, # in the case called ' Agent ' #声明三类组件agent. Sources = R1agent.channels = C1agent.sinks = k1# Configuration Source-r1 component Agent . Sources.r1.type = Netcatagent.sources.r1.bind = Localhostagent.sources.r1.port = 10000# port number, prompt to start successfully # Configure the CHANNEL-C1 component Agent.channels.c1.type = memory# Configuration Sink-k1 Component Agent.sinks.k1.type = logger# binding: Note the sagent.sources.r1.channels behind R1 and K1 = C1agent.sinks.k1.channel = C1
Five: Flume start
[[email protected] conf] # flume-ng agent-f r_nv.conf-n agent-dflume.root.logger=info.console
Format: Flume-ng agent-f Specify the file name (address, here because r_nv.conf is under Conf, so is followed by the r_nv.conf)-n name (that is, agent.sources = Agent in R1)-dflume.root.logger=info.consloe
...
18/05/25 15:42:56 INFO node. application:starting Sink K118/05/25 15:42:56 INFO node. Application:starting source R118/05/25 15:42:56 INFO source. Netcatsource:source starting18/05/25 15:42:56 INFO Source. netcatsource:created serversocket:sun.nio.ch.serversocketchannelimpl[/127.0.0.1:10000]
Here's a 127.0.0.1:10000 that says it's started successfully
Six: Native flume port Query and flume results
Open a new shell window (do not close the original flume as we print the data validation process in the console)
[[Email protected] ~] # NETSTAT-ANPT | grep+ TCP 0 0:: ffff:127.0.0.1:10000 :::* LISTEN 59845/java
Port exists
Flume Log Monitoring Results query
Note: Ubuntu installs netcat:apt-get-y install netcat-traditional
Execution in the presence of the Netcat service: [[email protected] ~]# NC localhost 10000
This article copyright notice:
This article is the emperor of the small fairy
Blog Home Address: http://www.cnblogs.com/dxxblog/
Welcome to Beau Main Blog content criticism pointing, if the problem, can comment or email ([email protected])
Welcome reprint, Reprint please in the article page obvious location give the original link, thank you
Flume installation Configuration