【Flume】 flume 負載平衡環境的搭建 load_balance

標籤：flume

flume的負載平衡即每次按照一定的演算法選擇sink輸出到指定地方，如果在檔案輸出量很大的情況下，負載平衡還是很有必要的，通過多個通道輸出緩解輸出壓力

flume內建的負載平衡的演算法預設是round robin，輪詢演算法，按序選擇

下面看一下具體執行個體：

 # Name the components on this agenta1.sources = r1a1.sinks = k1 k2a1.channels = c1 # Describe/configure the sourcea1.sources.r1.type = execa1.sources.r1.channels=c1a1.sources.r1.command=tail -F /root/dev/biz/logs/bizlogic.log #define sinkgroupsa1.sinkgroups=g1a1.sinkgroups.g1.sinks=k1 k2a1.sinkgroups.g1.processor.type=load_balancea1.sinkgroups.g1.processor.backoff=truea1.sinkgroups.g1.processor.selector=round_robin#define the sink 1a1.sinks.k1.type=avroa1.sinks.k1.hostname=192.168.11.179a1.sinks.k1.port=9876  #define the sink 2a1.sinks.k2.type=avroa1.sinks.k2.hostname=192.168.11.178a1.sinks.k2.port=9876# Use a channel which buffers events in memorya1.channels.c1.type = memorya1.channels.c1.capacity = 1000a1.channels.c1.transactionCapacity = 100 # Bind the source and sink to the channela1.sources.r1.channels = c1a1.sinks.k1.channel = c1a1.sinks.k2.channel=c1

以上是flume agent client的配置，server端的配置跟上一篇文章一樣http://blog.csdn.net/simonchi/article/details/42494461

同樣通過指令碼去類比組建檔案內容，觸發tail -F，執行兩次，發現第一次輸出在179，第二次輸出在178，說明負載平衡已經生效了！！

很簡單！！

【Flume】 flume 負載平衡環境的搭建 load_balance