flume 多chanel配置

來源:互聯網
上載者:User

標籤:size   host   buffers   nts   channels   stream   ati   mat   blog   

#配置文a1.sources= r1  a1.sinks= k1 k2  a1.channels= c1 c2     #Describe/configure the source  a1.sources.r1.type = avroa1.sources.r1.bind =  slave3a1.sources.r1.port = 50001a1.sources.r1.host=slave3a1.sources.r1.selector.type = replicatinga1.sources.r1.channels = c1 c2    #第一個 hdfsa1.sinks.k1.type = hdfsa1.sinks.k1.channel = c1a1.sinks.k1.hdfs.path = /maats5/%{logtype}/logdate=%{date}/a1.sinks.k1.hdfs.filePrefix = %{logtype}-%{date}a1.sinks.k1.hdfs.round = truea1.sinks.k1.hdfs.roundValue = 1a1.sinks.k1.hdfs.roundUnit = houra1.sinks.k1.hdfs.rollInterval = 180000a1.sinks.k1.hdfs.rollSize = 134217700a1.sinks.k1.hdfs.useLocalTimeStamp = true  a1.sinks.k1.hdfs.fileType=DataStream  a1.sinks.k1.hdfs.writeFormat=Text  #第二個到kafka#a1.channels = c1#a1.sinks = k1#a1.sinks.k1.type = org.example.MySink#a1.sinks.k1.channel = c1a1.sinks.k2.channel = c2a1.sinks.k2.type = my.bigdata.KafkaSink2a1.sinks.k2.kafka.topic = maats1a1.sinks.k2.kafka.bootstrap.servers = slave3:9092a1.sinks.k2.kafka.flumeBatchSize = 20a1.sinks.k2.kafka.producer.acks = 1a1.sinks.k2.kafka.producer.linger.ms = 1#a1.sinks.ki.kafka.producer.compression.type = snappy# Usea channel which buffers events in memory  a1.channels.c1.type= memory  a1.channels.c1.capacity= 1000  a1.channels.c1.transactionCapacity= 100     a1.channels.c2.type= memory  a1.channels.c2.capacity= 1000  a1.channels.c2.transactionCapacity= 100  

 

flume 多chanel配置

相關文章

聯繫我們

該頁面正文內容均來源於網絡整理,並不代表阿里雲官方的觀點,該頁面所提到的產品和服務也與阿里云無關,如果該頁面內容對您造成了困擾,歡迎寫郵件給我們,收到郵件我們將在5個工作日內處理。

如果您發現本社區中有涉嫌抄襲的內容,歡迎發送郵件至: info-contact@alibabacloud.com 進行舉報並提供相關證據,工作人員會在 5 個工作天內聯絡您,一經查實,本站將立刻刪除涉嫌侵權內容。

A Free Trial That Lets You Build Big!

Start building with 50+ products and up to 12 months usage for Elastic Compute Service

  • Sales Support

    1 on 1 presale consultation

  • After-Sales Support

    24/7 Technical Support 6 Free Tickets per Quarter Faster Response

  • Alibaba Cloud offers highly flexible support services tailored to meet your exact needs.