event sink

Sink groups makes several different sink a whole, while sink processor provides the ability to load balance and failover within a group.There are three kinds of sink processor:d efault sink processor,failover sink processor,load balancing sink

Users can not only customize the source of the Flume, but also customize the flume sink, the user-defined sink in flume only need to inherit a base class: Abstractsink, and then implement the method in it, For example, my current requirement is that

DescriptionThe results are personally tested and provided with simple data analysis, which is rudimentary and may result in inaccurate results.First of all, the results, multi-sink can be directly according to the general configuration, so that each

1, Logger Sink Logs that record the info level are typically used for debugging purposes. The sink used in the previous introduction of source are all of this type of sink Properties that must be configured: Type Logger Maxbytestolog Maximum

Sinkprocessor:============================failover:load balancing://Load Balancer Processor//Round_robin Polling 1-2-3-1-2-3-...//random randomly 1-3-2-3-1-...1, Round_robin polling 1-2-3-1-2-3-... 2, random randomly: custom

Fluem appear, transactioncapacity query, come to these:Recently in doing flume real-time log collection, with the flume default configuration, found not completely real-time, so looked at, the original is Memerychannel transactioncapacity in

flume– primary knowledge of Flume, source and sinkDirectoryBasic conceptsCommon source sourcesCommon sinkBasic conceptsWhat's the name flume?Distributed, reliable, large number of log collection, aggregation, and mobility tools.? eventsevent, which

Scenario 1. What is Flume 1.1 backgroundFlume, as a real-time log collection system developed by Cloudera, has been recognized and widely used by the industry. The initial release version of Flume is now collectively known as Flume OG (original

1. Create a Agent,sink type to be specified as a custom

This article mainly describes the process of using flume to transfer data to MongoDB, which involves environment deployment and considerations.First, Environment construction1, flune-ng:http://www.apache.org/dyn/closer.cgi/flume/1.5.2/apache-flume-1.