According to the Flume 1.8.0 User guide provided by Flume official website, the main content of this paper is to summarize the sink of flume1.8.0 support, see the table below.
Sink name |
Type |
Data destination |
Working style |
Note |
HDFS Sink |
Hdfs |
Hdfs |
|
|
Hive Sink |
Hive |
Hive |
|
|
Logger Sink |
Logger |
Custom |
Log level is info, primarily for debugging |
|
Avro Sink |
Avro |
External Avro Client |
Convert received events to Avro events Avro client that is sent to the specified address concurrently |
|
Thrift Sink |
Thrift |
External Thrift Client |
Convert received events to thrift events Avro client that is sent to the specified address concurrently |
|
IRC Sink |
Irc |
IRC destinations |
|
|
File Roll Sink |
File_roll |
Local file system |
|
|
Null Sink |
Null |
No |
Discard all data |
|
Hbase Sink |
HBase |
Hbase |
These two sink belong to one big category: Hbasesinks |
|
Asynchbasesink |
Asynchbase |
Hbase (Asynchronous mode) |
|
Morphlinesolrsink |
Org.apache.flume. Sink.solr.morphline. Morphlinesolrsink |
Apache SOLR Servers |
This sink extracts data from Flume events, Transforms it, and loads it in Near-real-time into Apache SOLR servers, which in turn serve Queries to end users or search applications. |
|
Elasticsearchsink |
Org.apache.flume. Sink.elasticsearch. Elasticsearchsink |
Elasticsearch Cluster |
|
|
Kite Dataset Sink |
Org.apache.flume. Sink.kite.DatasetSink |
Kite Dataset |
|
|
Kafka Sink |
Org.apache.flume. Sink.kafka.KafkaSink |
Kafka Topic |
|
|
HTTP Sink |
http |
A URI address (POST) |
|
|
Custom Sink |
Custom FQCN |
Custom |
|
|
Flume Study (iii)---sink