According to the Flume 1.8.0 User guide provided by Flume official website, the main content of this paper is to summarize the sink of flume1.8.0 support, see the table below.
| Sink name |
Type |
Data destination |
Working style |
Note |
| HDFS Sink |
Hdfs |
Hdfs |
|
|
| Hive Sink |
Hive |
Hive |
|
|
| Logger Sink |
Logger |
Custom |
Log level is info, primarily for debugging |
|
| Avro Sink |
Avro |
External Avro Client |
Convert received events to Avro events Avro client that is sent to the specified address concurrently |
|
| Thrift Sink |
Thrift |
External Thrift Client |
Convert received events to thrift events Avro client that is sent to the specified address concurrently |
|
| IRC Sink |
Irc |
IRC destinations |
|
|
| File Roll Sink |
File_roll |
Local file system |
|
|
| Null Sink |
Null |
No |
Discard all data |
|
| Hbase Sink |
HBase |
Hbase |
These two sink belong to one big category: Hbasesinks |
|
| Asynchbasesink |
Asynchbase |
Hbase (Asynchronous mode) |
|
| Morphlinesolrsink |
Org.apache.flume. Sink.solr.morphline. Morphlinesolrsink |
Apache SOLR Servers |
This sink extracts data from Flume events, Transforms it, and loads it in Near-real-time into Apache SOLR servers, which in turn serve Queries to end users or search applications. |
|
| Elasticsearchsink |
Org.apache.flume. Sink.elasticsearch. Elasticsearchsink |
Elasticsearch Cluster |
|
|
| Kite Dataset Sink |
Org.apache.flume. Sink.kite.DatasetSink |
Kite Dataset |
|
|
| Kafka Sink |
Org.apache.flume. Sink.kafka.KafkaSink |
Kafka Topic |
|
|
| HTTP Sink |
http |
A URI address (POST) |
|
|
| Custom Sink |
Custom FQCN |
Custom |
|
|
Flume Study (iii)---sink