Flume Study (iii)---sink

Source: Internet
Author: User
Tags apache solr solr

According to the Flume 1.8.0 User guide provided by Flume official website, the main content of this paper is to summarize the sink of flume1.8.0 support, see the table below.

Sink name Type Data destination Working style Note
HDFS Sink Hdfs Hdfs
Hive Sink Hive Hive
Logger Sink Logger Custom Log level is info, primarily for debugging
Avro Sink Avro External Avro Client

Convert received events to Avro events

Avro client that is sent to the specified address concurrently

Thrift Sink Thrift External Thrift Client

Convert received events to thrift events

Avro client that is sent to the specified address concurrently

IRC Sink Irc IRC destinations
File Roll Sink File_roll Local file system
Null Sink Null No Discard all data
Hbase Sink HBase Hbase These two sink belong to one big category: Hbasesinks
Asynchbasesink Asynchbase Hbase (Asynchronous mode)
Morphlinesolrsink

Org.apache.flume.

Sink.solr.morphline.

Morphlinesolrsink

Apache SOLR Servers

This sink extracts data from Flume events,

Transforms it, and loads it in Near-real-time

into Apache SOLR servers, which in turn serve

Queries to end users or search applications.

Elasticsearchsink

Org.apache.flume.

Sink.elasticsearch.

Elasticsearchsink

Elasticsearch Cluster
Kite Dataset Sink

Org.apache.flume.

Sink.kite.DatasetSink

Kite Dataset
Kafka Sink

Org.apache.flume.

Sink.kafka.KafkaSink

Kafka Topic
HTTP Sink

http

A URI address (POST)
Custom Sink

Custom FQCN

Custom

Flume Study (iii)---sink

Related Article

Contact Us

The content source of this page is from Internet, which doesn't represent Alibaba Cloud's opinion; products and services mentioned on that page don't have any relationship with Alibaba Cloud. If the content of the page makes you feel confusing, please write us an email, we will handle the problem within 5 days after receiving your email.

If you find any instances of plagiarism from the community, please send an email to: info-contact@alibabacloud.com and provide relevant evidence. A staff member will contact you within 5 working days.

A Free Trial That Lets You Build Big!

Start building with 50+ products and up to 12 months usage for Elastic Compute Service

  • Sales Support

    1 on 1 presale consultation

  • After-Sales Support

    24/7 Technical Support 6 Free Tickets per Quarter Faster Response

  • Alibaba Cloud offers highly flexible support services tailored to meet your exact needs.