Flume Study (IV)---channel

Source: Internet
Author: User

Definition: Channels is the repositories where the events is staged on a agent. Source adds the events and Sink removes it.

According to the Flume 1.8.0 User guide provided by Flume official website, the main content of this paper is to summarize the Schannel of flume1.8.0 support, see the table below.

Channel type Type Storage media Description
Memory Channel Memory Memory Events are stored in memory
JDBC Channel Jdbc Database Events is persisted to the database
Kafka Channel Org.apache.flume.channel.kafka.KafkaChannel Kafka Cluster The events is stored in a Kafka cluster
File Channel File A file on a local disk If there is no configuration file path, the default path is used. However, if you have two or more file channel two or more, you will need to specify at least one path, or a conflict may occur.
Spillable Memory Channel (experimental) Spillablememory An in-memory queue and on disk Prioritize storing data to memory when memory overflows and stored on disk
Pseudo Transaction Channel Org.apache.flume.channel.PseudoTxnMemoryChannel Only for unit tests
Custom Channel Custom FQCN

Flume Study (IV)---channel

Contact Us

The content source of this page is from Internet, which doesn't represent Alibaba Cloud's opinion; products and services mentioned on that page don't have any relationship with Alibaba Cloud. If the content of the page makes you feel confusing, please write us an email, we will handle the problem within 5 days after receiving your email.

If you find any instances of plagiarism from the community, please send an email to: info-contact@alibabacloud.com and provide relevant evidence. A staff member will contact you within 5 working days.

A Free Trial That Lets You Build Big!

Start building with 50+ products and up to 12 months usage for Elastic Compute Service

  • Sales Support

    1 on 1 presale consultation

  • After-Sales Support

    24/7 Technical Support 6 Free Tickets per Quarter Faster Response

  • Alibaba Cloud offers highly flexible support services tailored to meet your exact needs.