[Translation] flume 1.5.0.1 User Manual

From: http://flume.apache.org/FlumeUserGuide.html#data-flow-model

Learn flume through translation.

Introduction

Apache flume is a distributed, highly reliable, and highly available system. It is mainly used to efficiently collect, aggregate, and move a large amount of log data from various data sources.

The collected data is stored in a centralized manner.

The application scenarios of Apache flume are not limited to log data aggregation. Because flume data sources can be customized, flume can be used to transmit a large number of events.

Data, including but not limited to: network data, social media data, mail information, and other scenarios that require massive data transmission.

Aapche flume is now a top-level ASF project. Currently, there are two major versions: 0.9.x and 1.x. 1.x is recommended.

System Requirements

1. Java environment: After jdk1.6 (jdk1.7 is recommended)

2. Memory: You must have enough memory for the agent (sources, channels, sinks ).

3. Disk Space: sufficient disk space is required for channels and sinks.

4. directory permission: the directory used by the agent must have the read/write permission

Architecture Data Flow Model

Flume event is defined

To be continued...

[Translation] flume 1.5.0.1 User Manual