Introduction :
This article is based on the Flume 1.8.0 User Guide provided by the Flume official website, including the various source supported by flume1.8.0 (see table 0.1) and its description.
SOURCE category |
Type |
Data sources |
Description |
Avro Source |
Avro |
External Avro Client Streams |
|
Thrift Source |
Thrift |
External Thrift Client Streams |
|
Exec Source |
Exec |
Unix command |
The command must be able to produce data continuously in the standard output (console), such as Cat, Tail-f, and so on. Inverse Example: Date |
JMS Source |
Jms |
JMS destination such as a queue or topic |
You can use any JMS provider, but only use the ACTIVEMQ test |
Spooling Directory Source |
Spooldir |
A specific directory on the disk |
Monitor file changes in the directory and read the changes. Note: 1. After you move a file to the directory, |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
First, Avro Source
Flume Learning (ii)---source