Introduction :
This article is based on the Flume 1.8.0 User Guide provided by the Flume official website, including the various source supported by flume1.8.0 (see table 0.1) and its description.
| SOURCE category |
Type |
Data sources |
Description |
| Avro Source |
Avro |
External Avro Client Streams |
|
| Thrift Source |
Thrift |
External Thrift Client Streams |
|
| Exec Source |
Exec |
Unix command |
The command must be able to produce data continuously in the standard output (console), such as Cat, Tail-f, and so on. Inverse Example: Date |
| JMS Source |
Jms |
JMS destination such as a queue or topic |
You can use any JMS provider, but only use the ACTIVEMQ test |
| Spooling Directory Source |
Spooldir |
A specific directory on the disk |
Monitor file changes in the directory and read the changes. Note: 1. After you move a file to the directory, |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
First, Avro Source
Flume Learning (ii)---source