Flume use problems and solve

1 ... Cache file backlog occurs in the/flume/fchannel/spool/data/directory

Possible causes: same time the same client under the two monitoring directory MV file, or at the same time multiple clients to the server to upload files

2. Clear: /flume/fchannel/spool/data/directory After the file restart, the monitoring directory file backlog, no upload

Repeat an exception inside the Flume.log:

Java.lang.IllegalStateException:Channel closed [CHANNEL=C1]. Due to Java.lang.NullPointerException:NULLAt org.apache.flume.channel.file.FileChannel.createTransaction (Filechannel.java:65W) at Org.apache.flume.channel.BasicChannelSemantics.getTransaction (Basicchannelsemantics.java:122) at Org.apache.flume.channel.ChannelProcessor.processEventBatch (Channelprocessor.java:181) at Org.apache.flume.source.spooldirectorysource$spooldirectoryrunnable.run (Spooldirectorysource.java:188) at Java.util.concurrent.executors$runnableadapter.call (Executors.java:441) at Java.util.concurrent.futuretask$sync.innerrunandreset (Futuretask.java:317) at Java.util.concurrent.FutureTask.runAndReset (Futuretask.java:150) at java.util.concurrent.scheduledthreadpoolexecutor$scheduledfuturetask.access$101 (scheduledthreadpoolexecutor.java:98) at Java.util.concurrent.scheduledthreadpoolexecutor$scheduledfuturetask.runperiodic ( Scheduledthreadpoolexecutor.java:180) at Java.util.concurrent.scheduledthreadpoolexecutor$scheduledfuturetask.run ( Scheduledthreadpoolexecutor.java:204) at Java.util.concurrent.threadpoolexecutor$worker.runtask (Threadpoolexecutor.java:886) at Java.util.concurrent.threadpoolexecutor$worker.run (Threadpoolexecutor.java:908) at Java.lang.Thread.run (Thread.java:662) caused by:java.lang.NullPointerException at Org.apache.flume.channel.file.Log.writeCheckpoint (Log.java:1028) at Org.apache.flume.channel.file.Log.replay (Log.java:472) at Org.apache.flume.channel.file.FileChannel.start (Filechannel.java:60W) at Org.apache.flume.lifecycle.lifecyclesupervisor$monitorrunnable.run (Lifecyclesupervisor.java:251)        ... 9 more

The reason: empty. /flume/fchannel/spool/data/directory, you need to empty the file as well. Files under the/flume/fchannel/spool/checkpoint/directory

In addition, there are several questions about flume:

1. flume supports monitoring directory with subdirectories, but at the same time to two or more sub-directory MV files, there is no limit to the file size?

2. Flume support simultaneously how many clients to the same monitoring directory under the MV file?

3. What is the role of the file under the/opt/soft/flume/fchannel/spool/data directory of the flume client?

4. How to effectively verify that the Flume client uploaded the file is successful?

Flume use problems and solve