Deployment flume in a window environment, Kafka is deployed on Linux, from Flume sending events to Kafka there is always an error,
After a long time on-line search finally solved the problem,
Modify the configuration items in the Kafka
#advertised. Host.name=
Note, and configure the IP address of the Linux on which Kafka resides
advertised.host.name=192.168.10.10
Restart Kafka.
2016-04-16 16:43:34,069 (sinkrunner-pollingrunner-defaultsinkprocessor) [Info-kafka.utils.logging$class.info ( logging.scala:68)] Connected to dx.zdp.ol:9092 for producing
2016-04-16 16:43:34,069 (sinkrunner-pollingrunner-defaultsinkprocessor) [Info-kafka.utils.logging$class.info ( LOGGING.SCALA:68)] Disconnecting from dx.zdp.ol:9092
2016-04-16 16:43:34,069 (sinkrunner-pollingrunner-defaultsinkprocessor) [Warn-kafka.utils.logging$class.warn ( logging.scala:89)] Failed to send producer request with correlation ID 2 to broker 0 with
data for partitions [otaaudit1,0]
Java.nio.channels.ClosedChannelException
At Kafka.network.BlockingChannel.send (blockingchannel.scala:110)
At Kafka.producer.syncproducer.liftedtree1$1 (syncproducer.scala:76)
At kafka.producer.syncproducer.kafka$producer$syncproducer$ $doSend (syncproducer.scala:75)
At kafka.producer.syncproducer$ $anonfun $send$1$ $anonfun $apply$mcv$sp$1.apply$mcv$sp (syncproducer.scala:106)
At kafka.producer.syncproducer$ $anonfun $send$1$ $anonfun $apply$mcv$sp$1.apply (syncproducer.scala:106)
At kafka.producer.syncproducer$ $anonfun $send$1$ $anonfun $apply$mcv$sp$1.apply (syncproducer.scala:106)
At Kafka.metrics.KafkaTimer.time (kafkatimer.scala:33)
At kafka.producer.syncproducer$ $anonfun $send$1.apply$mcv$sp (syncproducer.scala:105)
At kafka.producer.syncproducer$ $anonfun $send$1.apply (syncproducer.scala:105)
At kafka.producer.syncproducer$ $anonfun $send$1.apply (syncproducer.scala:105)
At Kafka.metrics.KafkaTimer.time (kafkatimer.scala:33)
At Kafka.producer.SyncProducer.send (syncproducer.scala:104)
At kafka.producer.async.defaulteventhandler.kafka$producer$async$defaulteventhandler$ $send ( defaulteventhandler.scala:259)
At kafka.producer.async.defaulteventhandler$ $anonfun $dispatchserializeddata$2.apply (Defaulteventhandler.scala : 110)
At kafka.producer.async.defaulteventhandler$ $anonfun $dispatchserializeddata$2.apply (Defaulteventhandler.scala : 102)
At scala.collection.traversablelike$withfilter$ $anonfun $foreach$1.apply (traversablelike.scala:772)
At scala.collection.mutable.hashmap$ $anonfun $foreach$1.apply (hashmap.scala:98)
At scala.collection.mutable.hashmap$ $anonfun $foreach$1.apply (hashmap.scala:98)
At Scala.collection.mutable.hashtable$class.foreachentry (hashtable.scala:226)
At Scala.collection.mutable.HashMap.foreachEntry (hashmap.scala:39)
At Scala.collection.mutable.HashMap.foreach (hashmap.scala:98)
At Scala.collection.traversablelike$withfilter.foreach (traversablelike.scala:771)
At Kafka.producer.async.DefaultEventHandler.dispatchSerializedData (defaulteventhandler.scala:102)
At Kafka.producer.async.DefaultEventHandler.handle (defaulteventhandler.scala:75)
At Kafka.producer.Producer.send (producer.scala:77)
At Kafka.javaapi.producer.Producer.send (producer.scala:42)
At Org.apache.flume.sink.kafka.KafkaSink.process (kafkasink.java:135)
At Org.apache.flume.sink.DefaultSinkProcessor.process (defaultsinkprocessor.java:68)
At Org.apache.flume.sinkrunner$pollingrunner.run (sinkrunner.java:147)
At Java.lang.Thread.run (thread.java:745)
2016-04-16 16:43:34,079 (sinkrunner-pollingrunner-defaultsinkprocessor) [Info-kafka.utils.logging$class.info ( logging.scala:68)] Back off for MS before retrying send. Remaining retries = 3
2016-04-16 16:43:34,522 (Agent-shutdown-hook) [Info-org.apache.flume.lifecycle.lifecyclesupervisor.stop ( lifecyclesupervisor.java:79)] Stopping lifecycle Supervisor 12
This article is from the "Chocolate Black" blog, be sure to keep this source http://10120275.blog.51cto.com/10110275/1764526
Failed to send producer request with correlation ID 2 to broker 0 with