kafka topic

One of the most important features of the Kafka theme is the ability to let consumers specify the subset of messages they want to consume. In extreme cases, it may not be a good idea to put all your data in the same topic, because consumers cannot choose the events they are interested in-they need to consume all the messages. Another extreme situation, having millions of different themes is not a good idea,

Tags: send zookeeper rod command customer Max AC ATI BlogThe content of this section: Create Kafka Topic View all Topic lists View specified topic information Console to topic Production data Data from the console consumption

Generally in the Kafka consumer can set up a number of themes, that in the same program needs to send Kafka different topics of the message, such as exceptions need to send to the exception topic, normal to send to the normal topic, this time you need to instantiate a number of topics, and then send each.Use the Rdkafk

Original: http://blog.csdn.net/changong28/article/details/39325079With Kafka, we know that each time we create a Kafka theme (Topic), we can specify the number of partitions and the number of copies, and if these properties are configured in the Server.properties file, the themes generated by the subsequent call to the Java API will use the default values. Change

partition Storage distribution in topicTopic can logically be thought of as a queue. Each consumption must specify its topic, which can be simply understood to indicate which queue to put the message in. In order to make the Kafka throughput can be scaled horizontally, the topic is physically divided into one or more partition, each partition physically correspon

Kafka officially provided two scripts to manage the topic, including additions and deletions to topic. Where kafka-topics.sh is responsible for the creation and deletion of topic, kafka-configs.sh script is responsible for

Structure:Nginx-flume->kafka->flume->kafka (because involved in the cross-room problem, between the two Kafka added a flume, egg pain. )Phenomenon:In the second layer, write Kafka topic and read Kafka

With Kafka, we know that each time we create a Kafka theme (Topic), we can specify the number of partitions and the number of copies, and if these properties are configured in the Server.properties file, the themes generated by the subsequent call to the Java API will use the default values. Change first need to use command bin/

If you are using Kafka to distribute messages, there may be exceptions or other errors in the process of data processing that can result in loss or inconsistency. This time you may want to Kafka the data through the new process, we know that Kafka by default will be saved on disk to 7 days of data, you just need to Kafka