Flume high concurrency Optimization--(5) kafkaoffsetmonitor__ optimization

This film blog is introduced a Kafka monitoring software to match the Flume Kafka channel performance, in fact, this is a very simple project, we just need to download a good jar package, you can use the

1, download jar package

Http://pan.baidu.com/s/1eSPlzpw

2, start

JAVA-CP kafkaoffsetmonitor-assembly-0.2.0.jar \
 com.quantifind.kafka.offsetapp.OffsetGetterWeb \
 --zk 192.168.2.16:2181 \
 --port 8089 \
 --refresh 10.seconds \
 --retain 30.days

3, view

Input URL, mine is http://192.168.10.84:8089

Effect:

3, parameter description

Topic: Create Topic Name
Partition: Partition number
Offset: Indicates how much message the parition has consumed
LogSize: Indicates how much message the partition produced
Lag: Indicates how many of the message has not been consumed
Owner: Means consumer
Created: Indicates the partition creation time
Last seen: Indicates consumption status refresh latest time

Summarize:

Through observation we found that now although Kafka pressure is not, but basically performance bottlenecks in the pressure of Kafka and Es, so that we can eat dinner at ease, will not be wake up in the middle of the night to adjust the bug. This shows how smart a decision is to simplify the architecture. I hope these blogs can help you and not be woken up in the middle of the night.