Kafka+zookeeper Environment Configuration (MAC or Linux environment)

I. Zookeeper Download and Installation

1) Download

Ademacbook-pro:zookeeper_soft apple$ wget http://mirrors.cnnic.cn/apache/zookeeper/zookeeper-3.4.6/ Zookeeper-3.4.6.tar.gz

2) Unzip

Tar zxvf zookeeper-3.4. 6. tar.gz

3) configuration

CD zookeeper-3.4. 6

CP-RF conf/zoo_sample.cfg conf/zoo.cfg

Vim Zoo.cfg

Zoo.cfg:

# of milliseconds of each tickticktime= -# The number of ticks that the initial # synchronization phase can takeinitlimit=Ten# The number of ticks that can pass between # Sending a request and getting an acknowledgementsynclimit=5# The DirectorywhereThe snapshot isstored.# DoNot use/tmp forStorage,/tmp here isJust # example sakes. DataDir =/users/apple/documents/soft/zookeeper_soft/ zkdata #这个目录是预先创建的# The port at which the clients would connectclientport=2181# The maximum number of client connections.# increase This ifYou need to handle more Clients#maxclientcnxns= -# # is sure to read the maintenance sections of the # Administrator guide before turning on autopurge.## http://zookeeper.apache.org/doc/current/zookeeperadmin.html#sc_maintenance# # of snapshots to retaininchDatadir#autopurge.snapretaincount=3# Purge Task intervalinchhours# Set to"0"To disable Auto purge feature#autopurge.purgeinterval=1

4) Start Zookeeper

ademacbook-pro:bin apple$ sh zkserver.sh startjmx enabled bydefaultUsing config:/users/apple/documents/soft/zookeeper_soft/zookeeper-3.4.6/bin/. /conf/zoo.cfg-N Starting Zookeeper ... Startedademacbook-pro:bin apple$ PS ax| grep zookeeper. out 10311s003 s+0:00.01grep zookeeper. outAdemacbook-pro:bin apple$ PS ax|grep Zookeeper10307s003 S0:00.63/usr/bin/java-dzookeeper.log.dir=. -dzookeeper.root.logger=info,console-cp/users/apple/documents/soft/zookeeper_soft/zookeeper-3.4.6/bin/. /build/classes:/users/apple/documents/soft/zookeeper_soft/zookeeper-3.4.6/bin/. /build/lib/*.jar:/users/apple/documents/soft/zookeeper_soft/zookeeper-3.4.6/bin/. /lib/slf4j-log4j12-1.6.1.jar:/users/apple/documents/soft/zookeeper_soft/zookeeper-3.4.6/bin/. /lib/slf4j-api-1.6.1.jar:/users/apple/documents/soft/zookeeper_soft/zookeeper-3.4.6/bin/. /lib/netty-3.7.0.final.jar:/users/apple/documents/soft/zookeeper_soft/zookeeper-3.4.6/bin/. /lib/log4j-1.2.16.jar:/users/apple/documents/soft/zookeeper_soft/zookeeper-3.4.6/bin/. /lib/jline-0.9.94.jar:/users/apple/documents/soft/zookeeper_soft/zookeeper-3.4.6/bin/. /zookeeper-3.4.6.jar:/users/apple/documents/soft/zookeeper_soft/zookeeper-3.4.6/bin/. /src/java/lib/*.jar:/users/apple/documents/soft/zookeeper_soft/zookeeper-3.4.6/bin/. /conf:-dcom.sun.management.jmxremote-dcom.sun.management.jmxremote.local.only=false org.apache.zookeeper.server.quorum.quorumpeermain/users/apple/documents/soft/zookeeper_soft/zookeeper-3.4.6/ bin/. /conf/zoo.cfg 

Two downloads and installs Kafka (pre-installed Scala environment, MAC Environment Reference: http://www.cnblogs.com/super-d2/p/4534208.html)

1). Download Kafka:

wget http://apache.fayea.com/kafka/0.8.2.1/kafka_2.10-0.8.2.1.tgz

2) Unzip:

TAR-ZXF kafka_2.10-0.8.2.1.tgz

3) Start Kafka

ademacbook-pro:kafka_2.10-0.8.2.1 apple$ sh bin/kafka-server-start.sh config/server.properties

Note: To be hung in the background use:

SH bin/kafka-server-start.sh config/server.properties &

4) Create a new topic

1 1 --zookeeper localhost:2181

Note: To be hung in the background use:

SH kafka-topics.sh--create--topic kafkatopic--replication-factor 1--partitions 1--zookeeper localhost:2181 &

5) Start up the Kafka producers:

Ademacbook-pro:bin apple$ sh kafka-console-producer.sh--broker-list localhost:9092 --sync--topic kafkatopic

Note: To be hung in the background use:

SH kafka-console-producer.sh--broker-list localhost:9092--sync--topic kafkatopic &

6) Open another terminal to start up the consumer:

Ademacbook-pro:bin apple$ sh kafka-console-consumer.sh--zookeeper localhost:2181 --topic kafkatopic--  from-beginning

Note: To be hung in the background use:

SH kafka-console-consumer.sh--zookeeper localhost:2181--topic kafkatopic--from-beginning &

7) Use

1. Enter AAA at the terminal where the message is sent, which can be displayed at the end of the consumer message, as shown in:

Kafka+zookeeper Environment Configuration (MAC or Linux environment)