Storm distributed cluster Building

Storm distributed cluster Building 1, decompression storm compressed file

[[email protected] software]# tar -zxf apache-storm-0.10.0.tar.gz -C /opt/modules[[email protected] software]# cd /opt/modules[[email protected] modules]# mv apache-storm-0.10.0 storm-0.10.0

2. Configure Storm configuration Files

Deploying a dependent environment

Java 6+Python 2.6.6+

2.1. Deploy Zookeeper

3.4.5+ZK为什么要用3.4.5，因为它支持磁盘的快照和namenode的定期删除，避免磁盘被打满

Distributing Storm Packs

0.9.4+

2.2. Configure Storm

修改/opt/modules/storm-0.10.0/conf/目录下的storm.yaml配置文件[[email protected] conf]# pwd/opt/modules/storm-0.10.0/conf[[email protected] conf]# vi storm.yaml

storm.zookeeper.servers:     - "master"     - "slave1"     - "slave2"nimbus.host: "master"

2.3, the Master Host profile directory will be sent to Slave1, slave2

[[email protected] modules]# scp -r storm-0.10.0 [email protected]:/opt/modules/storm-0.10.0[[email protected] modules]# scp -r storm-0.10.0 [email protected]:/opt/modules/storm-0.10.0

3, start Storm3.1, start zookeeper

/opt/modules/zookeeper/bin/zkServer.sh status/opt/modules/zookeeper/bin/zkServer.sh start

3.2. Start Niumbus

[[email protected] storm-0.10.0]# cd /opt/modules/storm-0.10.0[[email protected] storm-0.10.0]# ./bin/storm nimbus >> logs/nimbus.out 2>&1 &

[[email protected] storm-0.10.0]# tail -f logs/nimbus.log

3.3. Start the Storm Web UI

[[email protected] ~]# cd /opt/modules/storm-0.10.0[[email protected] storm-0.10.0]# ./bin/storm ui >> logs/ui.out 2>&1 &

[[email protected] storm-0.10.0]# tail -f logs/ui.log

View the Storm Web UI

在浏览器地址栏中输入：http://192.168.230.129:8080

3.4. Start Supervisor

Start the supervisor in master

[[email protected] ~]# cd /opt/modules/storm-0.10.0[[email protected] storm-0.10.0]# ./bin/storm supervisor >> logs/supervisor.out 2>&1 &

[[email protected] storm-0.10.0]# tail -f logs/supervisor.log

Start the supervisor in Slave1

[[email protected] storm-0.10.0]# ./bin/storm supervisor >> logs/supervisor.out 2>&1 &

[[email protected] storm-0.10.0]# tail -f logs/supervisor.log

Start the supervisor in Slave2

[[email protected] storm-0.10.0]# ./bin/storm supervisor >> logs/supervisor.out 2>&1 &

[[email protected] storm-0.10.0]# tail -f logs/supervisor.log

3.5. Start Logviewer

[[email protected] storm-0.10.0]# ./bin/storm logviewer >> logs/logviewer.out 2>&1 &[[email protected] storm-0.10.0]# tail -f logs/logviewer.log

Verify: Browser opens webui,http://192.168.230.129:8080

3.6. Submit topology in Master

[[email protected] storm-0.10.0]# ./bin/storm jar examples/storm-starter/storm-starter-topologies-0.10.0.jar storm.starter.WordCountTopology wordcount

Storm distributed cluster Building