Storm distributed cluster Building 1, decompression storm compressed file
[[email protected] software]# tar -zxf apache-storm-0.10.0.tar.gz -C /opt/modules[[email protected] software]# cd /opt/modules[[email protected] modules]# mv apache-storm-0.10.0 storm-0.10.0
2. Configure Storm configuration Files
Deploying a dependent environment
Java 6+Python 2.6.6+
2.1. Deploy Zookeeper
3.4.5+ZK为什么要用3.4.5,因为它支持磁盘的快照和namenode的定期删除,避免磁盘被打满
Distributing Storm Packs
0.9.4+
2.2. Configure Storm
修改/opt/modules/storm-0.10.0/conf/目录下的storm.yaml配置文件[[email protected] conf]# pwd/opt/modules/storm-0.10.0/conf[[email protected] conf]# vi storm.yaml
storm.zookeeper.servers: - "master" - "slave1" - "slave2"nimbus.host: "master"
2.3, the Master Host profile directory will be sent to Slave1, slave2
[[email protected] modules]# scp -r storm-0.10.0 [email protected]:/opt/modules/storm-0.10.0[[email protected] modules]# scp -r storm-0.10.0 [email protected]:/opt/modules/storm-0.10.0
3, start Storm3.1, start zookeeper
/opt/modules/zookeeper/bin/zkServer.sh status/opt/modules/zookeeper/bin/zkServer.sh start
3.2. Start Niumbus
[[email protected] storm-0.10.0]# cd /opt/modules/storm-0.10.0[[email protected] storm-0.10.0]# ./bin/storm nimbus >> logs/nimbus.out 2>&1 &
[[email protected] storm-0.10.0]# tail -f logs/nimbus.log
3.3. Start the Storm Web UI
[[email protected] ~]# cd /opt/modules/storm-0.10.0[[email protected] storm-0.10.0]# ./bin/storm ui >> logs/ui.out 2>&1 &
[[email protected] storm-0.10.0]# tail -f logs/ui.log
View the Storm Web UI
在浏览器地址栏中输入:http://192.168.230.129:8080
3.4. Start Supervisor
Start the supervisor in master
[[email protected] ~]# cd /opt/modules/storm-0.10.0[[email protected] storm-0.10.0]# ./bin/storm supervisor >> logs/supervisor.out 2>&1 &
[[email protected] storm-0.10.0]# tail -f logs/supervisor.log
Start the supervisor in Slave1
[[email protected] storm-0.10.0]# ./bin/storm supervisor >> logs/supervisor.out 2>&1 &
[[email protected] storm-0.10.0]# tail -f logs/supervisor.log
Start the supervisor in Slave2
[[email protected] storm-0.10.0]# ./bin/storm supervisor >> logs/supervisor.out 2>&1 &
[[email protected] storm-0.10.0]# tail -f logs/supervisor.log
3.5. Start Logviewer
[[email protected] storm-0.10.0]# ./bin/storm logviewer >> logs/logviewer.out 2>&1 &[[email protected] storm-0.10.0]# tail -f logs/logviewer.log
Verify: Browser opens webui,http://192.168.230.129:8080
3.6. Submit topology in Master
[[email protected] storm-0.10.0]# ./bin/storm jar examples/storm-starter/storm-starter-topologies-0.10.0.jar storm.starter.WordCountTopology wordcount
Storm distributed cluster Building