Storm distributed cluster Building

Source: Internet
Author: User

Storm distributed cluster Building 1, decompression storm compressed file

[[email protected] software]# tar -zxf apache-storm-0.10.0.tar.gz -C /opt/modules[[email protected] software]# cd /opt/modules[[email protected] modules]# mv apache-storm-0.10.0 storm-0.10.0

2. Configure Storm configuration Files

Deploying a dependent environment

Java 6+Python 2.6.6+
2.1. Deploy Zookeeper
3.4.5+ZK为什么要用3.4.5,因为它支持磁盘的快照和namenode的定期删除,避免磁盘被打满

Distributing Storm Packs

0.9.4+
2.2. Configure Storm
修改/opt/modules/storm-0.10.0/conf/目录下的storm.yaml配置文件[[email protected] conf]# pwd/opt/modules/storm-0.10.0/conf[[email protected] conf]# vi storm.yaml

storm.zookeeper.servers:     - "master"     - "slave1"     - "slave2"nimbus.host: "master"

2.3, the Master Host profile directory will be sent to Slave1, slave2
[[email protected] modules]# scp -r storm-0.10.0 [email protected]:/opt/modules/storm-0.10.0[[email protected] modules]# scp -r storm-0.10.0 [email protected]:/opt/modules/storm-0.10.0
3, start Storm3.1, start zookeeper
/opt/modules/zookeeper/bin/zkServer.sh status/opt/modules/zookeeper/bin/zkServer.sh start
3.2. Start Niumbus
[[email protected] storm-0.10.0]# cd /opt/modules/storm-0.10.0[[email protected] storm-0.10.0]# ./bin/storm nimbus >> logs/nimbus.out 2>&1 &

[[email protected] storm-0.10.0]# tail -f logs/nimbus.log

3.3. Start the Storm Web UI
[[email protected] ~]# cd /opt/modules/storm-0.10.0[[email protected] storm-0.10.0]# ./bin/storm ui >> logs/ui.out 2>&1 &

[[email protected] storm-0.10.0]# tail -f logs/ui.log

View the Storm Web UI
在浏览器地址栏中输入:http://192.168.230.129:8080

3.4. Start Supervisor

Start the supervisor in master

[[email protected] ~]# cd /opt/modules/storm-0.10.0[[email protected] storm-0.10.0]# ./bin/storm supervisor >> logs/supervisor.out 2>&1 &

[[email protected] storm-0.10.0]# tail -f logs/supervisor.log

Start the supervisor in Slave1

[[email protected] storm-0.10.0]# ./bin/storm supervisor >> logs/supervisor.out 2>&1 &

[[email protected] storm-0.10.0]# tail -f logs/supervisor.log

Start the supervisor in Slave2

[[email protected] storm-0.10.0]# ./bin/storm supervisor >> logs/supervisor.out 2>&1 &

[[email protected] storm-0.10.0]# tail -f logs/supervisor.log

3.5. Start Logviewer
[[email protected] storm-0.10.0]# ./bin/storm logviewer >> logs/logviewer.out 2>&1 &[[email protected] storm-0.10.0]# tail -f logs/logviewer.log

Verify: Browser opens webui,http://192.168.230.129:8080

3.6. Submit topology in Master
[[email protected] storm-0.10.0]# ./bin/storm jar examples/storm-starter/storm-starter-topologies-0.10.0.jar storm.starter.WordCountTopology wordcount

Storm distributed cluster Building

Contact Us

The content source of this page is from Internet, which doesn't represent Alibaba Cloud's opinion; products and services mentioned on that page don't have any relationship with Alibaba Cloud. If the content of the page makes you feel confusing, please write us an email, we will handle the problem within 5 days after receiving your email.

If you find any instances of plagiarism from the community, please send an email to: info-contact@alibabacloud.com and provide relevant evidence. A staff member will contact you within 5 working days.

A Free Trial That Lets You Build Big!

Start building with 50+ products and up to 12 months usage for Elastic Compute Service

  • Sales Support

    1 on 1 presale consultation

  • After-Sales Support

    24/7 Technical Support 6 Free Tickets per Quarter Faster Response

  • Alibaba Cloud offers highly flexible support services tailored to meet your exact needs.