storm-1.0.1+zookeeper-3.4.8+netty-4.1.3 ha cluster installation

Source: Internet
Author: User

storm-1.0.1+zookeeper-3.4.8+netty-4.1.3ha cluster installationDownload Storm-1.0.1http//Mirrors.tuna.tsinghua.edu.cn/apache/storm/apache-storm-1.0.1/apache-storm-1.0.1.tar.gzDownload ZooKeeper-3.4.8http//Mirrors.cnnic.cn/apache/zookeeper/zookeeper-3.4.8/zookeeper-3.4.8.tar.gzDownload Netty-4.1.3. FINAL.TAR.BZ2 http://akamai.bintray.com/e7/e769383d99e244b7173b496f90f9b4a00574f8a33cdec2fe40b54f957a373e01?__gda__=exp=1469008981~ hmac=7f3864e58af529209d0c0460cc3d5a73f267d7b550ad82bf14c0f645f8608e74&response-content-disposition= Attachment%3bfilename%3d%22netty-4.1.3.final.tar.bz2%22&response-content-type=application%2fx-bzip2The package is as follows: apache-storm-1.0.1. tar.gz jdk-7u65-linux-X64.tar.gz netty-4.1.3. FINAL.TAR.BZ2 zookeeper-3.4.8. tar.gz Cluster Planning host IP Soft Process nimbus01 192.168.14.162Netty, Storm Nimbus, Core, Logviewer NIMBUS02 192.168.14.156Netty, Storm Nimbus, Logviewer Supervisor01 192.168.14.59Netty, ZooKeeper, Storm supervisor, Logviewer Supervisor02 192.168.14.119Netty, ZooKeeper, Storm supervisor, Logviewer supervisor03 192.168.14.139Netty, ZooKeeper, Storm supervisor, logviewer One, configure password-free login two, install JDK on all nodes install JDK cd/usr/local/soft/TAR-ZXVF jdk-7u65-linux-x64.tar.gz CD jdk1.7.0_65 vim/etc/Profile Export java_home=/usr/local/soft/jdk1.7.0_65 export path=.: $JAVA _home/Bin: $PATH source/etc/Profile three, installation ZooKeeper-3.4.8Configure cd/usr/local/soft/on the Supervisor01 nodeTAR-ZXVF zookeeper-3.4.8. tar.gz CD zookeeper-3.4.8MV Conf/zoo_sample.cfg conf/Zoo.cfg Vim conf/Zoo.cfg ticktime=2000initlimit=10Synclimit=5datadir=/usr/local/soft/zookeeper-3.4.8/Data clientport=2181server.1=suspervisor01:2888:3888server.2=suspervisor02:2888:3888server.3=suspervisor03:2888:3888mkdir data && echo "1" >data/myID copy the zookeeper to Supervisor02 on the Supervisor01 node scp-r/usr/local/soft/zookeeper-3.4.8 [Email protected]:/usr/local/ soft/echo "2" >/usr/local/soft/zookeeper-3.4.8/data/myID copy the zookeeper to supervisor03 on the Supervisor01 node scp-r/usr/local/soft/zookeeper-3.4.8 [Email protected]:/usr/local/ soft/echo "3" >/usr/local/soft/zookeeper-3.4.8/data/myID Four, install Storm-1.0.1Configure cd/usr/local/soft/on the NIMBUS01 nodeTAR-ZXVF apache-storm-1.0.1. tar.gz CD apache-storm-1.0.1Vim conf/"Supervisor03"# # # # # of Storm Nimbus Nodes HA # # # Nimbus.seeds: ["nimbus01", "NIMBUS02"# # # # # # Storm Local Storage # # # Storm.local.dir: "/usr/local/soft/apache-storm-1.0.1/localdir"# # # # # # # # # # # # Storm Supervisor Nodes Worker Process # supervisor.slots.ports:-6700-6701-6702-6703# # # # # # # # # # # Selector ZeroMQ, Storm use Netty Transport Protocol # # Storm.messaging.transport: "org.apache.storm.messaging . Netty. Context "Storm.messaging.netty.server_worker_threads:1Storm.messaging.netty.client_worker_threads:1storm.messaging.netty.buffer_size:5242880storm.messaging.netty.max_retries:300storm.messaging.netty.max_wait_ms:1000storm.messaging.netty.min_wait_ms:100mkdir Localdir replicate NIMBUS01 nodes on the storm to Nimbus02, Supervisor01, Supervisor02, supervisor03 scp-r/usr/local/soft/ apache-storm-1.0.1 [Email protected]:/usr/local/soft/Scp-r/usr/local/soft/apache-storm-1.0.1 [Email protected]:/usr/local/soft/Scp-r/usr/local/soft/apache-storm-1.0.1 [Email protected]:/usr/local/soft/Scp-r/usr/local/soft/apache-storm-1.0.1 [Email protected]:/usr/local/soft/V. Launch cluster 1, ZooKeeper start the clusterFor i in Supervisor01 Supervisor02 supervisor03;do echo $i; SSH $i "source/etc/profile; /usr/local/soft/zookeeper-3.4.8/bin/zkserver.sh Start "; Done Close the clusterFor i in Supervisor01 Supervisor02 supervisor03;do echo $i; SSH $i "source/etc/profile; /usr/local/soft/zookeeper-3.4.8/bin/zkserver.sh Stop "; Done View Zookeeper process statusFor i in Supervisor01 Supervisor02 supervisor03;do echo $i; SSH $i "source/etc/profile; /usr/local/soft/zookeeper-3.4.8/bin/zkserver.sh status "; Done View ProcessFor i in Supervisor01 Supervisor02 supervisor03;do echo $i; SSH $i "source/etc/profile; JPs; Done 2, start storm (need to ensure that the zookeeper cluster is started) Start Nimbus (Storm.yaml nimbus.seeds: [] nodes need to start the Nimbus process) on the NIMBUS01 start the following process nohup/usr/ Local/soft/apache-storm-1.0.1/bin/storm Nimbus &Nohup/usr/local/soft/apache-storm-1.0.1/bin/storm UI &Nohup/usr/local/soft/apache-storm-1.0.1/bin/storm Logviewer &start the following process on Nimbus02 nohup/usr/local/soft/apache-storm-1.0.1/bin/storm Nimbus & nohup/usr/local/soft/ Apache-storm-1.0.1/bin/storm Logviewer & Start the following process on Supervisor01 nohup/usr/local/soft/apache-storm-1.0.1/bin/ Storm Supervisor & nohup/usr/local/soft/apache-storm-1.0.1/bin/storm Logviewer &  Start the following process on Supervisor02 nohup/usr/local/soft/apache-storm-1.0.1/bin/storm Supervisor & nohup/usr/local/soft/ Apache-storm-1.0.1/bin/storm Logviewer & Start the following process on Supervisor03 nohup/usr/local/soft/apache-storm-1.0.1/bin/ Storm Supervisor & nohup/usr/local/soft/apache-storm-1.0.1/bin/storm logviewer &    

storm-1.0.1+zookeeper-3.4.8+netty-4.1.3 ha cluster installation

Contact Us

The content source of this page is from Internet, which doesn't represent Alibaba Cloud's opinion; products and services mentioned on that page don't have any relationship with Alibaba Cloud. If the content of the page makes you feel confusing, please write us an email, we will handle the problem within 5 days after receiving your email.

If you find any instances of plagiarism from the community, please send an email to: info-contact@alibabacloud.com and provide relevant evidence. A staff member will contact you within 5 working days.

A Free Trial That Lets You Build Big!

Start building with 50+ products and up to 12 months usage for Elastic Compute Service

  • Sales Support

    1 on 1 presale consultation

  • After-Sales Support

    24/7 Technical Support 6 Free Tickets per Quarter Faster Response

  • Alibaba Cloud offers highly flexible support services tailored to meet your exact needs.