storm-1.0.1+zookeeper-3.4.8+netty-4.1.3 ha cluster installation

storm-1.0.1+zookeeper-3.4.8+netty-4.1.3ha cluster installationDownload Storm-1.0.1http//Mirrors.tuna.tsinghua.edu.cn/apache/storm/apache-storm-1.0.1/apache-storm-1.0.1.tar.gzDownload ZooKeeper-3.4.8http//Mirrors.cnnic.cn/apache/zookeeper/zookeeper-3.4.8/zookeeper-3.4.8.tar.gzDownload Netty-4.1.3. FINAL.TAR.BZ2 http://akamai.bintray.com/e7/e769383d99e244b7173b496f90f9b4a00574f8a33cdec2fe40b54f957a373e01?__gda__=exp=1469008981~ hmac=7f3864e58af529209d0c0460cc3d5a73f267d7b550ad82bf14c0f645f8608e74&response-content-disposition= Attachment%3bfilename%3d%22netty-4.1.3.final.tar.bz2%22&response-content-type=application%2fx-bzip2The package is as follows: apache-storm-1.0.1. tar.gz jdk-7u65-linux-X64.tar.gz netty-4.1.3. FINAL.TAR.BZ2 zookeeper-3.4.8. tar.gz Cluster Planning host IP Soft Process nimbus01 192.168.14.162Netty, Storm Nimbus, Core, Logviewer NIMBUS02 192.168.14.156Netty, Storm Nimbus, Logviewer Supervisor01 192.168.14.59Netty, ZooKeeper, Storm supervisor, Logviewer Supervisor02 192.168.14.119Netty, ZooKeeper, Storm supervisor, Logviewer supervisor03 192.168.14.139Netty, ZooKeeper, Storm supervisor, logviewer One, configure password-free login two, install JDK on all nodes install JDK cd/usr/local/soft/TAR-ZXVF jdk-7u65-linux-x64.tar.gz CD jdk1.7.0_65 vim/etc/Profile Export java_home=/usr/local/soft/jdk1.7.0_65 export path=.: $JAVA _home/Bin: $PATH source/etc/Profile three, installation ZooKeeper-3.4.8Configure cd/usr/local/soft/on the Supervisor01 nodeTAR-ZXVF zookeeper-3.4.8. tar.gz CD zookeeper-3.4.8MV Conf/zoo_sample.cfg conf/Zoo.cfg Vim conf/Zoo.cfg ticktime=2000initlimit=10Synclimit=5datadir=/usr/local/soft/zookeeper-3.4.8/Data clientport=2181server.1=suspervisor01:2888:3888server.2=suspervisor02:2888:3888server.3=suspervisor03:2888:3888mkdir data && echo "1" >data/myID copy the zookeeper to Supervisor02 on the Supervisor01 node scp-r/usr/local/soft/zookeeper-3.4.8 [Email protected]:/usr/local/ soft/echo "2" >/usr/local/soft/zookeeper-3.4.8/data/myID copy the zookeeper to supervisor03 on the Supervisor01 node scp-r/usr/local/soft/zookeeper-3.4.8 [Email protected]:/usr/local/ soft/echo "3" >/usr/local/soft/zookeeper-3.4.8/data/myID Four, install Storm-1.0.1Configure cd/usr/local/soft/on the NIMBUS01 nodeTAR-ZXVF apache-storm-1.0.1. tar.gz CD apache-storm-1.0.1Vim conf/"Supervisor03"# # # # # of Storm Nimbus Nodes HA # # # Nimbus.seeds: ["nimbus01", "NIMBUS02"# # # # # # Storm Local Storage # # # Storm.local.dir: "/usr/local/soft/apache-storm-1.0.1/localdir"# # # # # # # # # # # # Storm Supervisor Nodes Worker Process # supervisor.slots.ports:-6700-6701-6702-6703# # # # # # # # # # # Selector ZeroMQ, Storm use Netty Transport Protocol # # Storm.messaging.transport: "org.apache.storm.messaging . Netty. Context "Storm.messaging.netty.server_worker_threads:1Storm.messaging.netty.client_worker_threads:1storm.messaging.netty.buffer_size:5242880storm.messaging.netty.max_retries:300storm.messaging.netty.max_wait_ms:1000storm.messaging.netty.min_wait_ms:100mkdir Localdir replicate NIMBUS01 nodes on the storm to Nimbus02, Supervisor01, Supervisor02, supervisor03 scp-r/usr/local/soft/ apache-storm-1.0.1 [Email protected]:/usr/local/soft/Scp-r/usr/local/soft/apache-storm-1.0.1 [Email protected]:/usr/local/soft/Scp-r/usr/local/soft/apache-storm-1.0.1 [Email protected]:/usr/local/soft/Scp-r/usr/local/soft/apache-storm-1.0.1 [Email protected]:/usr/local/soft/V. Launch cluster 1, ZooKeeper start the clusterFor i in Supervisor01 Supervisor02 supervisor03;do echo $i; SSH $i "source/etc/profile; /usr/local/soft/zookeeper-3.4.8/bin/zkserver.sh Start "; Done Close the clusterFor i in Supervisor01 Supervisor02 supervisor03;do echo $i; SSH $i "source/etc/profile; /usr/local/soft/zookeeper-3.4.8/bin/zkserver.sh Stop "; Done View Zookeeper process statusFor i in Supervisor01 Supervisor02 supervisor03;do echo $i; SSH $i "source/etc/profile; /usr/local/soft/zookeeper-3.4.8/bin/zkserver.sh status "; Done View ProcessFor i in Supervisor01 Supervisor02 supervisor03;do echo $i; SSH $i "source/etc/profile; JPs; Done 2, start storm (need to ensure that the zookeeper cluster is started) Start Nimbus (Storm.yaml nimbus.seeds: [] nodes need to start the Nimbus process) on the NIMBUS01 start the following process nohup/usr/ Local/soft/apache-storm-1.0.1/bin/storm Nimbus &Nohup/usr/local/soft/apache-storm-1.0.1/bin/storm UI &Nohup/usr/local/soft/apache-storm-1.0.1/bin/storm Logviewer &start the following process on Nimbus02 nohup/usr/local/soft/apache-storm-1.0.1/bin/storm Nimbus & nohup/usr/local/soft/ Apache-storm-1.0.1/bin/storm Logviewer & Start the following process on Supervisor01 nohup/usr/local/soft/apache-storm-1.0.1/bin/ Storm Supervisor & nohup/usr/local/soft/apache-storm-1.0.1/bin/storm Logviewer &  Start the following process on Supervisor02 nohup/usr/local/soft/apache-storm-1.0.1/bin/storm Supervisor & nohup/usr/local/soft/ Apache-storm-1.0.1/bin/storm Logviewer & Start the following process on Supervisor03 nohup/usr/local/soft/apache-storm-1.0.1/bin/ Storm Supervisor & nohup/usr/local/soft/apache-storm-1.0.1/bin/storm logviewer &    

storm-1.0.1+zookeeper-3.4.8+netty-4.1.3 ha cluster installation