Storm0.9.1 Cluster Environment installation Configuration

 

Storm installation Configuration

131,132,133 for three machines

JDK, Python, autoconf-2.64, zeromq-3.2.2, jzmq needs to be installed

Install JDK and python.

 

1 install autoconf-2.64,

1.1 download http://download.chinaunix.net/download.php? Id = 29328 & resourceid = 648

The working directory uploaded to Lunix, such as/home/bigdata/

Unzip tar-xvf autoconf-2.64.tar.bz2

Go to directory CD autoconf-2.64

Execute $./configure

$ Make

$ Make install

2. Install zeromq

2.1 Download http://download.zeromq.org/zeromq-3.2.2.tar.gz

Upload to/home/bigdata/

Decompress tar zxf zeromq-3.2.2.tar.gz

Go to directory zeromq-3.2.2

Execute $./configure

$ Make

$ Make install

3. Install jzmq

3.1 because this is a git project, you can install git to download it. I downloaded it from git on the window.

Git clone git: // github.com/nathanmarz/jzmq.git

There is a jzmq folder.

Change the jzmq/autogen. Sh file format from Doc to Lunix before uploading.

Upload to/home/bigdata/

Grant chmod-r 755 jzmq Permissions

CD/home/bigdata/jzmq/

$./Autogen. Sh

$./Configure

$ Touch src/classdist_noinst.stamp

$ CD src/org/zeromq/

$ Javac *. Java

$ CD/home/bigdata/jzmq

$ Make

$ Make install

$ Echo/usr/local/lib>/etc/lD. So. conf. d/local. conf

$ Ldconfig

$ Echo classpath =/usr/local/share/Java/zmq. jar:.>/etc/environment

$ Echo export LD_LIBRARY_PATH =/usr/local/lib>/etc/profile. d/ldlibrarypath. Sh

 

 

4. Install the zookeeper Cluster

Online Search

5. Install the storm Cluster

5.1 download http://storm.incubator.apache.org/downloads.html

Download APACHE-storm-0.9.1-incubating

Upload to/home/bigdata/

5.2 unzip tar-xvf apache-storm-0.9.1-incubating.tar.gz

Renamed mv apache-storm-0.9.1-incubating storm

Go to the directory CD/home/bigdata/storm/CONF/

VI storm. yaml my configuration is

########## These must be filled in for a storm Configuration

Storm. zookeeper. servers:

-"192.168.119.131"

-"192.168.119.132"

-"192.168.119.20"

#

Nimbus. HOST: hadoop2

Storm. Local. dir:/home/bigdata/storm/workdir

Ui. Port: 8088

Supervisor. Slots. ports:

-6700

-6701

-6702

-6703

5.3 configure environment variables (three machines are configured separately)

VI/etc/profile

Export storm_home =/home/bigdata/Storm

Path = $ storm_home/bin

Source/etc/profile

5.4 copy to remote machine

SCP-r storm [email protected]:/home/bigdata/

SCP-r storm [email protected]:/home/bigdata/

5.5 start storm

Start the zookeeper cluster first

Execute storm Nimbus on host 131

Execute JPs with the new srt Enabled

JPS 6008

4233 quorumpeermain

5496 Core

5289 Nimbus

 

 

 

 

Then on machines 132 and 133

In storm supervisor

5455 Supervisor

JPS 5912

4244 quorumpeermain

 

Execute storm UI on host 131

Http: // 192.168.119.131: 8088

 

Refer to some articles on the Internet:

Http://blog.csdn.net/willfcareer/article/details/8610122

Http://www.cnblogs.com/panfeng412/archive/2012/11/30/how-to-install-and-deploy-storm-cluster.html

Http://blog.csdn.net/comaple/article/details/7896167

Http://my.oschina.net/BreathL/blog/84165