Storm Cluster Setup

Installation Environment:

Virtual operating system:centOS7 2 units

IP address is 192.168.1.10 192.168.1.11

Memory:1GB Memory

Zookeeper version:3.4.6

Storm version:0.9.6

Installation steps:

1, installation of JDK and other steps omitted.

1, download storm installation package, unzip.

1. Configuring the /apache-storm-0.9.6/conf/storm.yaml configuration file

# Licensed to the Apache software Foundation (ASF) under one

# or more contributor license agreements. See the NOTICE file

# Distributed with the additional information

# regarding copyright ownership. The ASF licenses this file

# to you under the Apache License, Version 2.0 (the

# "License"); Except in compliance

# with the License. Obtain a copy of the License at

#

# http://www.apache.org/licenses/LICENSE-2.0

#

# unless required by applicable or agreed to writing, software

# Distributed under the License is distributed on a "as is" BASIS,

# without warranties or CONDITIONS of any KIND, either express or implied.

# See the License for the specific language governing permissions and

# Limitations under the License.

########### these must be filled on for a storm configuration

Storm.zookeeper.servers:

-"192.168.1.10"

-"192.168.1.11"

Nimbus.host: "192.168.1.10"

Storm.local.dir: "/opt/stormtmp/data"

ui.port:8080

Supervisor.slots.ports:

-6700

-6701

-6702

-6703

#

#

# ##### These may optionally is filled in:

#

# # List of Custom Serializations

# Topology.kryo.register:

#-Org.mycompany.MyType

#-Org.mycompany.MyType2:org.mycompany.MyType2Serializer

#

# # List of custom Kryo decorators

# topology.kryo.decorators:

#-Org.mycompany.MyDecorator

#

# # Locations of the DRPC servers

# Drpc.servers:

#-"Server1"

#-"Server2"

# # Metrics Consumers

# Topology.metrics.consumer.register:

#-Class: "Backtype.storm.metric.LoggingMetricsConsumer"

# parallelism.hint:1

#-Class: "Org.mycompany.MyMetricsConsumer"

# parallelism.hint:1

# argument:

#-Endpoint: "Metrics-collector.mycompany.org"

Detailed configuration:

Storm.zookeeper.servers:ZooKeeper Server List

Supervisor.slots.ports: And only one worker is running per port . This configuration allows you to adjust the performance of each machine worker number . ( Adjust slots / per machine )

local file system directory used by Storm.local.dir:storm ( must exist and the storm process can read and write )

Nimbus.host:nimbus Server Address

Ui.port:Storm The service port of the UI

Nimbus.host:nimbus Server Address

2. Start storm. Start the Stormfirst.

./storm Nimbus &

./storm Supervisor &

./storm UI &

machine running with IP end

./storm Supervisor &

3, check the running status, Access localhost:8080, Enter the Storm UI interface to see the cluster success.

Storm Cluster Setup