Error analysis of storm cluster construction

Click "Program Life" above and select "Public number"

The first time to focus on the program ape (daughter) side of the story

First of all, the storm cluster is no longer mentioned, there are many online, here is recommended one:

http://blog.csdn.net/lzm1340458776/article/details/45370381

This is a good writing, or more detailed construction steps , but there are some pits are not filled, it may be I met, in this proposed a number of construction process encountered problems in the solution, to everyone reference:

1. java. net. Connectexception

This is the first error, because the test is now successful, so log the error, view the log so that we developers must have skills.

Analysis: in general, this problem is our zookeeper out of the problem, this is before the zookeeper cluster, the number second machine out of the question:

After you have set up the zookeeper cluster, you must first start the test and check the status of each one to ensure that the zookeeper cluster does not have a problem.

The commands to view the status are:

.. /bin/zkserver.sh status

2. Java.net.NoRouteToHostException

This question believes that we should be able to find out easily, or Kafka connection zookeeper failed

Here are two points, or relatively simple, but also easy to write wrong:

One-size machine:

Machine Number Second:

Zookeeper.connect is the same, No. Third machine does not write, distinguish host.name on the line.

3. Deny connection

This question is also baffled me, searched a lot of information did not find the solution, I briefly summed up some of the previous masters of the solution:

(1) shutting down the firewall

But my computer is centos7,firewall in principle will not affect, and the default is also closed, so this solution for me is useless;

(2) An old driver Master said that it is zookeeper configuration of other machine information, I use is zookeeper cluster Ah, of course, with other machine information, this and storm cluster no conflict ah, so I followed his plan to try, still did not solve the problem;

(3) my own solution.

Here to thank captain_hwz the old master, not that he told me how to solve the problem, but he also wrote a storm cluster to build a document, and then there happened to have such a sentence

This sentence I read a lot of articles are not found, so has not been noticed, because I in the experimental phase, no such sentence can also connect (although error)

So the secret is here to untie, the Storm.yaml on each server is copied to the/root/.storm/storm.yaml, so that the project started to run flawlessly, the Shanghai stock:

Eventually

write in the end: If the above problems have been resolved or not able to start normally, it is recommended to close the storm cluster and Storm-ui, and then turn on Storm-nimbus,storm-supervisor (1), Storm-supervisor (2), Storm-ui, pay attention to the speed not too fast, and so on every boot success and then proceed to the next step, because it involves the system performance problem (My Computer configuration, CPU is not too much power), so to consider hardware reasons.

Speaking of which, I wish you all the best to build success and take another step on big data processing.

Click picture Get previous content