Install Graph Analytics cluster in CentOS
Official installation documentation:
Https://github.com/dato-code/PowerGraph/blob/master/TUTORIALS.md#cluster
Operating System: centos6.5 64
1. First install graphlab on a node. My installation path is/home/liulan/software/
2. Install the dependent software gcc, c ++, git, make, cmake, openmpi, autoconf, automake... and install it using yum. Note that the paths of each node in openmpi must be consistent.
3. download the software and run configure:
[Plain] view plaincopy
- Gitclonehttps: // github.com/graphlab-code/graphlab.git
- Cdgraphlab
- ./Configure
4. Select the toolkit to be installed and compile graph_analytics. Run the following command:
[Plain] view plaincopy
- Cdrelease/toolkits/graph_analytics
- Make-j4
An error occurred while arriving here. The error is as follows:
This section was solved by the help of both of them ..
It seems that the shared dynamic library cannot be generated. The specific method is to change the ldflags content of the makefile file in hadoop, as follows:
Finally, we can see that the bright green file is crying ..
(PS:. so is the dynamic link library,. a static Link Library)
5. Next, deploy the distributed environment. Create a machines file in the current home directory, write the ip addresses of each node, and press enter to separate each ip address;
[Plain] view plaincopy
- 10.1.1.103
- 10.1.1.101
- 10.1.1.105
6. Make sure that this file exists in the same directory on each machine;
7. set ssh password-free login between each machine. The method I use seems a bit strange, but it is very simple: Set the password on the master node. copy the ssh folder to another machine, and then copy. change the ssh/id_rsa File Permission to 600, as mentioned in the previous article;
8. Run the following command on the graphlab (master) node to copy the GraphLab file to all machines:
[Plain] view plaincopy
- Cd/home/liulan/software/graphlab/release/toolkits
- <Prename = "code" class = "plain">/home/liulan/software/<spanstyle = "font-family: Arial, Helvetica, sans-serif; "> graphlab/scripts/mpirsync </span>
[Plain] view plaincopy
- /Home/liulan/software/<spanstyle = "font-family: Arial, Helvetica, sans-serif;"> graphlab/deps/local </span>
[Plain] view plaincopy
- /Home/liulan/software/<spanstyle = "font-family: Arial, Helvetica, sans-serif;"> graphlab/scripts/mpirsync </span>
My openmpi may not be configured. You need to modify the mpirsync file:
After running mpirsync, I found that rsync was not installed, So I configured rsync again. There are a lot of online information;
This step should be successful later;
Hadoop does not need to be configured, and the process is very simple. Now you can run your own program;
Chinese installation documents: http://blog.csdn.net/zongzhou1234/article/details/39972495