IBM BigInsights 3.0.0.2 Cluster Environment construction

1. Modify the Hosts file and the permanent host name

Because the Biginsights 3.0 version does not have the ability to add nodes directly with IP as in previous versions, we need to change the hosts file and hostname for each server:

Vim/etc/hosts Add the following lines to this file:

Vim/etc/sysconfig/network set the permanent hostname in this file:

2. Install Ksh

The server system does not contain the Ksh shell, because IBM DB2 requires this ksh be installed.

View all shell versions with Chsh–l and find no ksh, so use the Yum list \*ksh\* to view availablepackage:

A ksh.x86_64 installation package was found and then installed with the Yum install Ksh.

Success.

3. Shut Down IPv6

IPv6 might causeproblem with MapReduce workloads.

See if the server-side IPv6 module is loaded:

or with Ifconfig|. Grep–i Inet6 to view directly.

Close the IPV6, you can modify the/etc/hosts, the IPv6 of the local host name resolution comment out:

#::1 localhost Localhost6 localhost6.localdomain6

and create a new setup file:/etc/modprobe.d/ipv6off.conf:

Add to:

Alias net-pf-10 off

Options IPv6 disable=1

Then check to see if the IPv6 is closed after reboot:

4. Cluster time synchronization:

First half:

First set up time server, where I set 9.110.246.249 to Timeserver.

Date–s 03/11/2015

Date–s 16:19:50

Clock–w

Hwclock–systohc

The latter two commands are to write the set time to the hardware time central, that is, the CMOS inside time.

Then, in order to configure 9.110.246.249 as time server, modify the/etc/ntp.conf:

Vim/etc/ntp.conf

Comment out restrict default kod nomodifynotrap nopeer noquery this line

Join Restrict 9.110.246.247 mask255.255.255.255 nomodify notrap

Join the server 127.127.1.0

Join Fudge 127.127.1.0 Stratum 10

These two lines are to synchronize the ntpd of this machine with the local hardware time.

Then restart NTPD Services, service ntpd restart

Chkconfig ntpd on to set boot auto-start NTPD service

Next, modify the iptables to open the TCP and UDP ports because this is the port that NTP requires:

/sbin/iptables-i input-p TCP--dport 103-j ACCEPT

/sbin/iptables-i input-p UDP--dport 103-j ACCEPT

/etc/rc.d/init.d/iptables Save

/etc/rc.d/init.d/iptables restart

See if the port is open

/etc/init.d/iptables status

This 9.110.246.249 becomes a time server

Second part:

Now we configure 9.110.246.247,

Also modify/etc/ntp.conf:vim/etc/ntp.conf

Because 9.110.246.247 does not need to do time server, comment out restrictdefault kod nomodify notrap nopeer noquery this line

Join the server 9.110.246.249 to synchronize with the 9.110.246.249 server.

This time synchronization is done, and the default action after that is 5mins and Times server synchronization.

5. Change the mount partition of/home

Because biginsights at the time of installation, the master node will produce a default directory __biginsights_install before the installation succeeds, it is stored in the directory of/home, and our servers are mounted in/dev/ Mapper/volgroup-lv_home this partition, the current size of this partition is only 2 G, when installed, will produce cpwriting, no space left on the device error.

There are two scenarios to solve this problem, one is to expand the disk partition capacity, but doing so can be cumbersome and time consuming.

Another scenario is:

Back up and delete/home, or rename/home, and then CD/enter [[email protected]/].

Then in the current directory for home/home new, Mkdir/home. Here our/home is mounted under the/dev/mapper/volgroup-lv_root partition. Of course, in order to make it permanent, and not to restore the original Mount settings after a reboot, we need to change one more file, Vim/etc/fstab

Comment out this line and save it.

Here, we look at the partitioning situation here:

The/dev/mapper/volgroup-lv_home partition has been lost.

Note: The second half of the first step, steps and 4th steps need to be operated for each node, and the 5th step is only for the installation node.

After the above preparatory work, we can install, then get successful results:

Original address: http://blog.csdn.net/yangxiangyuibm/article/details/44491617

IBM BigInsights 3.0.0.2 Cluster Environment construction