Hadoop cluster Master Node deployment scenario

Ø change/etc/hosts, add all cluster machine IP to host name mappings

Ø copy Hadoop package hadoop.tar.gz to/usr/local

Ømd5sum Check hadoop.tar.gz package: md5sum hadoop.tar.gz

Ø Decompression hadoop.tar.gz Package: Tar-xzf hadoop.tar.gz

Ø Change hadoop-1.0.3 directory permissions: Chown-r hadoop:hadoop hadoop-1.0.3

Ø build Hadoop directory Soft link: ln-s hadoop-1.0.3 Hadoop

Ø set up the/home/bin directory and copy the tool to the directory

Ø Change the/home/bin directory permission to 777

Ø to install TCL and expect tools with root authority, the following steps are as follows:

1. Create a soft directory under/home/bin

2. Copy the expect-5.43.0.tar.gz and tcl8.4.11-src.tar.gz to the soft directory and unzip

3. Change expect-5.43.0 and tcl8.4.11 permissions to Hadoop:chown-r Hadoop:hadoop

Ø installation Tcl:

A. Execution sed-i "S/relid '/relid/" Configure

B. implementation./configure--prefix=/expect

C. Execute make

D. Execute make Install

E. Implementation of Mkdir-p/tools/lib

F. Implementing the CP tclconfig.sh/tools/lib/

G. Export the/tools/bin directory to an environment variable

Tclpath=/tools/bin

Export Tclpath

Ø installation Expect:

A. Enter the/soft/expect-5.43 directory

B. Implementation./configure--prefix=/tools--with-tcl=/tools/lib--with-x=no

C. If the last line prompts:

Configure:error:Can ' t find Tcl private headers

Need to add a header file directory parameter

--with-tclinclude=. /tcl8.4.11/generic, i.e.

./configure--prefix=/tools--with-tcl=/tools/lib--with-x=no--with-tclinclude=. /tcl8.4.11/generic

.. /tcl8.4.11/generic is TCL decompression after the installation of the path, make sure that the path exists

D. Execute make

E. Execute make Install

F. Generate expect command in/tools/bin after compilation is complete

G. Execution/tools/bin/expect The expect1.1> prompt indicates that the expect installation was successful.

Ø generate the public and private key files in the Hadoop root directory:

A.SSH-KEYGEN-T RSA

B.cat id_rsa.pub > Authorized_keys

C.chmod 644 Authorized_keys

Ø Change the Conf file of the Hadoop cluster, modify the corresponding hostname, port, HTTP address, etc.

Ø establish the trust relationship of master node to all Datanode

Ø modify the. bash_profile file, add/home/bin to the environment variable, and export the environment variable

Ø Change/hadoop-disk or other permission to use disk is Hadoop:chown-r Hadoop:hadoop