Hadoop enterprise cluster architecture-NFS Installation

Hadoop enterprise cluster architecture-NFS Installation

Hadoop enterprise cluster architecture-NFS Installation

Server address: 192.168.1.230

Install NFS Software

Check whether nfs installation is complete

Rpm-qa | grep nfs

Check the rpcbind and nfs services

Systemctl list-unit-files | grep "nfs"

Systemctl list-unit-files | grep "rpcbind"

Systemctl enable nfs-server.service

Systemctl enable rpcbind. service

Systemctl list-unit-files | grep-E "rpcbind. service | nfs-server.service"

Check NFS and RPC statuses

Service rpcbind status

Service rpcbind status

Create a running account:

Groupadd grid

Useradd-m-s/bin/bash-g grid

Passwd grid

<Grid123>

Modify/ecc/expots

Add:

/Home/grid * (rw, sync, no_root_squash)

Restart rpcbind and nfs

Systemctl restart rpcbind

Systemctl restart nfs

Verification:

Showmount-e 192.168.1.230

Mount a shared directory on a node

NSF mounting Errror "wrong fs type, bad option

Solution:

Yum-y install nfs-utils

Mount-t nfs 192.168.1.230:/home/grid/nfs_share/

View mount

Mount

Set automatic mounting upon startup

Vi/etc/fstab

Add the following line:

192.168.1.230:/home/grid/nfs_share nfs ults 0 0

Configure SSH on NFS servers and nodes

Add the keys of each node to the NFS server.

Ssh h1.hadoop.com cat ~ /. Ssh/id_rsa.pub> ~ /. Ssh/authorized_keys

Ssh h2.hadoop.com cat ~ /. Ssh/id_rsa.pub> ~ /. Ssh/authorized_keys

Ssh h3.hadoop.com cat ~ /. Ssh/id_rsa.pub> ~ /. Ssh/authorized_keys

Id_rsa.pub

Create a soft connection to the shared directory file authorized_keys on each node

Install on each node

Yum-y install nfs-utils

Mkdir/nfs_share

Mount-t nfs 192.168.1.230:/home/grid/nfs_share/

Ln-s/nfs_share/. ssh/authorized_keys ~ /. Ssh/authorized_keys

You may also like the following articles about Hadoop:

Tutorial on standalone/pseudo-distributed installation and configuration of Hadoop2.4.1 under Ubuntu14.04

Install and configure Hadoop2.2.0 on CentOS

Build a Hadoop environment on Ubuntu 13.04

Cluster configuration for Ubuntu 12.10 + Hadoop 1.2.1

Build a Hadoop environment on Ubuntu (standalone mode + pseudo Distribution Mode)

Configuration of Hadoop environment in Ubuntu

Detailed tutorial on creating a Hadoop environment for standalone Edition