hadoop2.6-cdh5.7 Deployment Installation

CDH Address

http://archive-primary.cloudera.com/cdh5/cdh/5/

Add sudo permissions to a Hadoop user without password access

# useradd hadoop# vi /etc/sudoers    hadoop  ALL=(root)      NOPASSWD:ALL# su - hadoop

Download unzip

Modify configuration first requires jdk1.7

[[email protected] jdk1.7.0_80]# echo $JAVA_HOME/usr/java/jdk1.7.0_80

Modify the etc/hadoop/hadoop-env.sh file

在hadoop-env.sh文件中修改java_homeexport JAVA_HOME=/usr/java/jdk1.7.0_80增加HADOOP_PREFIXexport HADOOP_PREFIX=/home/hadoop/app/hadoop-2.6.0-cdh5.7.0

Modify Etc/hadoop/core-site.xml:

<configuration>    <property>        <name>fs.defaultFS</name>        <value>hdfs://hadoop:9000</value>    </property></configuration>

Modify Etc/hadoop/hdfs-site.xml:

<configuration>    <property>        <name>dfs.replication</name>        <value>1</value>    </property></configuration>

Modify the Etc/slaves file

hadoop

Configuring SSH-Free Encryption

删除.ssh文件夹 防止冲突# rm -rf .ssh生成ssh秘钥# ssh-keygen -t dsa -P ‘‘ -f ~/.ssh/id_dsa# cat ~/.ssh/id_dsa.pub >> ~/.ssh/authorized_keys修改authorized_keys 文件权限chmod 600 authorized_keys

Initial formatting of HDFs

[Email protected] hadoop-2.6.0-cdh5.7.0]$ Bin/hdfs Namenode-format

Start HDFs

[Email protected] hadoop-2.6.0-cdh5.7.0]$ sbin/start-dfs.sh

JPS Viewing processes

Web UI View

hadoop2.6-cdh5.7 Deployment Installation