Installing configuration Hadoop pseudo-distributed in MAC Environment

Pseudo-distributed requires 5 configuration files to be modified (hadoop2.x profile $hadoop_home/etc/hadoop)
First one: hadoop-env.sh

#vim hadoop-env. SH #第25行, because the new Mac system does not need to configure the JAVA environment variables, this is to write the specific path to export Java_home=/library/java/javavirtualmachines/jdk1. 8. 0_111.jdk/contents/home    

The second one: Core-site.xml

<!--address of the boss of HDFs (NameNode) -< Property> 　　 <name>Fs.defaultfs</name> 　　 <value>hdfs://localhost:9000</value></ Property><!--Specify the storage directory where the Hadoop runtime produces files -< Property> 　　 <name>Hadoop.tmp.dir</name> 　　 <value>/users/fengmingyue/myapps/hadoop-2.7.3/tmp</value></ Property>    

The third one: Hdfs-site.xml

 <!--  Specify the number of HDFs replicas  -->  <  property  >  <  name  >  dfs.replication</ name  >  <  Span style= "COLOR: #800000" >value  >  1 </ value  >  </ property  >  

Fourth: Mapred-site.xml (MV Mapred-site.xml.template mapred-site.xml)

<!--Vim Mapred-site.xml -<!--specify Mr to run on yarn -< Property> 　　 <name>Mapreduce.framework.name</name>　　 <value>Yarn</value></ Property>    

Fifth one: Yarn-site.xml

<!--Specify the address of yarn's boss (ResourceManager) -< Property> 　　 <name>Yarn.resourcemanager.hostname</name> 　　 <value>localhost</value></ Property><!--Reducer How to get data -< Property> 　　 <name>Yarn.nodemanager.aux-services</name> 　　 <value>Mapreduce_shuffle</value></ Property>

Add Hadoop to an environment variable

#vim ~/. Bash_profile export hadoop_home=/users/fengmingyue/myapps/hadoop-2.7. 3 export PATH= $PATH: $HADOOP _home/bin: $HADOOP _home//etc/profile Refresh configuration file

Format Namenode (is initialized for Namenode)
HDFs Namenode-format (Hadoop namenode-format)
Start Hadoop
Start hdfs:sbin/start-dfs.sh First
Start yarn:sbin/start-yarn.sh again.
Verify that startup is successful
Use the JPS command to verify that the following appears to be successful

27408 NameNode 28218 Jps 27643 Secondarynamenode 28066 NodeManager 27803 ResourceManager 27512 DataNode

http://localhost:50070 (HDFs management interface)
http://localhost:8088 (Mr Management interface)
Configure SSH Free Login
CD ~/.ssh
Ssh-keygen-t RSA (four return)
After executing this command, two files Id_rsa (private key), id_rsa.pub (public key) will be generated
Copy the public key to the machine that you want to avoid landing on

CP~/. ssh/id_rsa.pub >> ~/. ssh/authorized_keys# or SSH-copy-id -i localhost

Installing configuration Hadoop pseudo-distributed in MAC Environment