[Spark Asia Pacific Research Institute Series] the path to spark practice-Chapter 1 building a spark cluster (step 5) (2)

Copy the downloaded hadoop-2.2.0.tar.gz to the "/usr/local/hadoop/" directory and decompress it:

650) This. width = 650; "src =" http://s3.51cto.com/wyfs02/M00/4B/F9/wKioL1Q2TH-wYMmwAABttI0HOLI387.jpg "style =" float: none; "Title =" 11.png" alt = "wKioL1Q2TH-wYMmwAABttI0HOLI387.jpg"/>

650) This. width = 650; "src =" http://s3.51cto.com/wyfs02/M00/4B/F7/wKiom1Q2TEjRlv0gAAH_lDjj1Nw078.jpg "style =" float: none; "Title =" 12.png" alt = "wkiom1q2tejrlv0gaah_ldjj1nw078.jpg"/>

Modify the system configuration file ~ /Configure "hadoop_home" in the bashrc file and add the bin folder under "hadoop_home" to the path. After modification, run the source command to make the configuration take effect.

Next, create a folder in the hadoop directory using the following command:

650) This. width = 650; "src =" http://s3.51cto.com/wyfs02/M01/4B/F9/wKioL1Q2TICj4m5WAAJNowQ7Jns336.jpg "style =" float: none; "Title =" 13.png" alt = "wkiol1q2ticj4m5waajnowq7jns336.jpg"/>

Next, modify the hadoop configuration file. First, go to the hadoop 2.2.0 configuration file area:

650) This. width = 650; "src =" http://s3.51cto.com/wyfs02/M01/4B/F7/wKiom1Q2TErT3L5uAAKJoyZKndY535.jpg "style =" float: none; "Title =" 14.png" alt = "wkiom1q2tert3l5uaakjoyzkndy535.jpg"/>

Step 1 modify the profile hadoop-env.sh and add "java_home" to it, as shown below:

650) This. width = 650; "src =" http://s3.51cto.com/wyfs02/M02/4B/F9/wKioL1Q2TIGB8jHHAAEiRYVdn5Y084.jpg "style =" float: none; "Title =" 15.png" alt = "wkiol1q2tigb8jhhaaeiryvdn5y084.jpg"/>

Specify the "java_home" We have installed ":

650) This. width = 650; "src =" http://s3.51cto.com/wyfs02/M02/4B/F7/wKiom1Q2TErzrFDdAAEjhm4mlx8957.jpg "style =" float: none; "Title =" 16.png" alt = "wkiom1q2terzrfddaaejhm4mlx8957.jpg"/>

Step 2 modify the configuration file yarn-env.sh and add "java_home" to it, as shown below:

650) This. width = 650; "src =" http://s3.51cto.com/wyfs02/M00/4B/F9/wKioL1Q2TILgtm5YAACinSFuXKA642.jpg "style =" float: none; "Title =" 17.png" alt = "wkiol1q2tilgtm5yaacinsfuxka642.jpg"/>

Specify the "java_home" We have installed ":

650) This. width = 650; "src =" http://s3.51cto.com/wyfs02/M00/4B/F7/wKiom1Q2TEvSrKBYAAChWna9qyI175.jpg "style =" float: none; "Title =" 18.png" alt = "wkiom1q2tevsrkbyaachwna9qyi175.jpg"/>

Step 3 modify the configuration file mapred-env.sh and add "java_home" to it, as shown below:

650) This. width = 650; "src =" http://s3.51cto.com/wyfs02/M01/4B/F9/wKioL1Q2TIKDuvoQAACd__OfoXE434.jpg "style =" float: none; "Title =" 19.png" alt = "wkiol1q2tikduvoqaacd1_ofoxe434.jpg"/>

Specify the "java_home" We have installed ":

650) This. width = 650; "src =" http://s3.51cto.com/wyfs02/M01/4B/F7/wKiom1Q2TEvBhIswAACrjuvCRuY479.jpg "style =" float: none; "Title =" 20.png" alt = "wkiom1q2tevbhiswaacrjuvcruy479.jpg"/>

This article is from the spark Asia Pacific Research Institute blog, please be sure to keep this source http://rockyspark.blog.51cto.com/2229525/1561840

[Spark Asia Pacific Research Institute Series] the path to spark practice-Chapter 1 building a spark cluster (step 5) (2)