Install on Windows run Hadoop

0. Compile your own installation steps here, the English version of the connection: English portal.

Do not succeed after compiling your own attempt, for the following method of using someone else's compiled version. Reference blog: "Beginner hadoop,windows under Installation"

1. Download the JDK and set the Java_home. (using a path without spaces , such as program Files, will be an error in the configuration that follows!) )

Suppose the java_home path is C:\Java\jdk1.8.0_73

2. Download Hadoop. : http://hadoop.apache.org/releases.html

This download uses the 2.8.3 binary version of the file, extracted to d:/hadoop-2.8.3

3. Download Winutils. This is someone else's compiled version of Hadoop's Windows binaries, do not need us to compile. Download it and then take the hadoop-2.8.3! cover ! Can.

: Https://github.com/steveloughran/winutils

4. Modify the file under Path D:\hadoop-2.8.3\etc\hadoop

①core.site.xml (Configure the Access port for the default HDFs)

<Configuration>    < Property>        <name>Fs.defaultfs</name>        <value>hdfs://localhost:9000</value>    </ Property>    </Configuration>

②hdfs-site.xml (Sets the replication number to 1, which is not replicated.) Namenode file path and Datanode data path. ）

<Configuration>    < Property>        <name>Dfs.replication</name>        <value>1</value>    </ Property>    < Property>            <name>Dfs.namenode.name.dir</name>            <value>File:/hadoop/data/dfs/namenode</value>        </ Property>        < Property>            <name>Dfs.datanode.data.dir</name>            <value>File:/hadoop/data/dfs/datanode</value>      </ Property></Configuration>

③ Change the Mapred-site.xml. Template name to mapred-site.xml after modifying the content (set the frame used by Mr, yarn is used here)

<Configuration>    < Property>        <name>Mapreduce.framework.name</name>        <value>Yarn</value>    </ Property></Configuration>

④yarn-site.xml (here Yarn settings Use Mr Wash)

<Configuration>    < Property>        <name>Yarn.nodemanager.aux-services</name>        <value>Mapreduce_shuffle</value>    </ Property>    < Property>        <name>Yarn.nodemanager.aux-services.mapreduce.shuffle.class</name>        <value>Org.apache.hadoop.mapred.ShuffleHandler</value>    </ Property></Configuration>

⑤hadoop-env.cmd

Set the value of the Java_home (if the program files path with spaces is used here, an error will be made!) )

Set java_home=c:\java\jdk1.8.0_73

6. Enter the D:\hadoop-2.8.3\bin directory and format HDFs

Run command in cmd HDFs namenode-format

7. Enter D:\hadoop-2.8.3\sbin directory

Run the command in CMD start-all.cmd

8. Enter in the browser address bar: http://localhost:8088 View the cluster status.

9. In the browser address bar, enter: http://localhost:50070 to view the Hadoop status.

Above.

Install on Windows run Hadoop