Installing and running Hadoop under Windows

Source: Internet
Author: User

Install Hadoop under Windows and go directly to the website using simple brute force methods:

1. Download the installation package for Hadoop:http://hadoop.apache.org/-> to the left releases-> Point Mirror site-> Point/HTTP/ mirrors.tuna.tsinghua.edu.cn/apache/hadoop/common-> download hadoop-2.9.0.tar.gz;

2. Unpack the package: Unzip the download to the specified directory and add the environment variable; extract a directory: D:\hadoop-2.9.0, configure the bin path to the environment variable. Then http://download.csdn.net/detail/wuxun1997/9841472 download the relevant tool class, directly unzip the file into the D:\hadoop-2.9.0\bin directory, the Hadoop.dll in C :/windows/system32 also lost a copy;

3, go to D:\hadoop-2.9.0\etc\hadoop to find the following 4 files and paste it in the following minimum configuration:

Core.site.xml

<Configuration>    < Property>        <name>Fs.defaultfs</name>        <value>hdfs://localhost:9000</value>    </ Property>    </Configuration>

Hdfs-site.xml

<Configuration>    < Property>        <name>Dfs.replication</name>        <value>1</value>    </ Property>    < Property>            <name>Dfs.namenode.name.dir</name>            <value>File:/hadoop/data/dfs/namenode</value>        </ Property>        < Property>            <name>Dfs.datanode.data.dir</name>            <value>File:/hadoop/data/dfs/datanode</value>      </ Property></Configuration>

Mapred-site.xml

<Configuration>    < Property>        <name>Mapreduce.framework.name</name>        <value>Yarn</value>    </ Property></Configuration>

Yarn-site.xml

<Configuration>    < Property>        <name>Yarn.nodemanager.aux-services</name>        <value>Mapreduce_shuffle</value>    </ Property>    < Property>        <name>Yarn.nodemanager.aux-services.mapreduce.shuffle.class</name>        <value>Org.apache.hadoop.mapred.ShuffleHandler</value>    </ Property></Configuration>

4, next deal with an environment variable problem, enter into the Etc\hadoop directory, edit hadoop-env.cmd Modify the Java_home directory for your own JDK path; Note that if the path is installed in the Program Files directory, the name uses \ Progra~1\, otherwise the intervening spaces will cause the path to fail.

5. Go to the Bin directory and run HDFs Namenode-format

6. Enter Sbin directory: Start-all.cmd

Installing and running Hadoop under Windows

Related Article

E-Commerce Solutions

Leverage the same tools powering the Alibaba Ecosystem

Learn more >

Apsara Conference 2019

The Rise of Data Intelligence, September 25th - 27th, Hangzhou, China

Learn more >

Alibaba Cloud Free Trial

Learn and experience the power of Alibaba Cloud with a free trial worth $300-1200 USD

Learn more >

Contact Us

The content source of this page is from Internet, which doesn't represent Alibaba Cloud's opinion; products and services mentioned on that page don't have any relationship with Alibaba Cloud. If the content of the page makes you feel confusing, please write us an email, we will handle the problem within 5 days after receiving your email.

If you find any instances of plagiarism from the community, please send an email to: info-contact@alibabacloud.com and provide relevant evidence. A staff member will contact you within 5 working days.