Install Hadoop on Windows

Install Hadoop on Windows

1. Install JDK 1.6 or later.

When downloading JDK from the official website, it is recommended that you do not install JDK under a path with spaces, for example, Programe Files. Otherwise, JDK cannot be found when configuring the Hadoop configuration file (according to the relevant statement, the path in the configuration file can be enclosed by quotation marks, but I did not test it successfully ).

2. Install Cygwin

Cygwin is a tool for simulating Unix environment on Windows platform. It needs to install Hadoop on the basis of Cygwin,: http://www.cygwin.com/

Download a 32-bit or 64-bit installation file as needed.

1) double-click the downloaded Installation File, click Next, and select install from internet

2) Select the installation path

3) Select local Package Directory

4) select your Internet connection method

5) select an appropriate installation source and click Next.

6) on the Select Packages interface, expand the net in Category and Select openssh and openssl.

If you want to compile Hadoop on Eclipe, you need to install sed under the Base as the Category.

If you want to directly modify the hadoop configuration file on Cygwin, you can install vim under Editors

7) Click "Next" and wait until the installation is complete.

3. Configure Environment Variables

Right-click my computer, select "properties" from the menu, click the Advanced tab in the Properties dialog box, and click "environment variables, double-click the "Path" variable in the system Variable list and enter the bin directory of Cygwin installed after the variable value, for example, D: \ hadoop \ cygwin64 \ bin.

4. Install the sshd service

Double-click the Cygwin icon on the desktop to start Cygwin and run the ssh-host-config-y command.

After the command is executed, you will be prompted to enter the password. Otherwise, the configuration will exit. Enter the password and confirm the password, and press Enter. Host configuration finished. Have fun! Indicates that the installation is successful.

Enter net start sshd to start the service. Or find and start the Cygwin sshd service in the system service.

The sshd service cannot be installed or started. For more information, see http://www.cnblogs.com/kinglau/p/3261886.html.

In addition, if it is a Win8 operating system, when Cygwin is started, run as Administrator (right-click the icon and select Run as Administrator); otherwise, permissions may occur, the system error 5 is displayed ".

5. Configure SSH password-free Login

Run the ssh-keygen command to generate the key file.

As shown in, enter ssh-keygen-t dsa-p'-f ~ /. Ssh/id_dsa. Note that the-t-P-f parameter is case sensitive.

Ssh-keygen is the Key Generation Command

-T indicates the generated key type (dsa, rsa)

-P indicates the provided secret language

-F indicates the generated key file.

Note :~ Represents the current user's folder,/home/User Name

After you run this command, the. ssh folder is generated under the path of your Cygwin \ home \ Username. You can run the ls-a/home/username command to view the version and ssh-version command to view the version.

After executing the ssh-keygen command, run the following command to generate the authorized_keys file.

Cd ~ /. Ssh/

Cp id_dsa.pub authorized_keys

As shown in:

Run the exit command to exit the Cygwin window.

6. Double-click the Cygwin icon on the desktop again to open the Cygwin window and execute the ssh localhost command. If you run the command for the first time, a prompt is displayed. Enter yes and press Enter. As shown in

 

Install and configure Hadoop2.2.0 on CentOS

Build a Hadoop environment on Ubuntu 13.04

Cluster configuration for Ubuntu 12.10 + Hadoop 1.2.1

Build a Hadoop environment on Ubuntu (standalone mode + pseudo Distribution Mode)

Configuration of Hadoop environment in Ubuntu

Detailed tutorial on creating a Hadoop environment for standalone Edition

Build a Hadoop environment (using virtual machines to build two Ubuntu systems in a Winodws environment)

 

For more details, please continue to read the highlights on the next page:

1 2 Next Page