Single-machine pseudo-distributed deployment of Hadoop under Windows (1)

Source: Internet
Author: User

The operating environment for Hadoop should be in the Linux environment. If you want to install and run Hadoop in a Windows environment, there are generally two ways: a VM-like Linux operating system that enables Hadoop to run in a full Linux environment, and another way to install the Cygwin simulation Linux environment, which is relatively simple and convenient.

This article takes a cywin approach. The following is an introduction to the installation and configuration of the following Cygwin:

(1) Installation of Cygwin

Download Cygwin installation file:; I use the 64-bit version; the operating system is Win7;

The downloaded setup file is actually a boot installation and the download process of the execution file, the actual download and installation of the network.

Click Next to enter the installation boot screen.

Select the first one to download and install from the network and click Next to go to the Select Installation screen.

Here I use the default installation directory, click Next to select the file storage directory.

I still choose the default directory, click Next to enter the network connection interface.

Choose Direct connection here to connect directly, click Next after the installation file image Server selection interface.

Here I chose the image shown in the figure, click Next to enter the installation Component selection interface

In addition to the components that are installed by default, the following components are preferred:

Sed under the Base category directory

Editors Category Directory of VINM

Vim in the Editors category directory

Net Category Directory of Openssl,openssh

Then, click Next to start the download and install the automatic steps, all the way to choose the next.

(2) Configuration of Cygwin

Configure the SSH service to enable SSH login without password, the process is as follows:

Click the Cygwin shortcut,

Install sshd command: Ssh-host-config

In the first step, ask "should privilege separation be used?" (yes/no) ", enter No;

In the second step, ask "(Say" if it is alreadyinstalled as a service) (yes/no) ", enter Yes;

In the third step, ask "Enter the value of CYGWIN for Thedaemon: []" and enter directly.

If the installation succeeds, it will appear:

Appears: ***info:host configuration finished. Have fun!

Start sshd command: net start sshd

Implement no password login:

$ssh-keygen, all the way to the carriage,

Then there will be two files in the ~/.ssh directory: Id_rsa and, the two file is the private key and the public key generated by RSA encryption.

Then execute the command:

$cat ~/.ssh/ >> ~/.ssh/authorized_keys;

The public key file is appended to the authorization file, and no-password boarding is possible.

Login command: SSH localhost.

Related Article

Contact Us

The content source of this page is from Internet, which doesn't represent Alibaba Cloud's opinion; products and services mentioned on that page don't have any relationship with Alibaba Cloud. If the content of the page makes you feel confusing, please write us an email, we will handle the problem within 5 days after receiving your email.

If you find any instances of plagiarism from the community, please send an email to: and provide relevant evidence. A staff member will contact you within 5 working days.

A Free Trial That Lets You Build Big!

Start building with 50+ products and up to 12 months usage for Elastic Compute Service

  • Sales Support

    1 on 1 presale consultation

  • After-Sales Support

    24/7 Technical Support 6 Free Tickets per Quarter Faster Response

  • Alibaba Cloud offers highly flexible support services tailored to meet your exact needs.