Single-machine pseudo-distributed deployment of Hadoop under Windows (1)

The operating environment for Hadoop should be in the Linux environment. If you want to install and run Hadoop in a Windows environment, there are generally two ways: a VM-like Linux operating system that enables Hadoop to run in a full Linux environment, and another way to install the Cygwin simulation Linux environment, which is relatively simple and convenient.

This article takes a cywin approach. The following is an introduction to the installation and configuration of the following Cygwin:

(1) Installation of Cygwin

Download Cygwin installation file: http://cygwin.com; I use the 64-bit version; the operating system is Win7;

The downloaded setup file is actually a boot installation and the download process of the execution file, the actual download and installation of the network.

Click Next to enter the installation boot screen.

Select the first one to download and install from the network and click Next to go to the Select Installation screen.

Here I use the default installation directory, click Next to select the file storage directory.

I still choose the default directory, click Next to enter the network connection interface.

Choose Direct connection here to connect directly, click Next after the installation file image Server selection interface.

Here I chose the image shown in the figure, click Next to enter the installation Component selection interface

In addition to the components that are installed by default, the following components are preferred:

Sed under the Base category directory

Editors Category Directory of VINM

Vim in the Editors category directory

Net Category Directory of Openssl,openssh

Then, click Next to start the download and install the automatic steps, all the way to choose the next.

(2) Configuration of Cygwin

Configure the SSH service to enable SSH login without password, the process is as follows:

Click the Cygwin shortcut,

Install sshd command: Ssh-host-config

In the first step, ask "should privilege separation be used?" (yes/no) ", enter No;

In the second step, ask "(Say" if it is alreadyinstalled as a service) (yes/no) ", enter Yes;

In the third step, ask "Enter the value of CYGWIN for Thedaemon: []" and enter directly.

If the installation succeeds, it will appear:

Appears: ***info:host configuration finished. Have fun!

Start sshd command: net start sshd

Implement no password login:

$ssh-keygen, all the way to the carriage,

Then there will be two files in the ~/.ssh directory: Id_rsa and Id_rsa.pub, the two file is the private key and the public key generated by RSA encryption.

Then execute the command:

$cat ~/.ssh/id_rsa.pub >> ~/.ssh/authorized_keys;

The public key file is appended to the authorization file, and no-password boarding is possible.

Login command: SSH localhost.