To learn how to build Hadoop with three identical Linux virtual machines using VMware, hadoopvmware

To learn how to build Hadoop with three identical Linux virtual machines using VMware, hadoopvmware

Introduction:VMware can run two or more Windows, DOS, and LINUX systems simultaneously on a local laptop. VMWare uses a completely different concept than the "Multi-Boot" system. Multiple boot systems can run only one system at a time. During system switching, you must restart the machine. VMWare is truly "running" at the same time. multiple operating systems are switched on the platform of the main system, just like standard Windows applications. In addition, you can perform virtual partitioning and configuration in each operating system without affecting the data on the real hard disk. You can even use the NIC to connect several virtual machines to a LAN, which is extremely convenient. The performance of the VMware operating system is much lower than that of the system directly installed on the hard disk. Therefore, it is suitable for learning and testing.

 

Prepare the environment as follows:
Because there is no physical machine for testing, it is a good choice to learn how to build an environment with hadoop and how many linux virtual machines can be built in a local notebook.

Linux Virtual Machine ISO:CentOS-6.2-x86_64-bin-DVD1.ISO, CentOS-6.2-x86_64-bin-DVD2.ISO.

Virtual Machine Platform server version:VMware-workstation-full-10.0.1-1379776.exe

PS:If you need software, leave me a message and contact us,YesShareHere you are.The software description is as follows:

Local LAPTOP:T430I, 6 GB memory, 64-bit operating system, the configuration is as follows:

 
The procedure is as follows:

1. Install VMware-workstation. Next, import Centos and use ISO to build a linux virtual machine.

2. Select the path

3. Select multiple cores.

4. Select 1 GB memory.

5. Select the Bridge Connection method.

6. Select the disk I/O mode.

7. Create a new Virtual Machine

8. Select the disk type.

9. Virtual Machine file storage

10. Set the Virtual Machine file storage path

11. An error is reported as follows:

Cocould not prepare the install disc at E: \ software \ wmware \ CentOS-6.5-x86_64-bin-DVD1.iso. make sure that you are using a valid Linux install disc. if the error persists, you may need to reinstall VMware Workstation.

 

The reason is that the notebook does not enable the Virtual machine function option, restart the notebook T430i, press the F1 key, enter BIOS settings, find the Virtual option, set it to enable, and save and exit.

 

Error:EDD: Error 8000 reading sector 2073976

The reason is: VMware Workstation 9, the version is too old, upgrade to version 10, OK.

 

12. Set Virtual Machine network connection

12.1. Verify the Virtual Machine network connection

[Root @ name01 ~] # Ping www.baidu.com

Ping: unknown host www.baidu.com

[Root @ name01 ~] #

[Root @ name01 ~] # Ping 115.239.211.110

Connect: Network is unreachable

[Root @ name01 ~]

 

12.2 set the connection mode to NAT

 

 

Check whether the network can be connected to the Internet. Click the wireless icon in the lower-right corner of the notebook, click Open Network and sharing center, close VMnet01, retain only VMnet08, and use the default IPv4 IP address 192.168.52.1.

 

(1) set it by yourself

Start the VM, enter the VM operating system, set the network connection of the VM, set the IP address to 192.168.52.11, And the subnet mask to 255.255.255.0, the gateway is 192.168.52.1 (the gateway is the IP address of the VMware Network Adapter VMnet8 virtual Nic), and the DNS is set to the DNS of the host Network connection (the DNS of the connection we connect to the Internet, I am using a wireless network connection, so I can find the DNS of the wireless network connection. If it is a broadband connection, it is the DNS of the local connection), as shown below:

[Root @ name01 ~] # Vim/etc/sysconfig/network-scripts/ifcfg-eth0

DEVICE = eth0

BOOTPROTO = none

HWADDR = 00: 0c: 29: AE: 6b: a7

IPV6INIT = yes

NM_CONTROLLED = yes

ONBOOT = yes

IPADDR = 192.168.52.11

NETMASK = 255.255.255.0

TYPE = Ethernet

GATEWAY = 192.168.52.1

DNS1 = 192.168.180.254

USERCTL = no

[Root @ name01 ~] #

Then restart the network.

[Root @ name01 ~] # Service network restart

Shutting down interface eth0: Device state: 3 (disconnected)

[OK]

Shutting down loopback interface: [OK]

Bringing up loopback interface: [OK]

Bringing up interface eth0: Active connection state: activating

Active connection path:/org/freedesktop/NetworkManager/ActiveConnection/1

State: activated

Connection activated

[OK]

[Root @ name01 ~] #

 

(2) automatically set the network through dhcp

[Root @ name01 ~] # Cat/etc/sysconfig/network-scripts/ifcfg-eth0

DEVICE = eth0

BOOTPROTO = dhcp

HWADDR = 00: 0c: 29: AE: 6b: a7

ONBOOT = yes

TYPE = Ethernet

[Root @ name01 ~] #

Restart the network service

[Root @ name01 ~] # Service network restart

Shutting down interface eth0: Device state: 3 (disconnected)

[OK]

Shutting down loopback interface: [OK]

Bringing up loopback interface: [OK]

Bringing up interface eth0: Active connection state: activating

Active connection path:/org/freedesktop/NetworkManager/ActiveConnection/3

State: activated

Connection activated

[OK]

[Root @ name01 ~] #

 

(3) Verify the network and use wget to download the lib package, as shown below:

[Root @ name01 ~] # Wget http://ftp.gnu.org/gnu/glibc/glibc-2.12.1.tar.gz

-- 03:03:38 -- http://ftp.gnu.org/gnu/glibc/glibc-2.12.1.tar.gz

Resolving ftp.gnu.org... 208.118.235.20, 2001: 4830: 134: 3: B

Connecting to ftp.gnu.org | 208.118.235.20 |: 80... connected.

HTTP request sent, awaiting response... 200 OK

Length: 21119201 (20 M) [application/x-gzip]

Saving :?. Libc-2.12.1.tar.gz?

 

100% [============================================== ========================================================== ========================================================== ===========================>] 21,119,201 89.1 K/s in 7 m 23 s

 

03:11:03 (46.6 KB/s )-?. Libc-2.12.1.tar.gz ?. Saved [2, 21119201/21119201]

 

[Root @ name01 ~] #

[Root @ name01 ~] # Ping www.baidu.com

PING www.a.shifen.com (58.217.200.15) 56 (84) bytes of data.

64 bytes from 58.217.200.15: icmp_seq = 1 ttl = 128 time = 281 MS

64 bytes from 58.217.200.15: icmp_seq = 2 ttl = 128 time = 223 MS

64 bytes from 58.217.200.15: icmp_seq = 3 ttl = 128 time = 1925 MS

64 bytes from 58.217.200.15: icmp_seq = 4 ttl = 128 time = 1166 MS

64 bytes from 58.217.200.15: icmp_seq = 6 ttl = 128 time = 318 MS

^ C

--- Www.a.shifen.com ping statistics ---

6 packets transmitted, 5 bytes ed, 16% packet loss, time 5646 ms

Rtt min/avg/max/mdev = 223.089/782.893/1925.305/668.220 MS, pipe 2

[Root @ name01 ~] #

OK. The VM Internet connection is set successfully.

 

13. clone another identical Virtual Machine

Install necessary software on the first virtual machine, such as jdk, mysql, openssl, yum, and python. Then, through the unique clone function of the vm, quickly replicate the nth virtual machine.

13.1, in the Virtual MachineName02Right-click"Management(M )"And then click the drop-down menu on the right"Clone(C )", As shown below:

 

13.2. continue to the next step

 

13.3. Select "create complete clone ".(F)

 

13.4. Set the name and end, and click Finish.

 

13.5. Start copying. It takes a long time and wait patiently as follows:

 

Click Close to complete this operation.Clone.

In the same way, clone another data02 instance, as shown in:



OK. All three identical virtual machines have been built. You can build a hadoop environment and start your big data learning journey.

From: http://blog.itpub.net/26230597/viewspace-1255651/

How to Use VMWare + Hadoop to build a cloud computing environment and run a simple cloud computing instance on a rough Platform

The example of word statistics in hadoop can be tested. You have to build an environment step by step. The question above is too general. It should be like this: 1. How to install vmwarevm in XP or Windows 7. Install the linux system after installation. 2. install linux on a virtual machine (ubuntu, redhat, and fedora ). 3. If the redhat system is installed, find and install hadoop under redhat (a version of hadoop is downloaded from the official website ). 4. Test the hadoop environment. The installation step will show you how to test the word statistics example. Step by step! The configuration of these environments depends on the environment you want to build on several nodes. The configuration of each node is the same.

I want to learn about linux and how to get started with hadoop.

If you are studying linux, it must be better for laruence's Linux Private food _ basic learning (version 3rd !! There is a mirror in my online storage.