Set up hadhoop standalone mode in CentOS

Set up hadhoop standalone mode in CentOS

1. Download The hadhoop installation package ghost.

[Plain] view plaincopyprint?

1. Gzip-dhadoop-2.7.0-src.tar.gz
2. Tar-xvfhadoop-2.7.0-src.tar

Subsequent operations must be performed under root.

[SQL] view plaincopyprint?

1. Suroot

2. Install ssh

First, check whether ssh is installed.

Rpm-qa | grep ssh

If not, use

Yum install ssh

It is best to enable the ssh service again

[Plain] view plaincopyprint?

1. Servicesshdrestart
2. Ssh-keygen-tdsa-p'-f ~ /. Ssh/id_dsa

Switch to the root directory to check whether there is a. ssh file.

[Plain] view plaincopyprint?

1. Cd ~ /
2. Ls-

Enter the. ssh directory

Cat id_dsa.pub> authorized_keys

Then test and confirm whether you can log on to localhost over ssh without entering the password. That is to say, the following command will not prompt you to enter the password.

[Plain] view plaincopyprint?

1. Sshlocalhost

Now ssh configuration is complete.

3. Install jdk and set JAVA_HOM

In addition to configuring/etc/profile, you also need to export JAVA_HOME in the httpfs-env.sh

4. Configure hadhoop

Go to hadoop-2.7.0/etc/hadoop

A. Configure core-site.xml as follows:

[Html] view plaincopyprint?

1. <? Xmlversion = "1.0" encoding = "UTF-8"?>
2. <? Xml-stylesheettype = "text/xsl" href = "configuration. xsl"?>
4. <! -- Putsite-specificpropertyoverridesinthisfile. -->
6. <Configuration>
7. <Property>
9. <Name> fs. default. name </name>
10. <Value> hdfs :/// localhost: 9000 </value>
12. </Property>
13. </Configuration>

B. Configure hdfs-site.xml as follows:

[Html] view plaincopyprint?

1. <? Xmlversion = "1.0" encoding = "UTF-8"?>
2. <? Xml-stylesheettype = "text/xsl" href = "configuration. xsl"?>
4. <! -- Putsite-specificpropertyoverridesinthisfile. -->
6. <Configuration>
8. <Property>
9. <Name> dfs. replication </name>
10. <Value> 1 </value>
11. </Property>
13. </Configuration>
14. ~

C. Configure mapred-site.xml

There is only a mapred-site.xml.template under the Directory and there is no mapred-site.xml, So copy one.

[Plain] view plaincopyprint?

1. Cpmapred-site.xml.templatemapred-site.xml

The configuration is as follows:

[Html] view plaincopyprint?

1. <? Xml-stylesheettype = "text/xsl" href = "configuration. xsl"?>
3. <! -- Putsite-specificpropertyoverridesinthisfile. -->
5. <Configuration>
7. <Property>
8. <Name> mapred. job. tracker </name>
9. <Value> localhost: 9001 </value>
10. </Property>
12. </Configuration>

Now, hadoop configuration is complete.

4. Start hadoop

Go to the hadoop sbin directory and execute hadoop namenode-format

Then execute start-all.sh

5. Use jps to view related information

Note: JobTracker is removed in the new hadoop architecture, refer to http://hadoop.apache.org/docs/current/hadoop-yarn/hadoop-yarn-site/YARN.html

Bin/hadoopnamenode

-

Format