Ubuntu14.04 install Hadoop2.5.2 (pseudo Distribution Mode)

Record the detailed process of installing Hadoop2.5.2 (pseudo distribution mode) in Ubuntu14.04, and hope to help you. Hadoop can also run in a pseudo-distribution mode. Each Hadoop daemon runs on a node of a separate Java program. The pseudo-distribution mode must be configured based on the standalone mode. Core-site.xml, hdfs-site.xml, mapred-in/software/hadoop/etc/hadoop/directory-

Record the detailed process of installing Hadoop2.5.2 (pseudo distribution mode) in Ubuntu 14.04, and hope to help you.

Hadoop can also run in a pseudo-distribution mode. Each Hadoop daemon runs on a node of a separate Java program.

The pseudo-distribution mode must be configured based on the standalone mode.

In the/software/hadoop/etc/hadoop/directory
Core-site.xml, hdfs-site.xml, mapred-site.xml, yarn-site.xml and other files.
Configure the above files.

1. etc/hadoop/core-site.xml
Contains the configuration information when hadoop is started.

      
           
    
     fs.defaultFS
            
    
     hdfs://localhost:9000
        
   
  

Ii. etc/hadoop/hdfs-site.xml
Used to configure that each host in the cluster is available. Specify the host as the namenode and datanode directories.

      
           
    
     dfs.replication
            
    
     1
        
   
  

Iii. etc/hadoop/mapred-site.xml
By default, the/usr/local/hadoop/etc/hadoop/folder contains mapred. xml. template File. copy the file and name it mapred. xml, which is used to specify the framework used by MapReduce.

      
           
    
     mapreduce.framework.name
            
    
     yarn
        
   
  

4. etc/hadoop/yarn-site.xml
Contains the configuration information when MapReduce is started.

      
           
    
     yarn.nodemanager.aux-services
            
    
     mapreduce_shuffle
        
   
  

5. Format hdfs

 hdfs namenode -format    

You only need to run the command once. If you run the command again after hadoop is used, all data on hdfs is cleared.

6. Start Hadoop
After the configurations and operations described above, you can start the single-node cluster
Run the following command:

 sbin/start-dfs.sh    

• 1

If yes/no is prompted during command execution, enterYes,EnterYou can.

Next, run:

sbin/start-yarn.sh    

After the two commands are executed, Hadoop starts and runs.
RunjpsCommand to view Hadoop-related processes.

Open http: // localhost: 50070/in the browser and you will see the hdfs Management page.

Open http: // localhost: 8088 in the browser. The hadoop Process Management page is displayed.

For more details, refer to the highlights on the next page.: Http://www.linuxidc.com/Linux/2015-03/115188.htm

-------------------------------------- Split line --------------------------------------

Ubuntu14.04 Hadoop2.4.1 standalone/pseudo distributed installation configuration tutorial http://www.linuxidc.com/Linux/2015-02/113487.htm

Install and configure Hadoop2.2.0 on CentOSHttp://www.linuxidc.com/Linux/2014-01/94685.htm

Build a Hadoop environment http://www.linuxidc.com/Linux/2013-06/86106.htm on Ubuntu 13.04

Ubuntu 12.10 + Hadoop 1.2.1 cluster configuration http://www.linuxidc.com/Linux/2013-09/90600.htm

Build a Hadoop environment on Ubuntu (standalone mode + pseudo distribution mode) http://www.linuxidc.com/Linux/2013-01/77681.htm

Configuration http://www.linuxidc.com/Linux/2012-11/74539.htm for Hadoop environment in Ubuntu

Single-host version to build a Hadoop environment graphic tutorial detailed http://www.linuxidc.com/Linux/2012-02/53927.htm

Build Hadoop environment (build with virtual machine virtual two Ubuntu systems in Winodws environment) http://www.linuxidc.com/Linux/2011-12/48894.htm