hadoop linux distro

1. Configure Yum2. Installing the JDK2.1 Uploads2.2 Unpacking the JDK#创建文件夹Mkdir/usr/java#解压TAR-ZXVF jdk-7u79-linux-i586.tar.gz-c/usr/java/2.3 Adding Java to an environment variableVim/etc/profile#在文件最后添加java_home=/usr/java/jdk1.7.0_79Export path= $JAVA _home/bin: $PATH#刷新配置Source/etc/profile3. Source code compilation hadoop2.7.03.1 Upload hadoop2.7.0 source code3.2 Installing the Edit source program dependent componentsYum-y Install svn ncurses-devel

Continue to install Hadoop-related environments immediately preceding the previous article JDK Installation:1. Download, the following two addresses found on the Internet, can be directly downloaded:Http://download.oracle.com/otn-pub/java/jdk/7/jdk-7-linux-x64.tar.gzhttp://download.oracle.com/otn-pub/java/jdk/7/jdk-7-linux-x64.rpm2. Install, upload the downloaded

Immediately after the completion of the installation and running of Hadoop, it is time to run the relevant example, and the simplest and most straightforward example is the HelloWorld-wordcount example. Follow the blog to run: http://xiejianglei163.blog.163.com/blog/static/1247276201443152533684/ First create a folder, and create two files, directory arbitrary, for the following file structure: Examples --file1.txt --file2.txt The contents of the do

: d:\cygwin\home\lsq\hadoop-1.2.2/src/examples/org/apache/hadoop/examples/ Wordcount.javapackage Org.apache.hadoop.examples;import Java.io.ioexception;import Java.util.StringTokenizer; Import Org.apache.hadoop.conf.configuration;import Org.apache.hadoop.fs.path;import Org.apache.hadoop.io.intwritable;import Org.apache.hadoop.io.text;import Org.apache.hadoop.mapreduce.job;import Org.apache.hadoop.mapreduce.m

the metadata first2 starting three Journalnode processeshadoop-daemon.sh Start Journalnode3 Formatting NamenodePerformed on a namenode:HDFs Namenode-formatThis step will connect the Journalnode, and the Journalnode will be formatted as well.4 start HDFs on the namenode that you just formatted:CD $HADOOP _home/sbin;./start-dfs.sh5 Perform on another namenode:HDFs Namenode-bootstrapstandby6 Verifying manual fail overExecute on any one of the Namenode:H

/usr/local/hadoop/dfs/data this file folder has a lock, that is, insufficient access rights.The workaround is to modify the folder permissions: CHOMD g-w/usr/local/hadoop/dfs/data2. Error in log:java.io.IOException:Incompatible clusterids In/usr/local/hadoop/dfs/data:namenode Clusterid = CID-C1BF781C-D589-46D7-A246-7F64A6F24BC1; Datanode Clusterid = cid-b1ee6a5b-

modified, can be configured on a machine before distribution to each nodeHadoop-0.20.2/conf/master the IP that holds the master nodeHadoop-0.20.2/conf/slaves store IPCA masters and slaves files from the node4) hadoop-0.20.2/conf/core-site.xml Configure HDFS path, temp directory and other information, can be modified as shown in the configuration5) Hadoop-0.20.2/conf/mapred-site.xml Configure the map reduce

>5 Property>6 Configuration>　　Mapred-site.xml1 Configuration>2 Property>3 name>Mapred.job.trackername>4 value>localhost:9001value>5 Property>6 Configuration>　　After saving, you can add Hadoop to the environment variable or not add it,Then click on the previously said configuration SSH free LoginFinally, the process of bin/start-all.sh starting Hadoop under HadoopAt this t

). Save: Press "ESC" key First, then ": Wq". (4). Do not Save: Press ": q!". 9. Modify File Permissions: chmod (for example: $ chmod u+w/etc/profiles $chmod 777/etc/profiles (the file permission is All rights)) file permissions are: R (readable) w (writable) x (executable) 10. Rename the directory or file: $ MV (such as $ MV software softwares) 11. Move the directory or file: $ MV (such as $ MV software/hadoop

Prerequisites: Hadoop is written in Java, so install Java first. Installing the JDK on Ubuntu see: http://blog.csdn.net/microfhu/article/details/7667393The Hadoop version I downloaded is 2.4.1, which requires at least JDK 6 to be installed. Linux is the only supported production environment, unix,windows or Mac OS can be used as a development environment. Install

Note: For more information on how to import Hadoop source into eclipse see HTTP://PAN.BAIDU.COM/S/1EQCCDCM First, Hadoop configuration software (My computer is Windows7 flagship--64bit) 1. VMware dedicated CentOS image (CentOS is one of the Linux operating systems) 2. Vmware-workstation10 3. hadoop