Run the MapReduce program under Windows using Eclipse compilation Hadoop2.6.0/ubuntu

I. Introduction to the Environment

Host: Windows8

Virtual machine: Ubuntu14.04

hadoop2.6 Pseudo-Distribution: Build Tutorial http://blog.csdn.net/gamer_gyt/article/details/46793731

Eclipse:eclipse-jee-luna-sr2-win32-x86_64

II. Preparation Phase

Download Hadoop-eclipse-plugin-2.6.0.jar Online (click to download)

can also be self-compiled (online tutorials Quite a lot, can own Baidu or Google)

Iii. begin

• Copy the compiled jar into the Eclipse plugin directory and restart eclipse

• Configure the Hadoop installation directory

Windows->preference, Hadoop map/reduce, Hadoop installation directory

• Configuring the Map/reduce View

Window->open Perspective, other->map/reduce click "OK"

Windows→show view→other->map/reduce locations-> Click "OK"

• The console will have one more tab page for "Map/reduce Locations"

On the "Map/reduce Locations" tab, click the icon < elephant +> or right click on the blank, select "New Hadoop location ...", and the dialog box "new Hadoop locations ..." pops up, Configure the following: Change HA1 to your own Hadoop user

Then switch to the Advanced Parameters Options panel, which has a detailed configuration, remembering that it needs to be consistent with the configuration of Hadoop (configuration files in/usr/local/hadoop/etc/hadoop), as I configured the Hadoop.tmp.dir , you need to make changes.

This is true of almost all tutorials on the web, and it is true that Dfs Locations will appear in the upper-left corner of Eclipse when this tutorial is configured, as

But in fact, there will be a variety of problems, small series only I encountered and the solution presented

(1) Note: Copy the configuration file (Core-site.xml hdfs-site.xml log4j.properties) modified under Hadoop from the virtual machine to the SRC directory of the program

(2) Some files under DFS cannot be loaded, prompting permission denied error

Workaround: Add permissions to the HDFs directory file, HDFs Dfs-chnod 777/

Attached: Recommend a good Article http://www.aboutyun.com/thread-8780-1-1.html

Copyright NOTICE: This article for Bo Master original article, without Bo Master permission not reproduced.

Run the MapReduce program under Windows using Eclipse compilation Hadoop2.6.0/ubuntu