Building a Hadoop Eclipse development environment

Source: Internet
Author: User
Tags error handling

1. Install eclipse-downloaded Eclipse package and unzip it directly. 2.hadoop-eclipse plug-in configuration This article uses the Hadoop 1.2.1 version, online Many tutorials say the plugin is in the hadoop-1.2.1/contrib/directory, but I found that the directory does not have the plugin, as follows: Check it out, found that the plugin needs to compile itself, and the source code of the plug-in in the/hadoop-1.2.1/src/contrib/eclipse-plugin/directory, this article is not compiled, directly on the Internet to download a person compiled, specific methods of compiling please refer to the blog/http Www.cnblogs.com/alex-blog/p/3160619.html. Once we get the Hadoop-eclipse-plugin-1.2.1.jar plugin, we simply move it to the plugins directory under the Eclipse installation directory. Configure the Hadoop environment on 3.eclipse.     ① open Eclipse, select the Window->preferences menu, select Hadoop map/reduce on the left, and configure where Hadoop is installed.        ② Select Window->show view->other in Eclipse, select Map/reduce Locations under MapReduce Tools, as shown in the following window when the ③ step is completed. Place your mouse in the light red area, right-click on new Hadoop location④ configuration Hadoop location where location name is written casually, Map/reduce master is configured withHadoop-1.2.1/conf/mapred-site.xmlDFS Master is configured in the same way as theHadoop-1.2.1/conf/core-site.xmlThe same. At this point, the configuration work is complete.    5. Test whether the configuration is successful we create a new project, then select Map/reduce Project, then click Finish, as we are the first to build Map/reduce project, the following window will appear, we choose Yes. Then, in the Drawing view window, we see the DFS file structure, which indicates that our configuration was successful.

When you write a Hadoop program under Windows, you need to copy the Hadoop under Linux to the window, noting that the configuration file is exactly the same.
Error handling:
Modify the Hdfs-core.xml file under Hadoop on the Linux server and set the Dfs.permissions property to False. and restart Hadoop.







From for notes (Wiz)

List of attachments
    • 2015-01-25_225521.png

Building a Hadoop Eclipse development environment

Related Article

Contact Us

The content source of this page is from Internet, which doesn't represent Alibaba Cloud's opinion; products and services mentioned on that page don't have any relationship with Alibaba Cloud. If the content of the page makes you feel confusing, please write us an email, we will handle the problem within 5 days after receiving your email.

If you find any instances of plagiarism from the community, please send an email to: info-contact@alibabacloud.com and provide relevant evidence. A staff member will contact you within 5 working days.

A Free Trial That Lets You Build Big!

Start building with 50+ products and up to 12 months usage for Elastic Compute Service

  • Sales Support

    1 on 1 presale consultation

  • After-Sales Support

    24/7 Technical Support 6 Free Tickets per Quarter Faster Response

  • Alibaba Cloud offers highly flexible support services tailored to meet your exact needs.