Software
Software/os |
version |
Hadoop |
2.6.3 |
Eclipse |
Kepler 4.3 |
1. Download data from NOAA
FTP address
Ftp://ftp.ncdc.noaa.gov/pub/data/gsod
All data for 1944
Ftp://ftp.ncdc.noaa.gov/pub/data/gsod/1944/gsod_1944.tar 2. Creating a Maven Project
3. Configuring the Eclipse plug-in
Hadoop-eclipse-plugin-2.6.0.jar
Copy to plugins directory, restart eclipse
Windows->preferences->hadoop Map/reduce->hadoop installation directory
Windows->open perspective->map/reduce->map/reduce Locations windows->show view->map/reduce Locations->new Hadoop Location
4. Test code 5. Add a resource file
Project->new->source folder->src/main/resources
Etc/hadoop/core-site.xml
Etc/hadoop/log4j.properties Run
Run on Hadoop reference , select Main file, run as
1. Build Hadoop2.6.0+eclipse development and debugging environment
2. Using MAVEN to build a Hadoop development environment Source Code
[GitHub]: Hadoop
[LinkedIn]