Ubuntu 64-bit configuration Hadoop 2.7

Source: Internet
Author: User

64-bit Ubuntu configuration Hadoop needs to be compiled from the source code, although Ubuntu is installed in the virtual machine, can be loaded with a 32-bit, but now a little trouble to accumulate experience after the convenience. However, when writing this sentence, the compiled part is not finished yet. In any case, follow the usual habits and write as you go along:

1. hadoop-2.7.1-src.tar.gz decompression.

2. The requirements for the tool in the BUILDING.txt are:

Requirements:*Unix System* JDK1.7+* Maven3.0or later* Findbugs1.3.9(ifrunning findbugs)* Protocolbuffer2.5.0* CMake2.6or newer (ifCompiling native code), must be3.0or newer on Mac* Zlib Devel (ifcompiling native code)* OpenSSL devel (ifCompiling native hadoop-pipes and toGetThe best HDFS encryption performance)* Jansson C XML Parsing library (ifcompiling Libwebhdfs)* Linux FUSE (FilesysteminchUserspace) version2.6or above (ifcompiling Fuse_dfs)* Internet Connection forFirst build (to fetch all Maven and Hadoop dependencies)

Here are the tools to install the command, after installing the tool, you can start to use MAVEN to package the source code, for MAVEN usage txt also explained:

 is ' mvn install-dskiptests '  from   from

This is the description in "Building components separately". I don't know if I have grasped the meaning of it correctly. However, following the various tutorials on the web, go directly to the root folder and execute:

$MVN Package-pdist,native,docs-dskiptests-dtar

We can. This description in TXT is:

Create binary distribution with native code and with documentation:

Of course it is best to precede with sudo to avoid the hassle of permissions.

================

Originally in accordance with the above steps, it can be completed smoothly, but all the configuration will not be smooth sailing, the middle will be the waves treacherous. The first problem encountered is that Maven automatically downloads the location of the dependency connection is too slow, a blogger took a total of 3 hours to complete, so in order to fast and stable, the MAVEN library address to open source China provided (see details of how to modify the page).

OK, after modifying the library address into the wall, the speed is much faster. However, encountered problems, run the card in the downloading a file that step, no error, long time no response. According to the Netizen's discussion here, it is because of JDK 1.7 problem (However, Hadoop 2.7 is specified to JDK 1.7+). So it faces two choices:

1, swap the JDK to 1.6. However, this can result in a run-through:

2, download Hadoop 2.6

(To be continued)

Ubuntu 64-bit configuration Hadoop 2.7

Contact Us

The content source of this page is from Internet, which doesn't represent Alibaba Cloud's opinion; products and services mentioned on that page don't have any relationship with Alibaba Cloud. If the content of the page makes you feel confusing, please write us an email, we will handle the problem within 5 days after receiving your email.

If you find any instances of plagiarism from the community, please send an email to: info-contact@alibabacloud.com and provide relevant evidence. A staff member will contact you within 5 working days.

A Free Trial That Lets You Build Big!

Start building with 50+ products and up to 12 months usage for Elastic Compute Service

  • Sales Support

    1 on 1 presale consultation

  • After-Sales Support

    24/7 Technical Support 6 Free Tickets per Quarter Faster Response

  • Alibaba Cloud offers highly flexible support services tailored to meet your exact needs.