Ubuntu 14.10 under Hadoop HTTPFS configuration

Because the Hadoop cluster needs to configure a section of the graphical management data and later find Hue, in the process of configuring hue, you find that you need to configure HTTPFS because Httpfs,hue is configured to operate the data in HDFs.

What does HTTPFS do? It allows you to manage files on HDFs in a browser, for example in hue; it also provides a restful API to manage HDFs

1 cluster environment

Ubuntu-14.10

Openjdk-7

hadoop-2.6.0 HA (dual nn)

hue-3.8.1 (development)

2 installation

Because it comes with HTTPFS in Hadoop so, there's no need to download additional packages, just a bit of configuration

2.1 Core-site.xml, add the following

      <property>                <name>hadoop.proxyuser.hadoop.hosts</name>                <value>*</value>                <description> The second Hadoop is the user name that launches HTTPFS </description>      </property>              <property>                <name>hadoop.proxyuser.hadoop.groups</name>                <value>*</value>                < Description> The second Hadoop is the user group name that launches Httpfs </description>      </property>

Note: Hadoop.proxyuser. {hadoop}.hosts Second is the user name to start HTTPFS

If you need to configure a user agent, you need to add it in Httpfs-site.xml.

After this configuration, start Httpfs, enter Hadoop sbin, run

httpfs.sh start

After successful startup, JPS will have one more bootstrap process.

Browser Access Http://localhost:14000/
Page display: HttpFs service, service base URL at /webhdfs/v1. The root directory is:/webhdfs/v1

Reference:

Http://hadoop.apache.org/docs/current/hadoop-hdfs-httpfs/ServerSetup.html

http://duguyiren3476.iteye.com/blog/2209388

Http://blog.cheyo.net/90.html

Http://www.cloudera.com/content/cloudera/en/documentation/cdh4/latest/CDH4-Installation-Guide/cdh4ig_ Configuring_cdh_hue.html

http://blog.csdn.net/ganglia/article/details/25902873

Ubuntu 14.10 under Hadoop HTTPFS configuration