Alibabacloud.com offers a wide variety of articles about hortonworks hadoop installation, easily find your hortonworks hadoop installation information here online.
1. An overview of the establishment of the cloud platform for colleges and universities started a few days ago. The installation and configuration of the hadoop cluster test environment took about two days, I finally completed the basic outline and shared my experience with you. Ii. hardware environment 1, Windows 7 flagship edition 64-bit 2, VMWare Workstation ace version 6.0.23, RedHat Linux 54,
original path to the target path Hadoop fs-cat/user/hadoop/a.txt View the contents of the A.txt file Hadoop fs-rm/user/hadoop/a.txt Delete US The A.txt file below the Hadoop folder under the ER folderHadoop fs-rm-r/user/hadoop/a.
Hadoop installation and configuration Manual
I. Preparation
Hadoop runtime environment:
SSH service running properly
JDK
If you have not installed it, you can install it yourself.
Ii. BASICS (single-node Hadoop)
Hadoop download
H
One installation JDK
#/etc/profile
Export Java_home=/application/search/java/default
Export path= $JAVA _home/bin: $JAVA _home/jre/bin: $PATH
Export classpath=.: $JAVA _home/lib/dt.jar: $JAVA _home/lib/tools.jar
# Source/etc/profile
Two no password SSH login (recommended this machine also get)
# Local execution: Generate key pair
Ssh-keygen-t Dsa-p '-F ~/.SSH/ID_DSA
# Remote Server execution: Authorize the remote machine with the public key
For example, we demonstrate how to install Hadoop2.6.0 in a single node cluster. The installation of SSH and JDK is described in the previous article and is not covered here.Installation steps:(1) Place the downloaded Hadoop installation package in the specified directory, such as the home directory of your current user. Execute the following command to unpack th
An experimental environment:
1. Three physical machines (virtual machine can be virtual out of the three hosts), one of the main node (Namenode) ip:192.168.30.50, two to do from the node (datanode) ip:192.168.30.51/192.168.30.52
2. For each host installed JDK1.6 above, and set the environment variables, recommended (such as: java_home=/usr/java/java1.7.0_17), after the configuration can be passed: java-version test whether the installation was success
I. Installation PROTOBUFUbuntu system1 Create a file in the/etc/ld.so.conf.d/directory libprotobuf.conf write the content/usr/local/lib otherwise the error will be reported while loading shared libraries:libprotoc.so .8:cannot Open Shared obj2../configure Makemake Install2. Verify that the installation is completeProtoc--versionLibprotoc 2.5.0Two. Install the Snappy local libraryHttp://www.filewatcher.com/m
First, a brief introduction of the next blogger's configuration environment
MAC 10.10.0
Hadoop 2.6
JDK 1.6 (can be queried in the shell using jdk-version)
Hadoop installationIt is recommended to use the brew under the MAC for installation, the reason is to use brew installation, it will automatica
This article explains how to install Hadoop on a Linux cluster based on Hadoop 2.2.0 and explains some important settings.
Build a Hadoop environment on Ubuntu 13.04
Cluster configuration for Ubuntu 12.10 + Hadoop 1.2.1
Build a Hadoop environment on Ubuntu (standalone mode +
(qq:530422429) original works, reproduced please indicate the source: http://write.blog.csdn.net/postedit/40556267.
This article is based on the Hadoop website installation tutorial written by Hadoop yarn in a stand-alone pseudo distributed environment of the installation report, for reference only.1. The
Hadoop-2.X installation and configuration
We use a single-node cluster as an example to demonstrate how to install Hadoop2.6.0. The installation of ssh and jdk is described in the previous article.
Installation steps:
(1) Place the downloaded Hadoop
Hadoop is now a very popular platform for big data processing, while R is a powerful tool for statistical analysis of data mining, and it lacks in big data processing, with parallel computing, Rhadoop, and Rhipe solutions. Try installing Rhipe. Installation Environment
Environment
version
CentOS (64bit)
6.5
Java JDK
1.6.0_45
R
3.1.2
1. Environment tool Version Introduction
Centos6.4 (final)
Jdk-7u60-linux-i586.gz
Hadoop-1.1.2.tar.gz
Sqoop-1.4.3.bin__hadoop-1.0.0.tar.gz
Mysql-5.6.11.tar.gz
2. Install centos
Refer to the use of online Ultra to create a USB flash drive to start and directly format the installation system. There are a lot of information on the Internet, but it is best not to change the host name during
Tags: man manual enter row tar.gz err 1.4 for maximumHue: Https://github.com/cloudera/hue Hue Study document address : http://archive.cloudera.com/cdh5/cdh/5/hue-3.7.0-cdh5.3.6/manual.html I'm currently using hue-3.7.0-cdh5.3.6. Hue (Hue=hadoop User Experience) Hue is an open-source Apache Hadoop UI system that evolved from Cloudera desktop and finally cloudera the company's contribution to the Apache Found
directory(1) initialization, input command, Bin/hdfs Namenode-format(2) All start sbin/start-all.sh, can also separate sbin/start-dfs.sh, sbin/start-yarn.sh(3) Stop word, enter command, sbin/stop-all.sh(4) Input command, JPS, can see the relevant information13, Web Access, to open the port first or directly shut down the firewall(1) Input command, Systemctl stop Firewalld.service(2) Browser open http://192.168.6.220:8088/(3) Browser Open http://192.168.6.220:50070/14, the
platforms supported by 1.hadoop:
The Gnu/linux platform is a development and production platform. Hadoop has been proven to be more than 2000 nodes on the Gnu/linux platform.
Win32 is a development platform, and distributed operations are not well tested on Win32 systems, so it is not used as a production environment.
2. Install the required software for Hdoop:Software required for in
Tags: Hadoop hiveSince Hive relies on Hadoop, you must confirm that Hadoop is available before installing hive, and the installation of Hadoop can refer to the cluster distributed Hadoop insta
http://blog.csdn.net/franklysun/article/details/6443027
This article focuses on the installation, configuration, problem solving of hbase
For the installation of Hadoop and zookeeper and related issues, you can refer to:
Hadoop:http://blog.csdn.net/franklysun/archive/2011/05/13/6417984.aspx
Zookeeper:http://blog.csdn.net/franklysun/archive/2011/05/16/6424582.as
Tags: hadoop
Summary: This article describes how to install three Ubuntu virtual machines in virtualbox, build a hadoop environment, and finally run the wordcount routine in hadoop's built-in example.
1. Lab Environment
Virtualbox version: 4.3.2 r90405
Ubuntu virtual machine version: ubuntu11.04
Ubuntu Virtual Machine JDK version: jdk-1.6.0_45
Ubuntu Virtual Machine
The content source of this page is from Internet, which doesn't represent Alibaba Cloud's opinion;
products and services mentioned on that page don't have any relationship with Alibaba Cloud. If the
content of the page makes you feel confusing, please write us an email, we will handle the problem
within 5 days after receiving your email.
If you find any instances of plagiarism from the community, please send an email to:
info-contact@alibabacloud.com
and provide relevant evidence. A staff member will contact you within 5 working days.