hortonworks hadoop installation

Environmental requirements:MysqlHadoopThe hive version is: Apache-hive-1.2.1-bin.tar1. Setting Up Hive UsersEnter the MySQL command line to create a hive user and give all permissions:Mysql-uroot-prootMysql>create user ' hive ' identified by ' hive ';Mysql>grant all on * * to ' hive ' @ '% ' with GRANT option;Mysql>flush privileges;2. Create a hive DatabaseTo create a hive database using hive User login:Mysql-uhive-phiveMysql>create database hive;Mysql>show databases;3. Installing hiveDownload t

, right click on the file Select Properties to enter the local network share. Instructions to complete installation of Samba After a successful installation. You cannot access the new shared directory in Ubuntu in Win7. Search on the internet for a bit, said to find "security=user." I didn't find it, that's how I did it on the Ubuntu command line: Useradd Samba_share Smbpasswd-a Samba_share

I. Introduction of SqoopSqoop is a tool for transferring data from Hadoop (Hive, HBase), and relational databases, to importing data from a relational database (such as MySQL, Oracle, Postgres, etc.) into Hadoop's HDFs. You can also import HDFs data into a relational database.Sqoop is now an Apache top-level project, and the current version is 1.4.4 and Sqoop2 1.99.3, this article takes the 1.4.4 version as an example to explain the basic

Mac OSX System Brew install Hadoop Installation Guide Brew Install Hadoop Configure Core-site.xml: Configure the HDFs file address (remember to chmod the corresponding folder, otherwise it will not start HDFs properly) and Namenode RPC traffic port Configuring the map reduce communication port in Mapred-site.xml Configures the number of Datan

1: Environment Preparation1 Linux servers, Hadoop installation packages (Apache official website download) jdk1.6+2: Install the JDK, configure the environment variables (etc/profile), and java-version test the next step correctly. 3: Configure SSH password-free login CD ~ ssh-keygen-t RSA generate key, located in ~/.ssh directoryCp~/.ssh/id_rsa.pub ~/.ssh/authorized_keys theid_rsa.pub Public key file CP to

Hadoop-2.6.0 Pseudo-distribution--installation configuration HBase 1. Hadoop and HBase used: 2. Install Hadoop: Specific installation look at this blog post: http://blog.csdn.net/baolibin528/article/details/42939477 HBase all versions Download http://archive.apache.org/di

pseudo-distributed installation of Hadoop: installation of a physical machine or virtual machine. 1.1 Setting the IP addressExecute Command Service network restartVerification: Ifconfig1.2 Shutting down the firewallExecute command service iptables stopValidation: Service iptables status1.3 Turn off automatic operation of the firewallExecute command chkconfig ipta

This article address: http://blog.csdn.net/kongxx/article/details/6891591 1. Download the latest Hadoop installation package, download the address http://hadoop.apache.org/, here I use the hadoop-0.20.203.0rc1.tar.gz version; 2. Unzip the package to its own directory, such as decompression to the/data/fkong directory, in order to explain the following methods,

This article is a Hadoop simulation environment that uses its own computer to build up 3 computers.Tools Required:1. VMware 2. CentOS 6.7 3. Hadoop 2.2.0 4. JDK 1.7Steps:Configure the first Linux virtual machine configuration process slightly, personal choice 512m memory 20G hard disk, remember when installing the network adapter Select NAT Mode can beConfiguration complete If vt-x is not turned on, go to B

The installation mode of Hadoop is divided into three types: single-machine mode, pseudo-distribution mode, full distribution modeStand-alone mode, which is the default installation mode, is also the least resource-intensive mode, the configuration file is not modified. Runs completely locally, does not interact with other nodes, does not use the

It's been a while to learn Hadoop. Recently just relatively busy, some of the hadoop things to do some summary and record ~ Hope to help some of the first into the Hadoop children's shoes. The gods, please consciously bypass it ~ after all, I am still a small technical slag ^_^ ok~ don't rip, start from the beginningPreparation notes:1, VMware Virtual machine (is

Reference http://blog.csdn.net/lalaguozhe/article/details/10912527 Environment: hadoop2.3cdh5.0.2 Hive 1.2.1 Target: Install Lzo Test job run with Hive table creation using LZO format store Before installing the trial snappy, it was found that the CDH extracted native contains a local library such as Libsnappy, but does not contain lzo. Therefore, the use of Lzo, in addition to installing the LZO program, but also to compile the installation

1. Hive MySQL metastore installation Preparation Unzip the hive-0.12.0.tar.gz to the/zzy/. # TAR-ZXVF Hive-0.12.0.tar.gz-c/zzy (-c Specifies the path after unpacking) Modify the/etc/profile file to add hive to the environment variable # Vim/etc/profile Export java_home=/usr/java/jdk1.7.0_79 Export hadoop_home=/itcast/hadoop-2.4.1 Export hive_home=/itcast/hive-0.

}Replaced byExport JAVA_HOME=/OPT/JDK1. 8. 0_181/Third, copy to SlaveIv. format of HDFsThe shell executes the following commandHadoop Namenode-formatFormatting succeeds if the following red log content appears -/Ten/ A A: -: -INFO util. Gset:capacity =2^ the=32768Entries -/Ten/ A A: -: -INFO Namenode. fsimage:allocated New blockpoolid:bp-1164998719-192.168.56.10-153936231358418/10/12 12:38:33 INFO Common. Storage:storage Directory/opt/hdfs/name has been successfully formatted. -/Ten/ A A: -:

1) Turn off disable firewall:/etc/init.d/iptables status will get a series of messages stating that the firewall is open./etc/rc.d/init.d/iptables Stop shutting down the firewall2) Disable SELinux:To view the SELinux status:1,/usr/sbin/sestatus-v # #如果SELinux The status parameter is enabled is turned onSELinux status:enabled2. Getenforce # #也可以用这个命令检查To turn off SELinux:1, temporarily shut down (do not restart the machine):Setenforce 0 # #设置SELinux become permissive mode# #setenforce 1 set SELin

Win7 under the installation of Hadoop and other Windows platform there are many different, common steps will not repeat, the problems encountered summed up for everyone to consult, lest detours. 1.Do you want to use a different name? Choose No 2.Create new Privileged user account ' Cyg_server '? Choose No 3. The following exception occurred when the SSHD service could not be started: Privilege separation

Before installation, you must distribute file storage and Task Processing Based on the advantages of Hadoop. The Hadoop distributed architecture includes the following two types of servers responsible for different functions: master server and slave server. Therefore, this installation manual will introduce the two to

The first step of JDK installation 1. Put the downloaded JDK in the directory to be installed (my directory is:/root/hadoop/opt/cloud, use WINSCP to drag directly to the target directory) 2. Unzip the target directory sudo tar xvf jdk-7u45-linux-x64.tar.gz 3. Configure Environment variables Here I am using the command in the directory under the command: [Email protected] cloud]#/bin/vi/etc/profile The advan

1. Installing the various software needs to configure the path variable and so on home variables, what exactly is this?First, the main purpose of configuring the path variable is to use the commands inside the software, such as start-all.sh, under any directory, under any path, and so on.2. All kinds of software have env-sh and so on the end of the script file, here usually also need to configure various variables such as java--home, and so on, this is why?This is mainly because these software l

Failed to start DatanodeStart command:/data/hadoop/sbin/hadoop-daemon.sh Start DatanodeView logs with a fatal log:VI/data/hadoop/logs/hadoop-root-datanode-Slave2.log ... .- on- . -: -: -,702 FATAL Org.apache.hadoop.hdfs.server.datanode.DataNode:Initialization failed forBlock Pool 10.167.75.35:8020. Exiting.java.io.IO