hadoop installation

We use 2 nodes to install the Hadoop cluster, where 192.168.129.35 is the primary node and the 192.168.129.34 is from the node. Create a user named Hadoop-user on both the Master node (192.168.129.35) and from the node (192.168.129.34) Master node (192.168.129.35) log in Hadoop-user Because the Hadoop cluster requ

Hadoop yarn has solved many of the problems in MRv1, installing a Hadoop yarn, and then easy to learn Spark,yarn Issues such as/etc/hosts,ssh password login in the first edition of Hadoop are not detailed here, but this is just a little bit about the basic configuration of yarn and Hadoop version1. The basic three prof

When installing Hadoop ha, format ZK, execute HDFS ZKFC–FORMATZK command error as follows:16/09/08 20:41:53 INFO Zookeeper. Zookeeper:initiating Client connection, connectstring=>hddata1:2181,hddata2:2181,hddata3:2181 sessionTimeout= Watcher[email Protected]5dd308e316/09/08 20:41:53 FATAL Tools. Dfszkfailovercontroller:got a fatal error, exiting nowJava.net.UnknownHostException: >hddata1At Java.net.Inet4AddressImpl.lookupAllHostAddr (Native Method)At

Just beginning to contact, not very familiar with, make a small record, later revisionGenerate public and private keysSsh-keygen-t Dsa-p "-F ~/.SSH/ID_DSAImport the public key into the Authorized_keys fileCat ~/.ssh/id_dsa.pub >> ~/.ssh/authorized_keysUnder normal circumstances, SSH login will not need to use the passwordIf prompted: Permission denied, please try againModify SSH configuration, path/etc/ssh/sshd_configPermitrootlogin Without-passwordChange intoPermitrootlogin YesIf the above conf

Database xhkdb;4. Connect to the databaseCommand: Use For example: If the XHKDB database exists, try to access it:mysql> use XHKDB;Screen tip: Database changed5. View the database currently in useMysql> Select Database ();6. The current database contains table information:Mysql> Show tables; (Note: There is a last s)This article is from the "If you bloom, the breeze came in" blog, please be sure to keep this source http://iqdutao.blog.51cto.com/2597934/1766879 The five chapters of

First, prepareUpload apache-hive-1.2.1.tar.gz and Mysql--connector-java-5.1.6-bin.jar to NODE01Cd/toolsTAR-ZXVF apache-hive-1.2.1.tar.gz-c/ren/Cd/renMV apache-hive-1.2.1 hive-1.2.1This cluster uses MySQL as the hive metadata storeVI Etc/profileExport hive_home=/ren/hive-1.2.1Export path= $PATH: $HIVE _home/binSource/etc/profileSecond, install MySQLYum-y install MySQL mysql-server mysql-develCreating a hive Database Create databases HiveCreate a hive user grant all privileges the hive.* to [e-mai

1.tpc-ds download address is as follows Http://www.tpc.org/tpc_documents_current_versions/current_specifications.asp 1. Installation dependencies Yum-y install gcc gcc-c++ libstdc++-devel Bison BYACC Flex 2. Installation Unzip A3083c5a-55ae-49bc-8d6f-cc2ab508f898-tpc-ds-tool.zip CD V2.3.0/tools Make 3. Generating data Generate 10T Data ./dsdgen-scale 10000-dir/dfs/data Background data generation 100G

Tags: share port number USR data via SQL database my.cnf Chinese garbled problem MySQL installationMySQL installation for Hadoop---clusterOne:　　　　　　Two:　　 　　 Three:　　Four:　　 　　 Five:　　 　 Six:　　 　 Seven:　　 　 Eight: Modify database character: Solve Chinese garbled problem, mysql default is latin1, we want to change to Utf-81>　　　 　　　 2> Then we do modify:--> first we need to build a folder for MySQL at/etc/--a

The version of Hadoop that my cluster uses is hadoop-1.1.2. The corresponding eclipse version is also:hadoop-eclipse-plugin-1.1.2_20131021200005(1) Create a Hadoop-plugin folder under Eclipse's Dropins folder and put the plugin inside. Restart Eclipse again, open the view and the MapReduce view will appear(2) Configure host name, my hostname is

Environment: centos6.2 The machine was pre-installed with openjdk1.6, and later installed with colleagues on the Internet. download the latest version of jdk1.7 and change the jdk of centos. Hadoop downloaded version 1.0, but after the configuration is complete, the execution of hadoop namenode-format has no response, which is often strange. It has successively matched the following types: Jdk1.7 + hado

, right click on the file Select Properties to enter the local network share. Instructions to complete installation of Samba After a successful installation. You cannot access the new shared directory in Ubuntu in Win7. Search on the internet for a bit, said to find "security=user." I didn't find it, that's how I did it on the Ubuntu command line: Useradd Samba_share Smbpasswd-a Samba_share

1: Install JRE 2. Install eclipse 3: Download hadoop1.0.1 4. Download The hadoop Eclipse plug-in 5: Standalone pseudo distributed settings: http://www.open-open.com/lib/view/open1326164339265.html 6: Start the hadoop service: Hadoop_home/bin/start-all.sh Web Access: http: // localhost: 50030 Http: // localhost: 50070 Complete example: http://www.linuxidc.com/Linux/2011-03/33497p2.htm []

1) Turn off disable firewall:/etc/init.d/iptables status will get a series of messages stating that the firewall is open./etc/rc.d/init.d/iptables Stop shutting down the firewall2) Disable SELinux:To view the SELinux status:1,/usr/sbin/sestatus-v # #如果SELinux The status parameter is enabled is turned onSELinux status:enabled2. Getenforce # #也可以用这个命令检查To turn off SELinux:1, temporarily shut down (do not restart the machine):Setenforce 0 # #设置SELinux become permissive mode# #setenforce 1 set SELin