reliable coordination system for large-scale distributed systems. It provides functions such as configuration maintenance, name service, distributed synchronization, and group service.Hive is a Hadoop-based data warehouse tool that maps structured data files into a database table and provides a complete SQL query function. it can convert SQL statements into MapReduce tasks for running.Oozie is a framework that allows us to combine multiple Map/Reduce jobs into a logical work unit.MapReduce is a
As in the previous articlesArticleAs shown in, I am using cdh4 to install and develop hadoopProgramWhen I try to write a hadoop program using eclipse, I find that the hadoop package in cloudera does not have the eclipse-plugin plug-in. programmers who have used the common version of hadoop know that, the hadoop file on the Apache official website will integrate this Eclipse plug-in. Therefore, I have been searching for methods on Google and Baidu to c
Cloudera cdh4 has three installation methods:
1. Automatic Installation through cloudera Manager (only 64-bit Linux operating systems are supported );
2. Use the yum command to manually install the package;
3. Manually install the tarball package;
I personally recommend that you try either method 1 or 2. You should first have a clear understanding of the hadoop architecture, built-in components, and configurations. For specific installation, refer to
Preface
After a while of hadoop deployment and management, write down this series of blog records.
To avoid repetitive deployment, I have written the deployment steps as a script. You only need to execute the script according to this article, and the entire environment is basically deployed. The deployment script I put in the Open Source China git repository (http://git.oschina.net/snake1361222/hadoop_scripts ).
All the deployment in this article is based on
.
Computer = CPU + hard disk [hadoop = mapreduce + HDFS]
Mapreduce is composed of two functions: map and reduce. They first extract key-value pairs from the map function, and then reduce collects statistics on them.
Address planning: 192.168.0.200 hadoop version introduction hadoop version: hadoop-2.0.0-cdh4.7.0.tar.gzJDK version: jdk-6u45-linux-x64-rpm.bin
1. Download the JDK and cdh4.7 source code packages
All components of the hadoop ecosystem: tre
also have requirements.
Http://www.cloudera.com/content/cloudera-content/cloudera-docs/Impala/latest/PDF/Installing-and-Using-Impala.pdf
Install cdh4
Http://archive.cloudera.com/cdh4/cdh/4/
Both CDH and hive can be found here.
Three machinesMaster to install namenode, secondnamenode, ResourceManager, Impala-state-store, Impala-shell, hiveInstall datanode, nodemanager, Impala-server, and Impala-shell on sla
).
Therefore, each datanode node runs a nodemanager and a mapreduce
5 zookeeper planning description:
Considering that there are not many resources required by the zookeeper cluster, we generally recommend that you deploy ZK nodes and other services on the same machine. Zookeeper must have at least three nodes. Of course, you can run more. It is best to deploy an odd number and an even number, but the zookeeper cluster will crash the entire cluster only when the number of downtime exceeds half
JDK is the core of the entire Java, including the Java Runtime Environment (Java runtime envirnment), a bunch of Java tools and the Basic Java class library (RT. Jar ). No matter what Java application server is actually built into a certain version of JDK. Therefore, mastering JDK is the first step to learn java well. The most popular JDK is the JDK released by Sun. In addition to sun, many companies and organizations have developed their own JDK, such as JDK developed by IBM and jrocket of Bea,
Jet Robot (Jet Robot) game released Jet robot is a casual flying game, game screen or more interesting, the robot is very cute, click to fly, let the small robot fly higher the better. Game Introduction Jet bot: In this game, you have to use his jet pack to help as high as possible. But flying is not as simple as it looks. Avoid obstacles on the way, as well as avoiding deadly traps, collecting as much fuel as possible and exceeding everything. Post your score to the online High score table and
The Neon City (Neon) released Neon City is a very classic racing mobile phone game, the game has a new racing, cool special effects and beautiful game lighting screen design. Interested in the small partners to download the Neon City hand tour Try it! This is a good game yo! Game Introduction "Neon City" is a beautiful light-screen racing mobile phone games. In this game, you will be a pilot flying a space fighter. This game uses the famous film Tron'
Jdk1.6 official download _ jdk6 official: http://www.java.net/download/jdk6/6u10/promoted/b32/binaries/jdk-6u10-rc2-bin-b32-windows-i586-p-12_sep_2008.exe
Download jdk6 api chm Chinese reference:Jdk6apichinese reference 070114.rar:Http://chinesedocument.com/upimg/soft/jdk6apichinese reference 070114.rarJava SE 6 API Chinese CHM
Plsqldev download | plsqldev download cracked version download | plsqldev download
PL/SQL developer is an integrated development environment dedicated for development, testing, debugging, and optimization of Oracle PL/SQL storage.ProgramUnits, such as triggers. PL/SQL developer has comprehensive functions and greatly
The steel ant (Iron ant) released Steel ants as a very interesting agile game, these modified steel machinery ants to fill the crisis of the animal kingdom! Players who like this game, download the iron and steel ants to play it quickly! Game Introduction "Iron ant Iron ant" is a very interesting agile game! There are many ant tribes in the insect world, and in order to expand their territory, the modified steel machinery ants will invade other insect
// C # download the image file locally, C #, C #, download the image, download the file, and download the Function// Download the image from the image address to the local disk// Save the binary file to the disk
Using system;Using system. drawing;Using system. collections;
Yong Chuang Tian Ta (TOTEM) game released Game Introduction"Yong Chuang Tian Tower Chinese version" is a fun puzzle game, drawing wind design is very retro, players in the game in addition to collecting hidden scrolls to solve puzzles, play a relatively simple way up the ladder to go up, but the operation is not so easy oh, come download the challenge! "Introduction to the game""Yong Chuang Tian Ta" This is a 3D of agile puzzle Hand tour. In the game,
Search Youku Video Download, find a good software, download, directly open, new task >> will play the video address affixed to the >> program can be automatically detected, download FLV files, and, more powerful, can convert FLV files to WMV files
1, the new support potato Bean single and Lei guest network album download
The content source of this page is from Internet, which doesn't represent Alibaba Cloud's opinion;
products and services mentioned on that page don't have any relationship with Alibaba Cloud. If the
content of the page makes you feel confusing, please write us an email, we will handle the problem
within 5 days after receiving your email.
If you find any instances of plagiarism from the community, please send an email to:
info-contact@alibabacloud.com
and provide relevant evidence. A staff member will contact you within 5 working days.