Technical Articles

http://www.aliyun.com/zixun/aggregation/13461.html"> MongoDB, formerly known as 10gen, was founded in 2007 and after receiving a total of $ 231 million in 2013, the company's market capitalization has risen to 10 Billion dollar level, which is the result of 20 years of Red Hat, a well-known open-source company founded in 1993. High performance and easy scalability have been the foundation of MongoDB and meanwhile standardized documents ...

Here's Ellan Ponikiewicz, who shared his experience with software development at the Nuance team. Most developers know that open source Code in the development process will be used as the source code by engineers with high frequency of use, but also a number of and software platform solutions are also from the open source community masterpiece. Maybe you do not know, and open source code ...

Hadoop Learning Notes - Production Environment Hadoop Large Cluster Configuration Installation Installation Environment Operating Platform: vmware2 Operating System: Oracle Enterprise Linux 5.6 Software Version: hadoop-0.22.0, jdk-6u18 Cluster Architecture: 3+ node, master node (hotel01) slave node (hotel02, hotel03 ...) host name ip ...

Note that, before configuring these parameters, you should fully understand the meaning of these parameters to prevent mis-allocation to the cluster risks. In addition, these parameters need to be configured in yarn-site.xml. ResourceManager related configuration parameters (1) yarn.resourcemanager.address Parameter explanation: ResourceManager address exposed to the client. Client through the address submitted to the RM application, kill ...

Hadoop, a distributed computing open source framework for the Apache open source organization, has been used on many of the largest web sites, such as Amazon, Facebook and Yahoo. For me, a recent point of use is log analysis of service integration platforms. The service integration platform will have a large amount of logs, which is in line with the applicable scenarios for distributed computing (log analysis and indexing are two major application scenarios). Today we come to actually build Hadoop version 2.2.0, the actual combat environment for the current mainstream server operating system C ...

Hadoop mode introduced Stand-alone mode: easy to install, almost without any configuration, but only for debugging purposes Pseudo distribution mode: start simultaneously on a single node http://www.aliyun.com/zixun/aggregation/11696.html">namenode , Datanode, jobtracker, tasktracker, secondary namenode other five processes, simulate the various sections of the distributed operation ...

Virtualization has injected unprecedented energy into Hadoop, from the point of view of IT production management as follows: • Hadoop and other applications consuming different types of resources together deploy shared data centers to increase overall resource utilization; • Flexible virtual machines Operations allow users to dynamically create and extend their own Hadoop clusters based on data center resources, as well as shrink the current cluster and free resources to support other applications if needed.

1. Development Environment: Windows 2008 64bit Java 1.6.0_30 Myhttp: //www.aliyun.com/zixun/aggregation/13428.html "> Eclipse 6.5 environment deployment see: http://www.linuxidc.com/Linux/2014 -02 / 96528.htm 2.Hadoop cluster environment: ...

Hadoop cluster can run three modes? Stand-alone (local) mode pseudo-distributed mode fully distributed mode 2. stand-alone (local) mode attention points? There is no daemon in standalone mode, everything runs on a single JVM. There is also no DFS here, using a local file system. Stand-alone mode is suitable for running MapReduce programs during development, which is also the least used mode. Pseudo-distribution

Hadoop, a distributed computing open source framework for the Apache open source organization, has been used on many of the largest web sites, such as Amazon, Facebook and Yahoo. For me, a recent point of use is log analysis of service integration platforms. The service integration platform will have a large amount of logs, which is in line with the applicable scenarios for distributed computing (log analysis and indexing are two major application scenarios). Today we come to actually build Hadoop version 2.2.0, the actual combat environment for the current mainstream server operating system C ...

The New One http://www.aliyun.com/zixun/aggregation/32268.html "> The survey shows that the open-source culture, once a hobbyist developer, is now spreading. Ten years ago, open source was a developer's move and today Far from being like this. "A new survey by the Linux Foundation shows that" business executives recognize that companies not only urgently need open source software but are also the first to participate in the development of open source software. "This in turn also consolidates the open source software as the key business ...

Recently, the nosql database mongodb launched a new generation of products mongodb 2.6, this version fully strengthen the core server, providing new automated tools and important business functions, claiming to be mongodb come out in 5 years the largest release, the main improvement in the development of http: // www.aliyun.com/zixun/aggregation/7187.html "> Personnel management operations, better suited to large enterprises. It is reported that mongodb for a cross ...

April 19, 2014 Spark Summit China 2014 will be held in Beijing. The Apache Spark community members and business users at home and abroad will be gathered in Beijing for the first time. Spark contributors and front-line developers from AMPLab, Databricks, Intel, Taobao, NetEase, and others will share their Spark project experience and best practices in production environments. MapR is well-known Hadoop provider, the company recently for its Ha ...

In the era of big data, IT vendors researching big data focused their research on optimizing the software architecture of big data systems, optimizing business logic, optimizing data analysis algorithms and optimizing node performance, while ignoring the evaluation of network links in the big data environment infrastructure And optimized. This article introduces Cisco's network architecture design and optimization experience in a Hadoop cluster environment. Big Data Hadoop Environment Network Features Hadoop cluster nodes through http: //www.aliyun.com/zixun/aggregation ...

This article describes how to deploy Apache to Hadoop 2.2.0, http://www.aliyun.com/zixun/aggregation/14417.html". If your Hadoop is another version, such as CDH4, you can refer directly to the official Explain the operation. Need to pay attention to two points: (1) the Hadoop must be 2.0 series, such as 0.23.x, 2.0.x, 2.xx or CDH4, CDH5 ...

This article summarizes several hadoop yarn in http://www.aliyun.com/zixun/aggregation/17253.html "> common problems and solutions, note that this article describes the solution for hadoop 2.2.0 and above. 1) By default, the load of each node is unbalanced (the number of tasks is different), some nodes are running many tasks, some do not have tasks, and how to make each node tasks as balanced as possible?

Hello everyone, I am stefan, today to share with you how to migrate Hadoop1.x to Hadoop2.x. This blog post provides a way to migrate Hadoop MapReduce applications from Hadoop1.x to Hadoop2.x. & http: //www.aliyun.com/zixun/aggregation/37954.html "> nbsp; In the 2.x version, apache will reso ...

A Hadoop hard to find error This script is Deprecated. Instead use start-dfs.sh and start-yarn.sh Starting http://www.aliyun.com/zixun/aggregation/11696.html">namenodes on [Master132.Hadoop ] Ma ...

Type 1: one by one correspondence file1: a & http: //www.aliyun.com/zixun/aggregation/37954.html "> nbsp; 1b 2c 3 file2: 1! 2 @ 3 # file1 and file2 associated, want Results: a! B @ 3 # ideas: 1 ...

I. Preparatory work environment: Vmware virtual three hosts, the system is CentOS_6.4_i386 used software: Hadoop-1.2.1-1.i386.rpm, jdk-7u9-linux-i586.rpm Host Planning: IP Address & http: //www.aliyun.com/zixun/aggregation/37954.html "> nbsp; ...