Technical Articles

Recently abandoned non-ssh connection http://www.aliyun.com/zixun/aggregation/14119.html"> Hadoop cluster deployment, or returned to the ssh key authentication on the way. There is some trouble inside, each Taiwan machines have to upload the public key. Just because I am a lazy person, so write a few small script to complete, as long as the public key can be distributed on a machine above. The first is to generate ssh key script #! / Bin ...

【51CTO finishing】 The following is the United States well-known technology site "Inforworld" has commented 10 most valuable open source software: 1. Linux kernel Linux is the most popular free operating system kernel. It is a Unix-like operating system written in C and conforming to the POSIX standard. Linux was first developed by Finnish hacker Linus Torvalds in an attempt to provide a free, free Unix-like operating system on the Intel x86 architecture. The plan starts at 19 ...

Now global http://www.aliyun.com/zixun/aggregation/28200.html "> The number of mobile phones has tripled to computers, so having the right IT infrastructure for business users to help them improve The ability to deliver mobile and cloud services is critical, and by 2015 there will be 20 times more content in the world, 15 times more applications and 3 times more mobile transactions, so many businesses today Will choose the mainframe deployment of mobile should ...

The news about the Heartbleed vulnerability sparked heated discussions on the web. This loophole from the OpenSSL project allows an attacker to steal user information over a wide variety of encrypted and transmitted network data. As OpenSSL is widely used in web servers, mail protocols, and communication protocols, the number of users affected at a time Hard to estimate. The Heartbleed Vulnerability once again shows the vulnerability of cybersecurity, of course, for those who value security, which also gives them the opportunity to upgrade basic services, increase security ...

Some financial analysts questioned Teradata's ability to continue its growth in the IT market. While this segment of customers does put Hadoop on the agenda, customers often choose to give up only if data warehouse vendors with decades of experience find it difficult. "What's more important is to get rid of the misunderstanding of speculation rather than make a compromise at the level of reality," Scott Gnau, president of Teradata Labs, pointed out in a recent interview - the focus of this interview was to explore open source Hadoop from a historical perspective ...

Among them, the first one is similar to the one adopted by MapReduce 1.0, which implements fault tolerance and resource management internally. The latter two are the future development trends. Some fault tolerance and resource management are managed by a unified resource management system: http : //www.aliyun.com/zixun/aggregation/13383.html "> Spark runs on top of a common resource management system that shares a cluster resource with other computing frameworks such as MapReduce.

2014-03-13 11: 10: 23,665 INFO org.apache.Hadoop.ipc.Client: Retrying connect to server: Linux-hadoop-38 / 10.10.208.38: 9000. Already tried 0 time (s); retry policy is RetryUpToMaximumCountWithFixedSlee ...

Hadoop technology friends will certainly be confused about its system under the parasitic open-source projects confused, and I promise Hive, Pig, http://www.aliyun.com/zixun/aggregation/13713.html "> HBase these open source Technology will get you some confused, do not confused more than just one, such as a rookie post doubt, when to use Hbase and when to use Hive? ...

At the same time support scheduling memory and CPU resources (default only supports memory, if you want to further scheduling the CPU, you need to make some configuration), this article describes how Hadoop YARN scheduling and isolation of these resources. In YARN, resource management is done jointly by the ResourceManager and the NodeManager, where the scheduler in the ResourceManager is responsible for allocating resources and NodeManager is responsible for providing and isolating resources. ResourceM ...

http://www.aliyun.com/zixun/aggregation/13383.html"> Spark memory computing framework for a variety of iterative algorithms and interactive data analysis to improve the real-time processing of big data and accuracy.And MapReduce processing framework Is good at complex batch operations, landing filtering, ETL (data extraction, conversion, loading), web indexing and other applications, MapReduce has been criticized for low latency business.

The traditional relational database has good performance and stability, at the same time, the historical test, many excellent database precipitation, such as MySQL. However, with the explosive growth of data volume and the increasing number of data types, many traditional relational database extensions have erupted. NoSQL database has emerged. However, different from the previous use of many NoSQL have their own limitations, which also led to the difficult entry. Here we share with you Shanghai Yan Technology and Technology Director Yan Lan Bowen - how to build efficient MongoDB cluster ...

Hadoop technology in telecom operators online log processing application architecture Fang Jianguo First, the telecom operators Internet log processing status Today, so popular in the mobile Internet, every day will produce a lot of Internet log, these Internet log due to the huge amount of data generated Can only be retained for 3 days, because of storage space and other reasons are discarded. At present, telecom operators may only have a lot of useful information on customer behavior missing from the analysis of customer behavior mainly based on CDRs (call logs). For example, two people with similar phone conversations may be completely different types of customers ...

At the recently concluded Hadoop Europe Summit, Hortonworks announced version 2.1 of the Hortonworks Data Platform (HDP). The new version of the Hadoop distribution includes new enterprise features such as data governance, security, streaming and search, and takes the Stinger Initiative tool for interactive SQL queries to a whole new level. Jim Walker, director of product marketing at Hortonworks, said: "In order for Had ...

Some financial analysts questioned Teradata's ability to continue its growth in the IT market. While this segment of customers does put Hadoop on the agenda, customers often choose to give up only if data warehouse vendors with decades of experience find it difficult. "What's more important is to get rid of the misunderstanding of speculation rather than make a compromise at the level of reality," Scott Gnau, president of Teradata Labs, pointed out in a recent interview - the focus of this interview was to explore open source Hadoop from a historical perspective ...

Amazon lead the cloud market Microsoft play affinity card This week for Amazon, it should be "a year of mixed feelings." First of all, AWS's first market training event in China kicked off in Beijing. Nearly 400 participants from all over the country gathered for the venue to open the "AWS China" sign. The second happy event for AWS is that the latest Public Cloud survey from RightScale research shows that AWS has a 54% surveyor usage rate, far behind Rac ...

In the era of big data, IT vendors researching big data focused their research on optimizing the software architecture of big data systems, optimizing business logic, optimizing data analysis algorithms and optimizing node performance, while ignoring the evaluation of network links in the big data environment infrastructure And optimized. This article introduces Cisco's network architecture design and optimization experience in a Hadoop cluster environment. Big Data Hadoop Environment Network Features Hadoop cluster nodes through http: //www.aliyun.com/zixun/aggregation ...

Now the open source sky is no longer the banner of only Red Hat, whether it is chase behind the front or intercept, open source trend as if deep into the bottom of the industry, it is no wonder that open source almost covered up our horizons . Below, we have sorted out some important events on Microsoft's path to open source and open source, from which we also see that Microsoft can not escape the trend of open source and open. First, in the past, to participate in the contribution of the Linux kernel, the establishment of an open technology subsidiary first to planing the past, Microsoft continued to show muscle in the field of open source in recent years. At 201

Hadoop technology friends will certainly be confused about its system under the parasitic open-source projects confused, and I promise Hive, Pig, http://www.aliyun.com/zixun/aggregation/13713.html "> HBase these open source Technology will get you some confused, do not confused more than just one, such as a rookie post doubt, when to use Hbase and when to use Hive? ...

Building a fully service-oriented system has always been the goal pursued by Twitter, and from the previous article, we shared Twitter to cope with the overall 143,000 TPS peak system overview, but the details of the various service components are not involved. Fortunately, the company recently disclosed Manhattan's independently developed database system, which delivers in-service features while delivering features such as high availability and availability. The following is translation: As Twitter grows into a global user exchange ...

Several articles in the series cover the deployment of Hadoop, distributed storage and computing systems, and Hadoop clusters, the Zookeeper cluster, and HBase distributed deployments. When the number of Hadoop clusters reaches 1000+, the cluster's own information will increase dramatically. Apache developed an open source data collection and analysis system, Chhuwa, to process Hadoop cluster data. Chukwa has several very attractive features: it has a clear architecture and is easy to deploy; it has a wide range of data types to be collected and is scalable; and ...