Technical Articles

Based on my current readings and conversations, I understand today's http://www.aliyun.com/zixun/aggregation/1560.html"> The structure of Facebook is as follows: The web front end is written by PHP. Facebook's HipHop will Converting PHP to C ++ and compiling with g ++ will provide high performance for templates and Weblog business layers ... Business logic exists as Service ...

If you've been hitting the IT industry for some reason in recent years, then you've probably heard the word "Internet of Things." According to Gartner, although people are very much interested in the Internet of Things, but for the substantive development of the Internet of Things is not large. The number of devices connected to the network in 2009 was less than 1 billion, but Gartner predicts 26 billion devices will be connected to the network by 2020, generating $ 300 billion in revenue for manufacturers and service providers. all...

Apache Pig, a high-level query language for large-scale data processing, works with Hadoop to achieve a multiplier effect when processing large amounts of data, up to N times less than it is to write large-scale data processing programs in languages ​​such as Java and C ++ The same effect of the code is also small N times. Apache Pig provides a higher level of abstraction for processing large datasets, implementing a set of shell scripts for the mapreduce algorithm (framework) that handle SQL-like data-processing scripting languages ​​in Pig ...

Preconditions: 1, ubuntu10.10 successful installation (personally think it does not need to spend too much time on the system installation, we are not installed to install the machine) 2, jdk installed successfully (jdk1.6.0_23for linux version, the installation process illustrated http : //freewxy.iteye.com/blog/882784) 3, download hhadoop0.21.0.tar.gz (http: // apache.etoak.com//hadoop ...

Taobao http://www.aliyun.com/zixun/aggregation/14119.html"> Hadoop cluster machine hardware configuration Hadoop companies at home and abroad are more, the world's largest Hadoop cluster in Yahoo, there are about 25,000 nodes, the main use To support the advertising system and web search. Domestic use Hadoop are Baidu, Taobao, Tencent, Huawei, China Mobile, which Taobao ...

With the start of Apache Hadoop, the primary issue facing the growth of cloud customers is how to choose the right hardware for their new Hadoop cluster. Although Hadoop is designed to run on industry-standard hardware, it is as easy to come up with an ideal cluster configuration that does not want to provide a list of hardware specifications. Choosing the hardware to provide the best balance of performance and economy for a given load is the need to test and verify its effectiveness. (For example, IO dense ...

Word Co-occurrence has not know how to correctly translate, word similarity? Or symbiotic words? Or word co-occurrence matrix? This is in the statistics Inside is a very common text processing algorithms used to measure a set of documents all the most frequent ...

Apache is a very efficient WEB server, and is still the world's most popular Web server software first. The power of Apache is that we can develop many modules for it and configure it accordingly to make our Apache server more personal. 1, single sign-on module LemonLDAP LemonLdap can be a great Apache SSO function, and can handle ...

For large-scale data processing, MapReduce has the following three basic design ideas. 1. To deal with big data parallel processing: a large divide and conquer If the data can be divided into the same calculation of the data block, and there is no data dependence between these data blocks, then improve the processing speed of the best ...

& Http://www.aliyun.com/zixun/aggregation/37954.html "nbsp; Through the Hadoop security deployment experience summed up the following ten suggestions to ensure data security in large and complex and diverse environment information. Strong! Determine the privacy protection strategy for your data during planning and deployment, preferably before putting data into Hadoop ...

The problem arises in the data cluster number of nodes storage disk size is different, resulting in a period of time after the small capacity of the disk space is tight. In fact, the early configuration of the disk using the storage strategy, you can solve the problem, some networks to say that this strategy is invalid, and then hadoop2.0.1 this version is valid, the version applies to CHD4.6. In order to find an accurate program anchor point, refer to the following Hadoop design documents. Reference Hadoop HDFS file system Append / Hflush / Read design documents ...

1. What is MapReduce MapReduce is a computational model, framework and platform for big data parallel processing. It implies the following three meanings: 1) MapReduce is a cluster-based high-performance parallel computing platform (Cluster Infrastructure). It allows for the deployment of a distributed and parallel computing cluster of tens, hundreds to thousands of nodes with commercially available commercial servers. 2) MapReduce is a parallel computing and running software framework (Software ...

Apache publishes a page in its Hadoop Wikipedia that focuses on the benefits of running Hadoop in Docker and the need to run Hadoop entirely in Docker What you need to do ... There are many advantages to running Hadoop YARN in Docker, or other containers, as follows: Software Dependencies and Assignments ...

Hadoop service library: & nbsp; YARN uses a service-based object management model, the main features are: the object being serviced is divided into 4 states: NOTINITED , INITED, STARTED, STOPED Any change in service status can trigger other actions to combine any combination of services, ...

With the popularity of CSS3 and HTML5, our web pages not only require more user-friendly design concepts, but also require cooler page effects and user experience. As a developer, we need to understand some of the valuable CSS UI open source framework resources, they can help us to achieve some of the faster and better modern interface, including some mobile devices web interface style design. This article shares the top 10 CSS UI open source framework, a few really good, take a look together. 1, Bootstrap - the most popular W ...

Figure 1-14 shows the Hadoop system http://www.aliyun.com/zixun/aggregation/14305.html Distributed storage and parallel computing architecture from the hardware architecture point of view, Hadoop system is running in a normal The distributed storage and parallel computing system of commercial server cluster.The cluster will have a master node used to control and manage the normal operation of the entire cluster and coordinate the management of each slave nodes in the cluster to complete the data storage and computing tasks.All from Section ...

Raymie Stata, co-founder and CEO of Altiscale, a Hadoop as-a-service company, and former CTO of Yahoo, assisted Yahoo in completing the open source strategy and was involved in the launch of the Apache Hadoop project. Hadoop's expansion and operation are complex processes that hide potential crises in their implementation. Raymie has listed seven crisis signals and corresponding solutions based on experience to help users avoid disasters in advance. The following is the translation: Hadoop extension is a ...

Twelve Reasons Why Java Is Unshakable A Today, the technology that once was masked and defaced by various new technologies among programmers is something to remember. Just as the language of COBOL, which was revered as an artifact by the old programmers, is of little value today. And Java as the backbone of modern programmers at this point may be the next COBOL. How many books on JAVA technology is already a long-term memory. The use of the Java language now in middle age no longer appears on the covers of various magazines. JAVA from the ...

The Hadoop system runs on a compute cluster of commodity business servers that provide large-scale parallel computing resources while providing large-scale distributed data storage resources. On the big data processing software system, with the open-source development of the Apache Hadoop system, based on the original basic subsystem including HDFS, MapReduce and HBase, the Hadoop platform has evolved into a complete large-scale Data Processing Ecosystem. Figure 1-15 shows the Ha ...

& http: //www.aliyun.com/zixun/aggregation/37954.html "> This article introduces you to a few interesting Linux commands. 1. pv command 8630.html"> Sometimes we see on the movie screen Some subtitles one by one uniform display, like someone typing in the side of the keyboard, the same show. Linux on the pv command to achieve this ...