Facebook Database Architecture

Editor's note: Data Center 2013: Hardware refactoring and Software definition report has a big impact. We have been paying close attention to the launch of the Data Center 2014 technical Report. In a communication with the author of the report, Zhang Guangbin, a senior expert in the data center, who is currently in business, he says it will take some time to launch. Fortunately, today's big number nets, Zhangguangbin just issued a good fifth chapter, mainly introduces Facebook's data center practice, the establishment of Open Computing Project (OCP) and its main work results. Special share. The following is the text: confidentiality is the data ...

With the rise of internet web2.0 websites, the relational database has become a very hot new field, the development of the non relational database products is very rapid. 　　But the traditional relational database in dealing with web2.0 website, especially the super large-scale and high concurrent SNS type web2.0 pure dynamic website already appeared to be powerless, has exposed many insurmountable problems, for example: 1, high configured--to the database higher concurrent reads and writes the demand WEB2.0 website to be based on user personalized information to generate real-time dynamic ...

As a software developer or DBA, one of the essential tasks is to deal with databases, such as MS SQL Server, MySQL, Oracle, PostgreSQL, MongoDB, and so on. As we all know, MySQL is currently the most widely used and the best free open source database, in addition, there are some you do not know or useless but excellent open source database, such as PostgreSQL, MongoDB, HBase, Cassandra, Couchba ...

From the 2008 60-man "Hadoop in China" technology salon, to the current thousands of-person scale of the industry technology feast, the seven-year BDTC (large data technology conference) has fully witnessed the transformation of China's large data technology and applications, faithfully depicting the large data field of technology hotspots, Precipitated countless valuable industry experience. At the same time, from December 2014 12 to 14th, the largest China data technology event will continue to lead the current field of technology hotspots, sharing the industry experience. In order to better understand the trend of industry development, understanding of enterprises ...

When it comes to big data, many people first think of internet companies, such as Google, Baidu and Alibaba. Internet companies in the large data analysis has indeed walked in the forefront of the industry, its aura also obscured the industry's big data shine. IDC defines big data with "4 V": volume represents greater capacity, produced represents a variety of data, velocity represents faster processing speed, and value means that large data can create more value. Tianjin Nanda General Data Technology Co., Ltd. (hereinafter referred to as the General) chief technical Officer Vounie said, such as ...

Introduction with the advent of the cloud computing era, various types of Internet applications are emerging, the relevant data model, distributed architecture, data storage and other database related technical indicators also put forward new requirements. Although the traditional relational database has occupied the unshakable position in the data storage, but because of its inherent limitation, has been unable to satisfy the cloud computing age to the data expansion, reads and writes the speed, the support capacity as well as the construction and the operation cost request. The era of cloud computing has put forward a new demand for database technology, which is mainly manifested in the following aspects. Mass data processing: to ...

It was easy to choose a database two or three years ago. Well-funded companies will choose Oracle databases, and companies that use Microsoft products are usually SQL Server, while budget-less companies will choose MySQL. Now, however, the situation is much different. In the last two or three years, many companies have launched their own Open-source projects to store information. In many cases, these projects discard traditional relational database guidelines. Many people refer to these items as NoSQL, the abbreviation for "not only SQL." Although some NoSQL number ...

As the most popular open source database, MySQL is widely used in Web applications and other small and medium-sized projects. However, in many large IT companies, MySQL has gradually deviated from the original open source version after being highly optimized and customized, more like a branch, such as the Webscalesql of Facebook, which was not long ago open source. 　　Recently, Mr. Xiong has published a blog post, from the perspective of large-scale web site architecture development of the changes in MySQL application, here for you to share. This article mainly describes the different and ...

The big data age has come and has quietly influenced our lives. According to a recent study by IDC, 1 million new links are shared every 20 minutes on Facebook and 10 million user reviews are released. 　　Facebook and all other Internet sites, Internet applications, have gradually become the entire data collection, analysis, processing and value-added architecture. In China, social networks are also in full swing. Sina Vice President Wang Gaofei has said that Sina Weibo has registered more than 300 million users, users on average daily release more than 100 million micro bonnet ...

With the development of the Internet, mobile Internet and IoT, no one can deny that we have actually ushered in a massive data era, data research company IDC expects 2011 total data will reach 1.8 trillion GB, the analysis of these massive data has become a very important and urgent demand. As an Internet data analysis company, we are "revolt" in the field of analysis of massive data. Over the years, with stringent business requirements and data pressures, we've tried almost every possible big data analysis method, and finally landed on the Hadoop platform ...