--oceanbase distributed database system for decrypting and supporting Alipay transactions

This year's Taobao double 11 transactions reached an astonishing 57.1 billion, in these glossy data behind, in fact, Taobao database is a great test. What is more noteworthy is that this year the double 11 Alipay payment peak broke through 2.85 million strokes per minute, hitting a new record. The volume of such a high concurrency load has made us curious about the database technology behind the scenes oceanbase. What are the strengths of oceanbase?

I believe that you read this article on the understanding.

2014 China Large Data Technology conference the 2nd afternoon large Data Ecosystem forum, Alibaba senior technical expert Zhi Yong for you to introduce the Oceanbase, the keynote speaker titled "Oceanbase, Support Alipay transaction distributed Database System".

Zhi Yong says Oceanbase is a distributed relational database and the first non-commercial database for financial core systems. Compared to traditional business solutions, it offers much-needed features for many internet companies: pc-based servers, scalable online, no shared storage, and a higher cost-performance ratio than a commercial database.

Zhi Yong also contrasts the need for different characteristics of databases in the Internet and traditional services:

Transaction (ACID): Internet = traditional business;

Usability: Internet = Traditional Business performance:

Internet >> traditional business;

Price/performance: Internet >> traditional business;

Scalability: Internet >> traditional business.

In order to ensure the integrity of the data, in the use of gray upgrades, Ali will also check the data: disk read and write, each record with 64-bit checksum; network transmission, each network packet with 64-bit checksum; multiple copies per file (3~6), each file has 64-bit checksum; Modify incremental multiple copies, with 64-bit cumulative checksum; Redo log, each with checksum and checksum corresponding to updateserver memory, with 64-bit checksum for each column in each table.

Some information about Alipay core database oceanbase:

1, Oceanbase is an independent research and development of Alibaba to support the massive data of high-performance distributed database system.

2, compared to the traditional relational database, talk about the biggest bright spot of Oceanbase, when it is an automatic expansion of the characteristics, it can not only extend to a data center, and even the city, in the future, Oceanbase can become a global database of multiple data centers. Of course, Oceanbase has some features, such as strong consistency, that can automatically tolerate a server or even an entire datacenter failure without losing a single record. It is worth emphasizing that the Alipay transaction will choose Oceanbase rather than open source MySQL, precisely because only oceanbase can do not lose the data completely.

3, Oceanbase will automatically cut the data into a relatively small slice, each machine service several pieces, when a server fragmentation becomes a hot spot, will automatically trigger the migration operation, will be fragmented from the higher load server migration out, so that the "barrel effect." This is also an advantage of oceanbase, regardless of the 11 hot spots before the change, oceanbase can quickly balance the hotspot data to the entire cluster, rather than because one or two servers to the entire cluster collapsed.

4, Oceanbase is a true distributed relational database, not only support distributed, but also support SQL, transaction, concurrency control such a relational database features, users use up and MySQL no difference.

5, Oceanbase of the transaction engine designed for memory, it is characterized by fast, but also to avoid the traditional database of the write amplification problem, so that the oceanbase lock waiting by nature will be less. In addition, Oceanbase also put forward and the first implementation of early unlock, queuing and other optimization ideas, these ideas later applied to the group MySQL database patch, become Ali Double 11 to deal with hot issues standard.

6, and the difference between MySQL is that MySQL master standby synchronization is a risk of losing data, and oceanbase through the Paxos election protocol to achieve strong consistency. Whether it is a server, or the overall failure of the data center, Oceanbase can automatically recover, and do not lose the data completely. Oceanbase's approach is in common with the underlying principles of Google, Microsoft, and Amazon Cloud storage systems.