Twitter's open-source MySQL optimization results

According to the Twitter project blog,Twitter decided to open source its optimized MySQL version.

Twitter engineers Jeremy Cole and Davi Arnaut said in their blog:

Reference

MySQL is the main storage technology for most Twitter data, such as interest graphs, timelines, user data, and tweets. Because of our scale, we are better at promoting MySQL development than other companies. Of course, MySQL is an open source software, so we can improve it to meet our needs. We believe that sharing knowledge and open source code are conducive to innovation. We have decided to open source under the BSD license agreement.

 

This blog also listsMajor improvements to Twitter in MySQL include:

• Add additional state variables, especially inside InnoDB. This allows us to monitor our systems more effectively and better understand the behavior when handling product workloads.
• Memory Allocation Optimization in large-scale NUMA systems. The InnoDB buffer pool is fully allocated at startup, and the server performance is ensured even when the server memory pressure is high.
• Improve the server Statement Timeout) to reduce unnecessary work. This allows the server to cancel queries with a timeout interval greater than 1 ms.
• Use a safe and lightweight method to export and restore the InnoDB buffer pool.
• Optimize MySQL for SSD, including page refreshing-flushing) behavior and reduce disk writes to improve disk life.

Currently, the MySQL source code of Twitter is hosted on Github Based on the BSD license agreement.

Source Code address: https://github.com/twitter/mysql