Some time ago, the company had a project that needed to import data from a text file. There were 5600 text files, and more than pieces of statistics were collected after the import. because the data is complex and difficult to analyze, the file is saved to the database in segments. As a result, the data in some intermediate states reaches 1100 million, resulting in slow data query, therefore, we consider splitting the intermediate data table into two types: one for storing data and the other for storing the fields used for query. the blockid fields used in the two tables are associated. as a result, the tables that store data have data records, and the tables that store queries have million data records. after testing, the query data is much faster. Of course, indexes are used for the query condition fields.
However, at that time, the corresponding data was not recorded. At that time, SQL profile was used for monitoring.
Likewise, it is a good idea to split a database into two databases when the data volume is large.
The content source of this page is from Internet, which doesn't represent Alibaba Cloud's opinion;
products and services mentioned on that page don't have any relationship with Alibaba Cloud. If the
content of the page makes you feel confusing, please write us an email, we will handle the problem
within 5 days after receiving your email.
If you find any instances of plagiarism from the community, please send an email to:
info-contact@alibabacloud.com
and provide relevant evidence. A staff member will contact you within 5 working days.
