Big Data volume business order and solution thinking

The system of big data has to go through the analysis of data usage and data cycle to find a better solution.

1: Basic data of the business system, such as the basic information (basic information, authority, etc.)
The data can be keep in memory. The data should be stored in a decentralized, concise, basic data logic. Use incremental updates. Update base data ahead of peak

2: Thermal Data processing
This part of the data is frequently used in all aspects of the data storage of this data, such as the use of different storage methods, such as the establishment of efficient indexes, the use of SSD disk, or the use of MySQL database storage

3: Migration of historical data

Recent data such data is the data that needs to be used or called recently, which is the core data for OLTP systems.
Historical data This type of data is mainly historical data query or historical analysis data, it is recommended to migrate out of the OLTP system database

4: Storage of report data
Data conversion from raw data, to custom data, and then to report data

5: Database Business splits multi-table data storage
Split the core business tables to improve the performance of the database and to improve the security of the data

6: Storage of index data
Deletion of invalid indexes and periodic rebuilding of indexes and introduction of SSD disks etc. processing

Data flow

Data center
Tailor-made small data centers around the central database

Data distribution mechanism
Data distribution by Region city, etc.

Transfer of center data after storage

MYSQL: Query class System: queries like Web sites

Multiple sets of Oracle: Multi-purpose Systems: Backup, logistics monitoring, reporting, etc.

ORACLE: Core Business System: Information flow, logistics, capital flow control system of whole flow

Big Data Analytics System: Analyze historical data or big data.

Big Data volume business order and solution thinking