Architecture Design of the Data Exchange Platform

Preface

When it comes to architecture design, I dare not be arrogant. We can only pay tribute to Linux in silence. Without a powerful Linux system, the architecture we designed may be several times a day. (I won't talk about windows, huh, huh)

Architecture Development of the Data Exchange Platform

The architecture is not achieved overnight. It is gradually formed and evolved with the accumulation of technical capabilities of the team, the gradual improvement of the company's data platform, and the deep learning of relevant open-source products.

Different Stages require different architectures. Therefore, we cannot simply say that either architecture is good or not. As long as it is suitable for the current environment, it is the best. If the development of the company's business and project support for other modules do not play a role of constraint or restriction, OK. If it can play a leading role, it is awesome.

Of course, from the perspective of vertical project development history, it must be the best of the latest version. I spent the most time and energy, haha.

This is not the name of the Data Exchange Platform. It was called a data dumping tool, and it was afraid that the name would be too big to be squashed. (Haha, this may be the reason for naming the child. Someone starts to give the goods a name like this)

The data dump tool is just a program and only supports ora2ora data synchronization.

The program ran for about three months. Later, based on business needs, the program began to add data sources and added data exchange for mysql2ora. This is the second phase of the Data Exchange Project.

After three months, we began to design and develop the data exchange phase III project, which is now the Data Exchange Platform. In essence, it is still the core, but it only adds some classes for splitting and encapsulation. In addition, two types of data exchange are added, mysql2mysql and ora2mysql.

Latest Architecture

As follows:

Architecture Design of the Data Exchange Platform