In the past two years of the epidemic, DSG has been quite busy.

In August 2021, DSG entered the domestic testing phase of a state-owned large bank as a data synchronization service provider. Since then, a major domestication revolution has begun.

This revolution is based on the fact that the client is still in the stage of selecting domestic databases, facing a variety of database types, strong uncertainty, tight time, and heavy tasks. DSJ needs to respond to more domestication demands.

Fortunately, as promised, from data synchronization to data migration, and then to the subsequent solution and technical support, the revolution has proceeded smoothly, with more to come...

The first stage to be initiated was real-time data synchronization, with the main task at the time being to complete the real-time synchronization of core system data from domestic databases to big data platforms.

Compared to DSG's previous experiences, the management of core databases in state-owned banks is more complex, the technical requirements are higher, and the social impact is broader. Ensuring the integrity of transactions and the consistency of data is the core demand of state-owned banks, and the corresponding data synchronization construction has also put forward higher requirements.

In response to the above issues, combined with the differences in heterogeneous database characteristics and the lack of standardization in data quality, it was yet another strong communication and highly collaborative combat experience.

During the implementation of the data migration project, at a certain point in time, we encountered tight deadlines, heavy tasks, and the collective resistance to "sheep", making the completion of the project extremely difficult. It was through the collective efforts of everyone working together that we were able to complete the data migration of more than 50 systems that year, successfully fulfilling the mission of the bank.

Example of data migration architecture for voltage-sensitive cables

Technical architecture diagram

Data architecture diagram

Scenarios for source database shutdown (stop writing data): Use data migration tools to transfer data to the target heterogeneous database in a one-time full amount.

Scenarios for source database non-shutdown (data is still being written during migration): The data migration tool supports full incremental data migration, and can continue to synchronize incremental data after the full amount is completed, until the source database switches after writing data is stopped at the specified time.

Buffer operation mechanism: The data migration component needs to convert and store the collected data, requiring a certain amount of hard disk storage space. These buffered data are stored in the directories of each migration task; the storage of data is temporary, and during the migration operation, these temporary data will be marked and cleared after loading and replaying into the target database, freeing up space for another migration task in the future.

Data isolation mechanism

Data Migration Channel Isolation: Each single migration from a source database to a target database is treated as a data migration channel, with each channel corresponding to a separate data directory in the data migration platform. These directories are used to store the buffered data collected and loaded, ensuring the isolation of data for different migration tasks.

The SuperSync high-performance database replication platform developed by DSG is designated as the most important domestication tool for the entire state-owned large-scale banks in the current digital transformation construction. It has not only achieved breakthroughs in compatibility with more types of domestic databases and adaptation rates, but also accumulated a representative practical experience of the group's scale.

Drawing strength from the external ecosystem and rooting down through internal accumulation, DSG always adheres to the principles of independence, controllability, and win-win cooperation. With higher product quality, stronger technical capabilities, and better user experiences, we aim to assist our clients in achieving better digital transformation. In the future, domestic creative technology will surely have more opportunities!