Recently, the mobile account management system of a province in East China has been officially migrated and cutover from Oracle database to GoldenDB database, marking a significant step forward in the independent and controllable development of domestic technology.
Mobile, a mobile telecommunications company in a certain province in Eastern China, is a subsidiary of China Mobile Communications Group. It has 11 city branches and 62 county (city) branches in the province, and is a major provider of mobile communication services in the province, always maintaining a leading position. The total number of mobile phone customers of the company has exceeded 90 million, and its network scale and total number of customers have ranked in the top 3 nationwide for eight consecutive years.
Since 2020, the Eastern China Mobile has been exploring innovation in communications, actively creating new forms of business independently controllable. Earlier, it migrated the channel center system from a traditional Oracle database to the domestic database Yunshixun AntDB based on Huawei ARM servers using the DSG SuperSync large-scale database high-performance replication tool, embarking on a new journey of transformation.
Based on the trust established in the initial cooperation, DSG has successively participated in the domestic data migration of more than a dozen large-scale core business databases such as the operator's customer center, order center, product warehouse, configuration warehouse, and channel, and undertook the database migration of the operator's account management system from Oracle to GoldenDB in 2023.
GoldenDB is a mature and stable leading distributed database developed by ZTE Corporation based on 20 years of accumulated research and development in the field of databases and 8 years of refining in the financial industry. It excels in SQL compatibility, transaction management, distributed scaling, data consistency, and data security.
In 2020, DSG's independently developed high-performance database replication platform SuperSync and comprehensive real-time data collection and sharing platform DataXone have been completed and mutually certified for product compatibility with GoldenDB.
DSG and ZTE product compatibility mutual recognition certificate
As a high-quality domestic enterprise in the software industry, DiSiJie has established a deep cooperative relationship with GoldenDB in this project. Based on the joint promotion of project implementation, both parties have fully leveraged their respective strengths to complement the shortcomings of conventional distributed database real-time synchronization across multiple nodes, and to incubate the full process of product research and development, adaptation, testing, and deployment in a short period of time, making the project implementation architecture more forward-looking.
DSG SuperSync, a high-performance replication tool for large databases, remains the cornerstone of this project implementation. From Oracle to GoldenDB migration, to GoldenDB reverse migration to Oracle databases, and then to real-time replication of data from various peripheral systems, the self-developed technology is applied throughout the process.
The total amount of data for this database migration is 24TB, with 120,000 tables needing to be migrated, many of which do not have primary keys, making the challenge quite apparent.
Challenges of the project
In addition to the massive database, the account management system also involves backend batch data processing work such as end-of-month billing, beginning-of-month prepaid deductions, and reconciliation statements, as well as complex DDL processing.
After the migration, the accounting system adopted GoldenDB 20 shards, involving sharded tables, multi-shard replicated tables, and single-shard replicated table flowback synchronization.
Implement data reconciliation between Oracle and GoldenDB, including number of records, content, full data, and incremental reconciliation.
In the cutover process, the data reconciliation verification and other operations take a short time, approximately 30 minutes.
After the completion of data migration and cut-off, reverse synchronization is still required to stream the incremental data from the GoldenDB database back to the original Oracle database in real time. This is to prevent abnormal situations and ensure the normal operation of the system through rollback.
一、Synchronous architecture
The specific steps are as follows:
二、Comparison architecture
Project Description:
By using the DSG XCMP data comparison tool, data comparison will be conducted in three stages: Oracle → AntDB/GoldenDB; AntDB/GoldenDB → Oracle; Oracle → Oracle. This will ensure 100% data quality and consistency, guaranteeing the integrity of the data.
Currently, DSG has completed the migration of 11 core business systems, including CRM, orders, channels, configuration vendors, and account management, in 11 cities for the operator. However, the migration is still ongoing, with more data-intensive and challenging tasks awaiting resolution.
2024.05.16
Learn more>
2024.04.01
Learn more>
2024.03.25
Learn more>
2024.03.18
Learn more>
2024.03.04
Learn more>
2024.02.19
Learn more>
2024.02.04
Learn more>
2024.01.22
Learn more>
2024.01.15
Learn more>
2024.01.02
Learn more>
2023.12.25
Learn more>
2023.12.20
Learn more>
2023.12.11
Learn more>
2023.12.04
Learn more>
2023.11.20
Learn more>
2023.11.13
Learn more>
2023.11.06
Learn more>
2023.10.30
Learn more>
2023.10.11
Learn more>
2023.09.15
Learn more>
2023.08.01
Learn more>
2023.07.25
Learn more>
2023.07.04
Learn more>
2023.05.29
Learn more>
2023.05.08
Learn more>
2023.03.06
Learn more>
2022.12.28
Learn more>
2022.11.14
Learn more>
2022.09.26
Learn more>