华东师范大学学报(自然科学版) ›› 2024, Vol. 2024 ›› Issue (2): 42-52.doi: 10.3969/j.issn.1000-5641.2024.02.006

• 计算机科学 • 上一篇    下一篇

基于微服务的研究生信息系统数据同步方案研究与设计

陶慧玲, 马依琳, 王晔*(), 董启文   

  1. 1. 华东师范大学 数据科学与工程学院, 上海 200062
  • 收稿日期:2022-07-20 出版日期:2024-03-25 发布日期:2024-03-18
  • 通讯作者: 王晔 E-mail:ywang@dase.ecnu.edu.cn

Research and design of data synchronization schemes of postgraduate information systems based on microservice

Huiling TAO, Yilin MA, Ye WANG*(), Qiwen DONG   

  1. 1. School of Data Science and Engineering, East China Normal University, Shanghai 200062, China
  • Received:2022-07-20 Online:2024-03-25 Published:2024-03-18
  • Contact: Ye WANG E-mail:ywang@dase.ecnu.edu.cn

摘要:

随着高校信息系统应用的普及以及使用频率的提高, 师生对数据一致性、准确性、及时性和完整性提出了更高的要求, 原数据同步方案中使用XML (extensible markup language)进行数据同步具有同步效率低下、难以扩展的缺点. 考虑到开源工具DataX可以完成多种异构数据库之间的数据同步且不会对源数据库造成破坏, 本文使用DataX对原数据同步方案进行改进, 并针对高校研究生信息系统建设过程中存在的多个业务需求和应用场景, 提出了不同的数据同步方案. 同时, 针对DataX在启动和执行过程中一次读只能进行一次写的缺点, 设计了一次读可以多次写的方案. 对比实验表明, 优化后的方案可以提高数据同步效率, 具有较好的扩展性, 能够满足高校数据同步需求.

关键词: 微服务, 数据同步, DataX

Abstract:

With the popularization of university information system applications and the increase in their usage frequency, teachers and students have higher requirements for data consistency, accuracy, timeliness, and completeness. The original data synchronization scheme using extensible markup language (XML) for data synchronization has the disadvantages of low synchronization efficiency and difficulty of expansion. The open-source tool, DataX, can complete data synchronization between various heterogeneous databases without damaging the source database. This study used DataX to improve the original data synchronization scheme and proposed different data synchronization schemes for various business requirements and application scenarios in the foundation of university postgraduate information system construction. At the same time, in view of the shortcomings of DataX in which only one read can do one write during the start-up and execution, the method where one read can do multiple writes was designed. The comparison experiment shows that the optimized scheme can improve data synchronization efficiency, has better scalability, and can meet the data synchronization requirements of universities.

Key words: microservice, data synchronization, DataX

中图分类号: