Computer Science

Research and design of data synchronization schemes of postgraduate information systems based on microservice

  • Huiling TAO ,
  • Yilin MA ,
  • Ye WANG ,
  • Qiwen DONG
Expand
  • 1. School of Data Science and Engineering, East China Normal University, Shanghai 200062, China

Received date: 2022-07-20

  Online published: 2024-03-18

Abstract

With the popularization of university information system applications and the increase in their usage frequency, teachers and students have higher requirements for data consistency, accuracy, timeliness, and completeness. The original data synchronization scheme using extensible markup language (XML) for data synchronization has the disadvantages of low synchronization efficiency and difficulty of expansion. The open-source tool, DataX, can complete data synchronization between various heterogeneous databases without damaging the source database. This study used DataX to improve the original data synchronization scheme and proposed different data synchronization schemes for various business requirements and application scenarios in the foundation of university postgraduate information system construction. At the same time, in view of the shortcomings of DataX in which only one read can do one write during the start-up and execution, the method where one read can do multiple writes was designed. The comparison experiment shows that the optimized scheme can improve data synchronization efficiency, has better scalability, and can meet the data synchronization requirements of universities.

Cite this article

Huiling TAO , Yilin MA , Ye WANG , Qiwen DONG . Research and design of data synchronization schemes of postgraduate information systems based on microservice[J]. Journal of East China Normal University(Natural Science), 2024 , 2024(2) : 42 -52 . DOI: 10.3969/j.issn.1000-5641.2024.02.006

References

1 刘敏斯, 陈少波.. 大数据时代高校智慧校园建设研究. 软件导刊, 2015, 14 (8): 6- 8.
2 雷芸, 涂庆华, 宋骏飞, 等.. 大数据时代高校智慧校园服务平台建设与研究. 通讯世界, 2017, (1): 275- 276.
3 王平.. 基于 SOA 的数字化校园资源整合研究. 信息技术, 2016, 40 (1): 159- 161.
4 王杰勋, 廖文和. 利用JMS, XML技术实现异构数据库的数据同步 [J]. 机械制造与自动化, 2007, 36(1): 68-70.
5 WANG Q, LIU N J, YU C. Research of ETL on university data exchange platform [C]// Proceedings of the 2011 IEEE International Symposium on IT in Medicine and Education. 2011: 285-288.
6 WANG S N, LYU X Y. The analysis and design of data sharing platform for universities based on blockchain technology [C]// Proceedings of the 2018 3rd International Conference on Automation, Mechanical Control and Computational Engineering. 2018: 160-165.
7 ZHAO D.. Discussion on the application of blockchain technology in Internet insurance industry. Journal of Financial Development Research, 2016, (12): 35- 38.
8 张迅. 基于HDFS的海量小文件存取优化技术与应用 [D]. 南京: 南京邮电大学, 2021.
9 唐紫珺, 蒋亮.. 基于Kettle的数据预处理应用. 信息技术与信息化, 2021, (8): 128- 130.
10 陈馨瑶. 智慧化校园数据共享与交换的研究与应用 [D]. 杭州: 浙江农林大学, 2020.
11 刘曦葳.. 教育部印发《教育信息化十年发展规划 (2011—2020年)》. 中国教育信息化, 2012, (8): 95.
12 刘蕊.. 数字化校园建设与高校管理工作探讨. 黑龙江科学, 2021, 12 (1): 132- 133.
13 万里鹏, 陈雅, 郑建明.. 中国高校数字化校园建设与思考. 情报科学, 2004, 22 (3): 356- 362.
Outlines

/