华东师范大学学报（自然科学版） ›› 2021, Vol. 2021 ›› Issue (5): 84-93.doi: 10.3969/j.issn.1000-5641.2021.05.008

• 系统关键技术 • 上一篇    下一篇

多主数据库中基于分区的并发控制

刘文欣(), 蔡鹏*()   

  1. 华东师范大学 数据科学与工程学院, 上海　200062
  • 收稿日期:2021-07-25 出版日期:2021-09-25 发布日期:2021-09-28
  • 通讯作者: 蔡鹏 E-mail:51195100012@stu.ecnu.edu.cn;pcai@dase.ecnu.edu.cn

Partition-based concurrency control in a multi-master database

Wenxin LIU(), Peng CAI*()   

  1. School of Data Science and Engineering, East China Normal University, Shanghai　200062, China
  • Received:2021-07-25 Online:2021-09-25 Published:2021-09-28
  • Contact: Peng CAI E-mail:51195100012@stu.ecnu.edu.cn;pcai@dase.ecnu.edu.cn

RichHTML

46

PDF

300

摘要：

大数据时代, 存储计算架构分离的单写多读场景已无法满足海量数据的高效读写需求; 另一方面, 多个计算节点同时提供写服务还会引起计算节点间的缓存不一致. 已有的研究采用全局有序的事务日志来进行冲突检测, 并通过广播和回放事务日志维护整个系统的数据一致性. 但该类方案由于是在每个写节点维护全局写日志, 可扩展性较差. 针对这些问题, 提出了一个基于分区的并发控制方案: 通过分区的方式降低每个写节点需要维护的事务日志, 以有效提升系统的扩展能力. 基于此想法, 在MySQL上实现了分区多主插件, 并通过实验验证了该解决方案对系统性能的影响.

关键词: 多主数据库, 分区, 并发控制

Abstract:

In the era of big data, the single-write multi-read process with separate storage and computing architectures can no longer meet the demands for efficient reading and writing of massive datasets. Multiple computing nodes providing write services concurrently can also cause cache inconsistencies. Some studies have proposed a global ordered transaction log to detect conflicts and maintain data consistency for the whole system using broadcast and playback of the transaction log. However, this scheme has poor scalability because it maintains the global write log at each write node. To solve this problem, this paper proposes a partition-based concurrency control scheme, which reduces the transaction log maintained by each write node by partitioning, and effectively improves the system’s overall expansion ability.

Key words: multi-master database, partition, concurrency control

中图分类号: