Persistent memory- and shared cache architecture-based high-performance database

doi:10.3969/j.issn.1000-5641.2023.05.001

Abstract

Abstract:

The upsurge in cloud-native databases has been drawing attention to shared architectures. Although a shared cache architecture can effectively address cache consistency issues among multiple read-write nodes, problems still exist, such as slow persistence speed, high latency in maintaining cache directories, and timestamp bottlenecks. To address these issues, this study proposes a shared cache architecture-based solution that is combined with novel persistent memory hardware, to realize a three-layer shared architecture database—TampoDB, which includes memory, persistent memory, and storage layers. The transaction execution process was redesigned based on this architecture with optimized timestamps and directories, thereby resolving the aforementioned problems. Experimental results show that TampoDB effectively enhances the persistence speed of transactions.

Key words: cloud-native database, persistent memory, shared cache

CLC Number:

TP392

Congcong WANG, Huiqi HU. Persistent memory- and shared cache architecture-based high-performance database[J]. Journal of East China Normal University(Natural Science), 2023, 2023(5): 1-10.

Figures/Tables 6

Fig.1

Fig.2

Fig.3

Fig.4

Fig.5

Fig.6

References 12

1	VERBITSKI A, GUPTA A, SAHA D, et al. Amazon aurora: Design considerations for high throughput cloud-native relational databases [C]// Proceedings of the 2017 ACM International Conference on Management of Data. 2017: 1041-1052.
2	CAO W, ZHANG Y, YANG X, et al. Polardb serverless: A cloud native database for disaggregated data centers [C]// Proceedings of the 2021 International Conference on Management of Data. 2021: 2477-2489.
3	CORBETT J C, DEAN J, EPATEIN M, et al.. Spanner: Google’s globally distributed database. ACM Transactions on Computer Systems (TOCS), 2013, 31 (3): 1- 22.
4	GUAY PAZ J R. Introduction to Azure Cosmos DB [M]// Microsoft Azure Cosmos DB Revealed: A Multi-model Database Designed for the Cloud. California: Apress Berkeley, 2018: 1-23.
5	ANTONOPOULOS P, BUDOVSKI A, DIACONU C, et al. Socrates: The new SQL server in the cloud [C]// Proceedings of the 2019 International Conference on Management of Data. 2019: 1743-1756.
6	ZIEGLER T, BINNIG C, LEIS V. ScaleStore: A fast and cost-efficient storage engine using DRAM, NVMe, and RDMA [C]// Proceedings of the 2022 International Conference on Management of Data. 2022: 685-699.
7	LAHIRI T, SRIHARI V, CHAN W, et al. Cache fusion: Extending shared-disk clusters with shared caches [C]// Proceedings of the 27th VLDB Conference. 2001: 683-686.
8	ZAMANIAN E, BINNIG C, KRASKA T, et al.. The end of a myth: Distributed transactions can scale. Proceedings of the VLDB Endowment, 2017, 10 (6): 685- 696.
9	ASTRAHAN M M, BLASGEN M W, CHAMBERLIN D D, et al.. System R: Relational approach to database management. ACM Transactions on Database Systems (TODS), 1976, 1 (2): 97- 137.
10	LARDINOIS F. Google Cloud launches AlloyDB, a new fully managed PostgreSQL database service [EB/OL]. [2023-05-30]. https://cloud.google.com/alloydb.
11	MONGODB INC. MongoDB: A source-available cross-platform document-oriented database program [EB/OL]. [2023-05-30]. https://www.mongodb.com.
12	LAKSHMAN A, MALIK P.. Cassandra: A decentralized structured storage system. ACM SIGOPS Operating Systems Review, 2010, 44 (2): 35- 40.

[1]	Shuai ZHANG, Huiqi HU, Yaoqiang XU, Xuan ZHOU. Time series database query optimization for anomaly detection [J]. Journal of East China Normal University(Natural Science), 2023, 2023(2): 119-131.
[2]	Jialin GUAN, Yan ZHU, Tingliang WU, Yan CHEN, Jingwei ZHANG. A memory allocation strategy for learned index based on huge pages [J]. Journal of East China Normal University(Natural Science), 2023, 2023(2): 73-81.
[3]	Mengnan LIU, Jianqiu XU. Two-level trajectory data partition algorithm based on query cost [J]. Journal of East China Normal University(Natural Science), 2022, 2022(5): 184-194.
[4]	Yongjin TANG, Jiabo SUN, Peng CAI. Optimization of HTAP data synchronization based on query frequency [J]. Journal of East China Normal University(Natural Science), 2022, 2022(5): 26-35.
[5]	Ting CHEN, Zhaokun XIANG, Jinkai XU, Rong ZHANG. Benchmarking join order selection of query optimizers [J]. Journal of East China Normal University(Natural Science), 2022, 2022(5): 48-60.
[6]	Shuhong YOU, Qian SU, Rong ZHANG. Dynamic simulation for cloud database runtime environment [J]. Journal of East China Normal University(Natural Science), 2022, 2022(5): 73-89.
[7]	Yaoyi HU, Huiqi HU, Xuan ZHOU, Aoying ZHOU. SQLite-CC based on non-volatile memory cache [J]. Journal of East China Normal University(Natural Science), 2021, 2021(6): 124-134.
[8]	Jiabo SUN, Peng CAI. Query optimization technology based on an LSM-tree [J]. Journal of East China Normal University(Natural Science), 2021, 2021(5): 94-103.
[9]	Wenxin LIU, Peng CAI. Partition-based concurrency control in a multi-master database [J]. Journal of East China Normal University(Natural Science), 2021, 2021(5): 84-93.
[10]	Zhaokun XIANG, Ting CHEN, Qian SU, Rong ZHANG. A fuzzer for query processing functionality of OLAP databases [J]. Journal of East China Normal University(Natural Science), 2021, 2021(5): 74-83.
[11]	Yang YU, Huiqi HU, Xuan ZHOU. Optimization of LSM-tree storage systems based on non-volatile memory [J]. Journal of East China Normal University(Natural Science), 2021, 2021(5): 37-47.
[12]	Chuangxin FANG, Hao SONG, Yuming LIN, Ya ZHOU. Query processing of large-scale product knowledge in a CPU-GPU heterogeneous environment [J]. Journal of East China Normal University(Natural Science), 2021, 2021(5): 157-168.
[13]	DING Guo-hao, XU Chen, QIAN Wei-ning. Efficient data loading for log-structured data stores [J]. Journal of East China Normal University(Natural Sc, 2019, 2019(5): 143-158.
[14]	ZHU Chao-fan, GUO Jin-wei, CAI Peng. Implementation and optimization of a distributed consistency algorithm based on Paxos [J]. Journal of East China Normal University(Natural Sc, 2019, 2019(5): 168-177.
[15]	TU Yun-shan, CHU Jia-jia, ZHANG Yao, WENG Chu-liang. Data processing software technology for new hardware [J]. Journal of East China Normal University(Natural Sc, 2018, 2018(5): 30-40,78.