Design and optimization of high-contention transaction processing architecture

doi:10.3969/j.issn.1000-5641.2023.06.003

Abstract

Abstract:

Shared-nothing distributed databases are designed for the high scalability and high availability request of Internet-based applications. There have been significant achievements in shared-nothing distributed databases, but for some shared-nothing databases with stateless computation layers, long conflict-detection paths challenge database performance under high-contention workloads. To solve this problem, we design two methods, pre-lock and local cache, together with a high-contention detection module that allow high-contention to be quickly detected and the corresponding high-contention-handling strategy applied. Experiments show that our design and optimization for high-contention transaction-processing architecture can improve the performance of distributed databases under high-contention workloads.

Key words: transaction processing, high-contention, distributed database

CLC Number:

TP392

Xuechao LIAN, Wei LIU, Qingshuai WANG, Rong ZHANG. Design and optimization of high-contention transaction processing architecture[J]. Journal of East China Normal University(Natural Science), 2023, 2023(6): 28-38.

Figures/Tables 7

Fig.1

Fig.2

Fig.3

Fig.4

Fig.5

Fig.6

Fig.7

References 19

1	PAVLO A, ASLETT M.. What’s really new with NewSQL?. SIGMOD Record, 2016, 45 (2): 45- 55.
2	BINNIG C, CROTTY A, GALAKATOS A, et al.. The end of slow networks: It’s time for a redesign. Proceedings of the VLDB Endowment, 2016, 9 (7): 528- 539.
3	ZAMANIAN E, SHUN J, BINNIG C, et al. Chiller: Contention-centric transaction execution and data partitioning for modern networks [C]// Proceedings of the 2020 International Conference on Management of Data. 2020: 511-526.
4	FARBER F, MAY N, LEHNER W, et al. The SAP HANA database – an architecture overview [J]. IEEE Data Engineering Bulletin, 2012, 35(1): 28-33.
5	KALLMAN R, KIMURA H, NATKINS J, et al. H-store: A high-performance, distributed main memory transaction processing system [J]. Proceedings of the VLDB Endowment, 2008, 1(2): 1496–1499.
6	LOMET D, FEKETE A, WEIKUM G, et al. Unbundling transaction services in the cloud [EB/OL]. (2009-09-09)[2022-06-11]. https://arxiv.org/ftp/arxiv/papers/0909/0909.1768.pdf.
7	HUANG D X, LIU Q, CUI Q, et al.. TiDB: A raft-based HTAP database. Proceedings of VLDB Endowment, 2020, 13 (12): 3072- 3084.
8	TAFT R, SHARIF I, MATEI A, et al. CockroachDB: The resilient geo-distributed SQL database [C]// Proceedings of the 2020 International Conference on Management of Data. 2020: 1493–1509.
9	CORBETT J C, DEAN J, EPSTEIN M, et al. Spanner: Google’s globally-distributed database [C]// Proceedings of the 10th USENIX Conference on Operating Systems Design and Implementation. 2012: 251–264.
10	ZHOU J Y, XU M, SHRAER A, et al. FoundationDB: A distributed unbundled transactional key value store [C]// Proceedings of the 2021 International Conference on Management of Data. 2021: 2653–2666.
11	PENG D, DABEK F. Large-scale incremental processing using distributed transactions and notifications [C]// Proceedings of the 9th USENIX Conference on Operating Systems Design and Implementation. 2010: 251–264.
12	WANG T Z, KIMURA H.. Mostly-optimistic concurrency control for highly contended dynamic workloads on a thousand cores. Proceedings of the VLDB Endowment, 2016, 10 (2): 49- 60.
13	GUO Z H, WU K, YAN C, et al. Releasing locks as early as you can: Reducing contention of hotspots by violating two-phase locking [C]// Proceedings of the 2021 International Conference on Management of Data. 2021: 658–670.
14	WANG Z G, MU S, CAI Y, et al. Scaling multicore databases via constrained parallel execution [C]// Proceedings of the 2016 International Conference on Management of Data. 2016: 1643–1658.
15	THOMSON A, DIAMOND T, WENG S C, et al. Calvin: Fast distributed transactions for partitioned database systems [C]//Proceedings of the ACM SIGMOD International Conference on Management of Data. 2012. https://doi.org/10.1145/2213836.2213838.
16	GUO H, ZHOU X, CAI L. Lock violation for fault-tolerant distributed database system [C]// 2021 IEEE 37th IEEE International Conference on Data Engineering. 2021: 1416–1427.
17	TAFT R, MANSOUR E, SERAFINI M, et al.. E-Store: Fine-grained elastic partitioning for distributed transaction processing systems. Proceedings of the VLDB Endowment, 2014, 8 (3): 245- 256.
18	TIAN B Y, HUANG J M, MOZAFARI B Y, et al.. Contention-aware lock scheduling for transactional databases. Proceedings of the VLDB Endowment, 2018, 11 (5): 648- 662.
19	COOPER B F, SILBERSTEIN A, TAM E, et al. Benchmarking cloud serving systems with YCSB [C]// Proceedings of the 1st ACM Symposium on Cloud Computing. 2010: 143–154.

[1]	ZHANG Shuyan, WANG Qingshuai, ZHANG Rong. High contention transaction processing prototype for e-commerce workloads [J]. Journal of East China Normal University(Natural Science), 2020, 2020(5): 1-9.
[2]	YU Wen-qian, HU Shuang, HU Hui-qi. The designs and implementations of columnar storage in Cedar [J]. Journal of East China Normal University(Natural Sc, 2018, 2018(5): 67-78.
[3]	HUANG Jian-wei, ZHANG Zhao, QIAN Wei-ning. Primary key management in distributed log-structured database systems [J]. Journal of East China Normal University(Natural Sc, 2018, 2018(5): 79-90,119.
[4]	ZHAO Chun-yang, XIAO Bing, GUO Jin-wei, QIAN Wei-ning. Application of the consistency protocol in distributed database systems [J]. Journal of East China Normal University(Natural Sc, 2018, 2018(5): 91-106.
[5]	HE Xiao-long, MA Hai-xin, HE Yu-kun, PANG Tian-ze, ZHAO Qiong. Technology and implementation of a new OLTP system [J]. Journal of East China Normal University(Natural Sc, 2018, 2018(5): 107-119.
[6]	WANG Yan-zhao, HU Hui-qi, ZHANG Zhao, LIU Xiao-bing, DUAN Hui-chao. Sublink elimination and optimization in data storage and processing separation architecture [J]. Journal of East China Normal University(Natural Sc, 2018, 2018(4): 90-98.
[7]	CHU Jia-jia, GUO Jin-wei, LIU Bo-zhong, ZHANG Chen-dong, QIAN Wei-ning. On the distributed consensus protocol in high-availability database systems [J]. Journal of East China Normal University(Natural Sc, 2016, 2016(5): 1-9.
[8]	MAO Si-yu, ZHANG Li-jun, ZHANG Xiao-fang, GAO Jin-tao, LI Zhan-huai. Optimization strategies of correlated subquery for distributed database [J]. Journal of East China Normal University(Natural Sc, 2016, 2016(5): 56-66.
[9]	QIAN Zhao-ming, WANG Lei, YU Sheng-jun, GONG Xue-qing. Implementation of Semi-Join algorithm in a distributed system [J]. Journal of East China Normal University(Natural Sc, 2016, 2016(5): 75-80.
[10]	YU Kai, LI Zhi-fang, ZHOU Min-qi, ZHOU Ao-ying. Research and implementation of transactional real-time data ingestion technology without blocking [J]. Journal of East China Normal University(Natural Sc, 2016, 2016(5): 131-143.
[11]	REN Kun, LI Zhan-Huai. Key techniques and challenges of designing new OLTP database systems [J]. Journal of East China Normal University(Natural Sc, 2014, 2014(5): 31-42.
[12]	ZHOU Huan, FAN Qiu-Shi, HU Hua-Liang. Consistency and availability in OceanBase [J]. Journal of East China Normal University(Natural Sc, 2014, 2014(5): 103-116.
[13]	PANG Tian-Ze, ZHANG Chen-Dong, GAO Ming, GONG Xue-Qing. Implementation of database schema design in distributed environment [J]. Journal of East China Normal University(Natural Sc, 2014, 2014(5): 290-300.