Journal of East China Normal University(Natural Science) ›› 2023, Vol. 2023 ›› Issue (5): 11-25.doi: 10.3969/j.issn.1000-5641.2023.05.002

• Database Systems • Previous Articles     Next Articles

An HTAP database prototype with an adaptive data synchronization

Rong YU1, Panfei YANG2,*(), Qingshuai WANG1, Rong ZHANG1   

  1. 1. School of Data Science and Engineering, East China Normal University, Shanghai 200062, China
    2. The Fifth Electronics Research Institute of the Ministry of Industry and Information Technology, Guangzhou 511300, China
  • Received:2023-06-29 Online:2023-09-25 Published:2023-09-15
  • Contact: Panfei YANG


In HTAP (hybrid transactional and analytical processing) database, resource isolation and data sharing is a difficult problem. Although different vendors achieve resource isolation through different architectures, the freshness of user concerns, that is, the gap between online transactional processing (OLTP) write and online analytical processing (OLAP) read versions, is determined by the consistency model of data sharing. However, existing HTAP databases apply only one consistency synchronization model for an easy implementation, which is contradictory to the multiple consistency requirements of user applications, and the overall system performance is sacrificed for the highest consistency upward compatibility. In this paper, by constructing a cost model of freshness and performance tradeoff, proposing a consistency switching algorithm and a processing strategy for synchronized data before and after switching, and realizing an HTAP database prototype with adaptive switching between sequential consistency synchronization and linear consistency synchronization, which makes it possible to support query loads with different consistency (freshness) requirements and maximize the system performance without adjusting the HTAP architecture. The effectiveness of adaptive switching is also verified by extensive experiments.s of adaptive switching is also verified by extensive experiments.

Key words: HTAP database systems, data synchronization, consistency model, adaptive synchronization mode switching, performance and freshness trade off

CLC Number: