Journal of East China Normal University(Natural Sc ›› 2017, Vol. 2017 ›› Issue (5): 30-39.doi: 10.3969/j.issn.1000-5641.2017.05.004

• Data Management • Previous Articles     Next Articles

Design and implementation of Smart materialization for column-store in CLAIMS

ZHANG Han, ZHOU Min-qi   

  1. School of Data Science and Engineering, East China Normal University, Shanghai 200062, China
  • Received:2017-06-19 Online:2017-09-25 Published:2017-09-25

Abstract: Materialization is a necessary operation in the process of query execution. Materialization strategy and materialization technology play an important role in the process of query execution. Therefore, it is necessary to design a materialization strategy for column-store database. According to the shortcomings of early materialization and later materialization, we provide a strategy named Smart materialization that are different from the two strategies mentioned above. Here we need to define a concept in the logical query plan-projection, the structure is used to select the desired attributes, the physical table is cut by column, to ensure that the structure at the beginning of the query can reduce the direct load to memory of the amount of data, to avoid additional overhead. In the logical query plan, the projection is divided by columns, and the next required columns are predicted according to the relevance of the query in a set of queries, and the required columns are stabilized in one of the most appropriate projection. We use the data set of TPC-H to verify its validity worked on the disturbed in-memory database-CLAIMS.

Key words: projection, Smart materialization, data compression

CLC Number: