华东师范大学学报(自然科学版)

• 计算机科学 • 上一篇    下一篇

不对称内存计算平台OLAP查询处理技术研究

张延松[1-3] , 张 宇[4], 周 烜[1,2], 王 珊[1,2]   

  1. 1. 中国人民大学 DEKE实验室, 北京 100872; 2. 中国人民大学 信息学院, 北京 100872; 3. 中国人民大学 中国调查与数据中心, 北京 100872; 4. 国家卫星气象中心, 北京 100081
  • 收稿日期:2016-06-27 出版日期:2016-09-25 发布日期:2016-11-29
  • 通讯作者: 张 宇, 女, 博士, 研究方向为OLAP, GPU数据库. E-mail: zyszy511@hotmail.com.
  • 基金资助:

    国家 863 计划项目(2015AA015307)；中央高校基本科研业务费专项资金项目(16XNLQ02)；华为创新研究计划(HIRP 20140507, HIRP 20140510)

Research on OLAP query processing technology for asymmetric in-memory computing platform

ZHANG Yan-song[1-3], ZHANG Yu[4], ZHOU Xuan[1,2], WANG Shan[1,2]   

  1. 1. DEKE Lab, Renmin University of China, Beijing 100872, China; 2. School of Information, Renmin University of China, Beijing 100872, China; 3. National Survey Research Center at Renmin University of China, Beijing 100872, China; 4. National Satellite Meteorological Center, Beijing 100081, China
  • Received:2016-06-27 Online:2016-09-25 Published:2016-11-29

RichHTML

9

PDF

871

摘要：

给出了一种面向当前和未来不对称内存计算平台的 OLAP 查询处理技术. 不对称内存计算平台是指配置有不同计算类型的处理器、不同存储访问设备的计算机, 因此需要对 OLAP 查询处理模型按不同的计算特点进行优化存储配置和实现算法设计, 从而使 OLAP 查询处理的不同阶段更好地适应相应的存储与计算设备的硬件特点, 提高硬件设备的利用率, 更好地发挥硬件的性能. 提出了 3 阶段 OLAP 计算模型, 将传统基于迭代处理模型的 OLAP 查询处理过程分解为计算密集型和数据密集型负载, 分别由功能完备的通用处理器和并行计算能力强大的协处理器分而治之地完成, 并最小化不同存储与计算设备之间的数据传输代价. 实验结果表明基于负载划分的 3 阶段 OLAP 计算模型能够较好地适应 CPU-Phi 不对称计算平台, 实现通过计算型硬件加速计算密集型负载, 从而加速整 个 OLAP 查询处理性能的目标.

关键词: 内存计算; 不对称计算平台, 内存联机分析处理

Abstract:

This paper proposes an OLAP query processing technology for nowadays and future asymmetric in-memory computing platform. Asymmetric in-memory computing platform means that computer equips with different computing feature processors and different memory access devices so that the OLAP processing model needs to be optimized for different computing features and implementation designs to enable the different processing stages to adapt to the characteristics of corresponding storage and computing hardware for higher hardware utilization and performance. This paper proposes the 3-stage OLAP
computing model, which divides the traditional iterative processing model into computing intensive and data intensive workloads to be assigned to general purpose processor with full fledged functions and coprocessor with powerful parallel processing capacity. The data transmission overhead between different storage and computing devices is also minimized. The experimental results show that the 3-stage OLAP computing model based on workload partitioning can be adaptive to CPU-Phi asymmetric computing platform, the acceleration on OLAP query processing can be achieved by accelerating computing intensive workload by computing intensive hardware.

Key words: in-memory computing, asymmetric computing platform, in-memory OLAP