Journal of East China Normal University(Natural Sc ›› 2017, Vol. 2017 ›› Issue (5): 20-29.doi: 10.3969/j.issn.1000-5641.2017.05.003

• Data Management • Previous Articles     Next Articles

Storage and load balancing for large-scale comment data on heterogeneous Redis cluster

ZHANG Jing-wei1, DING Zhi-jun1, YANG Qing2, ZHANG Hui-bing1, ZHANG Hai-tao1, ZHOU Ya1   

  1. 1. Guangxi Key Laboratory of Trusted Software, Guilin University of Electronic Technology, Guilin Guangxi 541004, China;
    2. Guangxi Key Laboratory of Automatic Detection Technology and Instrument, Guilin University of Electronic Technology, Guilin Guangxi 541004, China
  • Received:2017-06-30 Online:2017-09-25 Published:2017-09-25

Abstract: The storage and query performance for large-scale comment data have a great influence on those applications built on the above data. In a heterogeneous computing environment, each node has different performance on storage and computation, it presents a key challenge for optimizing the storage and query performance for large-scale comment data by taking full advantage of the performance of each node. Based on the ability of Redis cluster, we design a storage model for large-scale comment data in a homogeneous Redis cluster, which provides the storage balancing in Redis slots. And then, we discuss the relationship between the number of Redis slots and query efficiency to design a method for allocating storage on the real load of each computing node for heterogeneous Redis clusters, which can make full use of the performance of each node and can guide to allocate slots to nodes by balancing the query performance and storage loading. Our experimental results show that the proposed model has a good effect on storage loading and improve the query efficiency of the heterogeneous Redis cluster.

Key words: large-scale comment data, storage and load balancing, query optimization

CLC Number: