Article

Distributed computing system for communication data management

  • CHAO Ping-Fu ,
  • ZHENG Zhi-Ling ,
  • FANG Jun-Hua ,
  • ZHANG Rong
Expand
  • 1. Software Engineering Institute, East China Normal University, Shanghai,200062, China;
    2. Institute for Data Science and Engineering,  East China Normal University, Shanghai,200062, China

Online published: 2014-11-27

Abstract

In this article, a communication data management platform based on an open sourced resource on clustered system which has the requirement for inmemory data computing is introduced, in order to support real time processing as well as online queries under the massive data volume efficiently. In particular, we firstly give a brief analysis on popular distributed and in memory techniques, provide candidate techniques and test for choosing the approprate ones for our task. Then, we design and implement an online communication data processing and query platform. Finally, we use inmemory techniques to optimize our platform performance. The experimental results indicate that the inmemory distributed computing system not only outperforms the disk based system in both query response time and real time processing speed, but also improves on resource utilization and data throughput.

Cite this article

CHAO Ping-Fu , ZHENG Zhi-Ling , FANG Jun-Hua , ZHANG Rong . Distributed computing system for communication data management[J]. Journal of East China Normal University(Natural Science), 2014 , 2014(5) : 89 -102 . DOI: 10.3969/j.issn.10005641.2014.05.008

Outlines

/