Journal of East China Normal University(Natural Sc ›› 2014, Vol. 2014 ›› Issue (5): 89-102.doi: 10.3969/j.issn.10005641.2014.05.008

• Article • Previous Articles     Next Articles

Distributed computing system for communication data management

CHAO  Ping-Fu1, ZHENG  Zhi-Ling1, FANG  Jun-Hua1, ZHANG  Rong1,2   

  1. 1. Software Engineering Institute, East China Normal University, Shanghai,200062, China;
    2. Institute for Data Science and Engineering,  East China Normal University, Shanghai,200062, China
  • Online:2014-09-25 Published:2014-11-27

Abstract: In this article, a communication data management platform based on an open sourced resource on clustered system which has the requirement for inmemory data computing is introduced, in order to support real time processing as well as online queries under the massive data volume efficiently. In particular, we firstly give a brief analysis on popular distributed and in memory techniques, provide candidate techniques and test for choosing the approprate ones for our task. Then, we design and implement an online communication data processing and query platform. Finally, we use inmemory techniques to optimize our platform performance. The experimental results indicate that the inmemory distributed computing system not only outperforms the disk based system in both query response time and real time processing speed, but also improves on resource utilization and data throughput.

Key words: communication data management, distributed system, in memory computation, real time data processing

CLC Number: