In this article, a communication data management platform based on an open sourced resource on clustered system which has the requirement for inmemory data computing is introduced, in order to support real time processing as well as online queries under the massive data volume efficiently. In particular, we firstly give a brief analysis on popular distributed and in memory techniques, provide candidate techniques and test for choosing the approprate ones for our task. Then, we design and implement an online communication data processing and query platform. Finally, we use inmemory techniques to optimize our platform performance. The experimental results indicate that the inmemory distributed computing system not only outperforms the disk based system in both query response time and real time processing speed, but also improves on resource utilization and data throughput.
CHAO Ping-Fu
,
ZHENG Zhi-Ling
,
FANG Jun-Hua
,
ZHANG Rong
. Distributed computing system for communication data management[J]. Journal of East China Normal University(Natural Science), 2014
, 2014(5)
: 89
-102
.
DOI: 10.3969/j.issn.10005641.2014.05.008