Data correlation-based partition approach for distributed deputy database

doi:10.3969/j.issn.1000-5641.2016.05.006

Abstract

Abstract:

Object deputy database (ODDB) is an advanced database system with strong ability of complex information processing. With the rapid development of data, distributed storage becomes more and more important to ODDB. However, there exist correlations between objects in ODDB, which makes the traditional data portioning method of distributed storage unsuitable. To solve this problem, we propose a data correlation-based partition approach for ODDB. Firstly, we cluster correlated objects according to the deputy tree, and each object cluster is considered as a heap file in storage. Secondly, on the basis of schema feature and semantic feature, we divide object clusters into k subsets using k-means, each subset is stored on one of the storage nodes. Finally, we compare our method with random distributed storage, the results show that our approach is obviously better in query efficiency.

Key words: distributed, object deputy database, correlation, data partition, object cluster

WANG Min, PENG Cheng-chen, LI Rong-rong, PENG Yu-wei. Data correlation-based partition approach for distributed deputy database[J]. Journal of East China Normal University(Natural Sc, doi: 10.3969/j.issn.1000-5641.2016.05.006.

References

[ 1 ] PENG Z Y, KAMBAYASHI Y. Deputy mechanisms for object-oriented database[C]//Proceedings of the 11th International Conference on Data Engineering. 1995: 333-340.
[ 2 ] KAMBAYASHI Y, PENG Z Y. Object deputy model and its applications[C]//Proceedings of the 4th Inernational Conference on Database Systems for Advenced Applications. 1995: 1-15.
[ 3 ] 彭智勇, 黄泽谦,刘俊. 基于对象代理数据库的微生物信息服务系统[J]. 计算机应用,2010(1): 5-9.
[ 4 ] PENG Z Y, SHI Y, ZHAI B X. Realization of biological data management by object deputy database system[C]//Transaction on Computational Systems Biology V. Berlin: Springer, 2006: 49-67.
[ 5 ] 彭智勇, 彭煜玮, 翟博譞. 一个基于对象代理模型的多表现地信息系统[J]. 计算机应用, 2006(9):2016-2019.
[ 6 ] 彭智勇. Web数据管理系统: 201010140168.4[P]. 2010-09-15.
[ 7 ] MACQUEEN J. Some methods for classification and analysis of multivariate observations [C]//Proceedings of the 5th Berkeley Symposium on Mathematical Statistics and Probability. 1967: 281-297.
[ 8 ] ?黄泽谦. 对象代理数据库聚簇策略与查询优化技术研究[D].武汉: 武汉大学, 2011.
[ 9 ] BAIAO F, MATTOSO M, ZAVERUCHA G. A distribution design methodology for object DBMS[J]. Distributed and Parallel Databases, 2004,16(1): 45-90.
[10] OZSU M T, VALDURIEZ P. Principles of Distributed Database Systems[M]. New York: Springer-Verlag, 2002.
[11] NAVATHE S B, RA M. Vertical partitioning for database design: A graphical algorithm[J]. ACM Sigmod Record, 1989, 18(2): 440-450.
[12] EZEIFE C, BARKER K. A comprehensive approach to horizontal class fragmentation in a distributed object based system[J]. International Journal of Distributed and Parallel Databases, 1995(3): 247-272.
[13] ?施源, 彭智勇, 庄继峰, 等. 对象关系数据库中OID回收机制[J].计算机科学, 2004, 31(10): 566-568+581.
[14] SHAMEEM M U S, FERDOUS R. An efficient k-means algorithm integrated with Jaccard distance measure for document clustering[C]//Proceedings of the Asian Himalayas International Conference on Internet. 2009: 1-6.
[15] WEIL S A. Ceph: Reliable, scalable, and high-performance distributed storage[D]. Santa Cruz: University of California Santa Cruz, 2007.

[1]	Yanli FENG, Yu ZHOU, Fuxing HUANG, Junling WAN, Peisen YUAN. Study on short-term electricity load forecasting based on SF-Transformer for intelligent education platform [J]. Journal of East China Normal University(Natural Science), 2024, 2024(5): 173-182.
[2]	Chen ZHANG, Zhi TANG, Yan LU, Rui LI, Zhongyang GUO. Accounting and change analysis of ecological asset in Yingpu Street, Shanghai [J]. Journal of East China Normal University(Natural Science), 2024, 2024(4): 137-149.
[3]	Xuechao LIAN, Wei LIU, Qingshuai WANG, Rong ZHANG. Design and optimization of high-contention transaction processing architecture [J]. Journal of East China Normal University(Natural Science), 2023, 2023(6): 28-38.
[4]	Litao TANG, Zhiyong ZHANG, Jun CHEN, Linna XU, Jiachen ZHONG, Peisen YUAN. Research on Autoformer-based electricity load forecasting and analysis [J]. Journal of East China Normal University(Natural Science), 2023, 2023(5): 135-146.
[5]	Zhenyu WANG, Wei XIE. Time-resolved second-order correlation function of ultrafast evolutionary light field [J]. Journal of East China Normal University(Natural Science), 2023, 2023(4): 119-126.
[6]	Haojie WU, Yanjie WANG, Wenbing CAI, Fei WANG, Yang LIU, Peng PU, Shaohui LIN. Correlation operation based on intermediate layers for knowledge method [J]. Journal of East China Normal University(Natural Science), 2022, 2022(5): 115-125.
[7]	Qichen LIU, Jianghai QIAN, Hanyun CHANG. Fluctuation behavior of the evolution of complex networks [J]. Journal of East China Normal University(Natural Science), 2022, 2022(4): 147-153.
[8]	Cheng ZHOU, Ying HUANG, Hualei YANG, Minghui DU, Ying ZHANG, Jianwu TANG. Photosynthesis and fluorescence characteristics of mangrove Kandelia candel leaves in southern Zhejiang Province [J]. Journal of East China Normal University(Natural Science), 2022, 2022(3): 90-100.
[9]	Yuting HUANGFU, Liying LI, Haizhou WANG, Fuke SHEN, Tongquan WEI. Enabling self-attention based multi-feature anomaly detection and classification of network traffic [J]. Journal of East China Normal University(Natural Science), 2021, 2021(6): 161-173.
[10]	Yaqin HU, Ming TANG. The impact of coupling patterns on transport in multilayer networks [J]. Journal of East China Normal University(Natural Science), 2021, 2021(3): 105-113.
[11]	SHEN Jing, CAI Peng. Lineage-driven distributed database system with an automated fault injection test tool [J]. Journal of East China Normal University(Natural Science), 2020, 2020(4): 98-107.
[12]	ZHU Chao-fan, GUO Jin-wei, CAI Peng. Implementation and optimization of a distributed consistency algorithm based on Paxos [J]. Journal of East China Normal University(Natural Sc, 2019, 2019(5): 168-177.
[13]	LI Yan-li, ZHANG Zong-yong, FENG Jie, LI Zhi-hui. A distributed user-friendly Dubbo interface testing platform [J]. Journal of East China Normal University(Natural Sc, 2019, 2019(4): 120-132,143.
[14]	YU Wen-qian, HU Shuang, HU Hui-qi. The designs and implementations of columnar storage in Cedar [J]. Journal of East China Normal University(Natural Sc, 2018, 2018(5): 67-78.
[15]	HUANG Jian-wei, ZHANG Zhao, QIAN Wei-ning. Primary key management in distributed log-structured database systems [J]. Journal of East China Normal University(Natural Sc, 2018, 2018(5): 79-90,119.