华东师范大学学报(自然科学版) ›› 2014, Vol. 2014 ›› Issue (5): 1-16.doi: 10.3969/j.issn.10005641.2014.05.001

• 计算机科学与技术 •    下一篇

NoSQL系统的容错机制:原理与系统示例

孔超,钱卫宁,周傲英   

  1. 华东师范大学,数据科学与工程研究院,上海,200062
  • 出版日期:2014-09-25 发布日期:2014-11-27
  • 通讯作者: 周傲英,男,博士生导师,研究方向为数据管理与信息系统. E-mail:ayzhou@sei.ecnu.edu.cn
  • 基金资助:

    国家973课题(2010CB731402);国家自然科学基金(61170086)

Fault tolerance in NoSQL systems: Principles and system analysis

KONG Chao,QIAN Wei-Ning,ZHOU Ao-Ying   

  1. Institute for Data Science and Engineering, East China Normal University, Shanghai,200062, China
  • Online:2014-09-25 Published:2014-11-27

摘要: NoSQL数据管理系统因其具有良好的可扩展性和容错性,在以Web数据管理和分析处理为代表的新型大数据应用环境中得到了广泛使用.这些系统通过新型一致性模型和数据冗余等技术,实现了集群环境中的容错处理.本文在对集群环境数据管理系统的一致性保持和容错处理基本原理进行介绍的基础上,对Bigtable、HBase、Dynamo、Cassandra,以及PNUTS五个典型的NoSQL系统的容错机制及其实现进行分析与对比,并讨论它们的设计原则和实现技术对于系统的可用性、性能、复杂负载的处理能力等方面的影响.最后,讨论现有NoSQL系统容错机制对于设计和实现支持关键任务的内存数据管理系统的借鉴意义.

关键词: NoSQL系统, 容错, 一致性保持

Abstract: NoSQL data management systems have been widely used in Web data management and processing applications, for their high scalabilities and fault tolerence. The fault tolerence is achieved by using new consistency models and data replications in clustered systems. In this paper, the mechanism and implementation details of five representative NoSQL systems, i.e. Bigtable, HBase, Dynamo, Cassandra, and PNUSTS, were discussed and analyzed, after a general introduction to the principles of consistency preserving and fault tolerent processing. Furthermore, the impact of these technologies on system availability, performance and workload balance, was analyzed. Finally, their influence on the design of inmemory database management systems was discussed.

Key words: NoSQL systems, fault tolerance, consistency preserve

中图分类号: