Journal of East China Normal University(Natural Sc ›› 2014, Vol. 2014 ›› Issue (5): 17-30.doi: 10.3969/j.issn.10005641.2014.05.002

• Article • Previous Articles     Next Articles

Survey of resource uniform management and scheduling in cluster

 LI  Yong-Feng1, ZHOU  Min-Qi1, HU  Hua-Liang2   

  1. 1. Software Engineering Institute, East China Normal University, Shanghai,200062, China;
    2. School of Economics and Management, Zhejiang Sci Tech University, Hangzhou,310018, China
  • Online:2014-09-25 Published:2014-11-27

Abstract: With the rapid development of Internet and the coming of big data, resource management system, a thin resource sharing layer that enables sharing cluster across diverse cluster computing frameworks, by giving frameworks a common interface for accessing cluster resources. For powering both large Internet services and a growing number of dataintensive scientific applications, cluster computing framework will continue emerge, and no framework will be optimal for all applications. Therefore, multiplexing a cluster between frameworks makes significant difference. Deploying and running multiple frameworks in the same cluster, improves utilization and allowing applications to share access to large datasets that may be costly to replicate across clusters. This paper is aimed to illustrate current major techniques of resource management and scheduling in cluster, including resource representation model, resource allocation model and scheduling policy. Finally, current prominent solutions, which have been developed and used by many companies, will be demonstrated, and we then summary and contrast these solutions used in recent years.

Key words: resource management system, resource sharing, job scheduling

CLC Number: