Article

Survey of resource uniform management and scheduling in cluster

  • LI Yong-Feng ,
  • ZHOU Min-Qi ,
  • HU Hua-Liang
Expand
  • 1. Software Engineering Institute, East China Normal University, Shanghai,200062, China;
    2. School of Economics and Management, Zhejiang Sci Tech University, Hangzhou,310018, China

Online published: 2014-11-27

Abstract

With the rapid development of Internet and the coming of big data, resource management system, a thin resource sharing layer that enables sharing cluster across diverse cluster computing frameworks, by giving frameworks a common interface for accessing cluster resources. For powering both large Internet services and a growing number of dataintensive scientific applications, cluster computing framework will continue emerge, and no framework will be optimal for all applications. Therefore, multiplexing a cluster between frameworks makes significant difference. Deploying and running multiple frameworks in the same cluster, improves utilization and allowing applications to share access to large datasets that may be costly to replicate across clusters. This paper is aimed to illustrate current major techniques of resource management and scheduling in cluster, including resource representation model, resource allocation model and scheduling policy. Finally, current prominent solutions, which have been developed and used by many companies, will be demonstrated, and we then summary and contrast these solutions used in recent years.

Cite this article

LI Yong-Feng , ZHOU Min-Qi , HU Hua-Liang . Survey of resource uniform management and scheduling in cluster[J]. Journal of East China Normal University(Natural Science), 2014 , 2014(5) : 17 -30 . DOI: 10.3969/j.issn.10005641.2014.05.002

Outlines

/