Journal of East China Normal University(Natural Sc ›› 2018, Vol. 2018 ›› Issue (5): 30-40,78.doi: 10.3969/j.issn.1000-5641.2018.05.003

Previous Articles     Next Articles

Data processing software technology for new hardware

TU Yun-shan, CHU Jia-jia, ZHANG Yao, WENG Chu-liang   

  1. School of Data Science and Engineering, East China Normal University, Shanghai 200062, China
  • Received:2018-07-04 Online:2018-09-25 Published:2018-09-26

Abstract: The rapid development of computer hardware in recent years has brought profound technological progress. New hardware for high-performance and low-latency applications (e.g., heterogeneous processors, programmable high-speed NICs/switches, and volatile/non-volatile memory) have been emerging, which bring both new opportunities and challenges to traditional computer architectures and systems. In the case of big data processing, it is difficult to adapt traditional software technology directly onto new hardware, this makes realizing the full potential brought by breakthroughs in hardware technology challenging. Hence, a rethink of traditional software technology can help unlock the benefits brought by advancements in hardware technology. This paper reviews:data processing technology for new hardware from the perspective of computing, transmission, and storage; an analysis of related work in the field; a summary of progress made to date; and new problems and challenges that exist. The study also provides a valuable reference point for future research on exploring the performance ceiling of systems for data processing.

Key words: new hardware, data processing, software stack

CLC Number: