Journal of East China Normal University(Natural Sc ›› 2018, Vol. 2018 ›› Issue (4): 99-108.doi: 10.3969/j.issn.1000-5641.2018.04.010

Previous Articles     Next Articles

Data calculation and performance optimization of dairy traceability based on Hadoop/Hive

ZHU Shu-xin1, LI Yue1, YUAN Pei-sen1, XU Huan-liang1,2, WANG Kang1, XIE Zhong-hong1   

  1. 1. College of Information Science and Technology, Nanjing Agricultural University, Nanjing 210095, China;
    2. Jiangsu Collaborative Innovation Center of Meat Production and Processing, Quality and Safety Control, Nanjing 210095, China
  • Received:2017-06-19 Online:2018-07-25 Published:2018-07-19

Abstract: In order to enhance the performance of traditional dairy traceability systems for the production data of large-scale enterprise, this paper analyzed the supply chain process of dairy enterprises, key traceability units and traceability information; combining Hadoop/Hive big data technology and distributed database technology, the paper designed and constructed a dairy products traceability framework based on Hadoop/Hive. We built a simulated large-scale data environment and used actual production data to test the system performance. The experimental results showed that after the introduction of the Hadoop/Hive technology system, the average data storage speed, the average data access speed, and the average data exchange rate increased by 87.43%, 27.10% and 58.16%, respectively. The improved traceability system for dairy products is superior to the traditional dairy traceability system in storing and processing large-scale data.

Key words: Hadoop/Hive, dairy products traceability, data calculation, performance optimization

CLC Number: