Journal of East China Normal University(Natural Sc ›› 2019, Vol. 2019 ›› Issue (5): 74-84.doi: 10.3969/j.issn.1000-5641.2019.05.006

• Computational Intelligence in Emergent Applications • Previous Articles     Next Articles

Transfer learning based QA model of FAQ using CQA data

SHAO Ming-rui, MA Deng-hao, CHEN Yue-guo, QIN Xiong-pai, DU Xiao-yong   

  1. Information college, Renmin University of China, Beijing 100872, China
  • Received:2019-07-27 Online:2019-09-25 Published:2019-10-11

Abstract: Building an intelligent customer service system based on FAQ (frequent asked questions) is a technique commonly used in industry. Question answering systems based on FAQ offer numerous advantages including stability, reliability, and quality. However, given the practical limitations of scaling a manually annotated knowledge base, models often have limited recognition ability and can easily encounter bottlenecks. In order to address the problem of limited scale with FAQ datasets, this paper offers a solution at both the data level and the model level. At the data level, we use Baidu Knows to crawl relevant data and mine semantically equivalent questions, ensuring the relevance and consistency of the data. At the model level, we propose a deep neural network with transAT oriented transfer learning, which combines a transformer network and an attention network, and is suitable for semantic similarity calculations between sentence pairs. Experiments show that the proposed solution can significantly improve the impact of the model on FAQ datasets and to a certain extent resolve the issues with the limited scale of FAQ datasets.

Key words: transfer learning, deep neural network, FAQ (frequent asked questions) question-answering

CLC Number: