基于自注意力机制的冗长商品名称精简方法

doi:10.3969/j.issn.1000-5641.2019.05.009

华东师范大学学报(自然科学版) ›› 2019, Vol. 2019 ›› Issue (5): 113-122,167.doi: 10.3969/j.issn.1000-5641.2019.05.009

• 新兴应用中的计算机智能 • 上一篇下一篇

基于自注意力机制的冗长商品名称精简方法

傅裕, 李优, 林煜明, 周娅

桂林电子科技大学广西可信软件重点实验室, 广西桂林 541004

收稿日期:2019-07-28 出版日期:2019-09-25 发布日期:2019-10-11
通讯作者: 李优,女,副教授,硕士生导师,研究方向为Web数据分析、观点挖掘.E-mail:liyou@guet.edu.cn. E-mail:liyou@guet.edu.cn
作者简介:傅裕,男,硕士研究生,研究方向为海量数据管理.E-mail:fuzzyu@foxmail.com.
基金资助:
国家自然科学基金（61562014，U1501252，U1811264）；广西自然科学基金重点项目（2018GXNSFDA281049）；桂林电子科技大学研究生优秀论文培养项目（17YJPYSS17）；广西可信软件重点实验室研究课题（kx201916）

Self-attention based neural networks for product titles compression

FU Yu, LI You, LIN Yu-ming, ZHOU Ya

Guangxi Key Laboratory of Trusted Software, Guilin University of Electronic Technology, Guilin Guangxi 541004, China

Received:2019-07-28 Online:2019-09-25 Published:2019-10-11

摘要/Abstract

摘要： 大部分电子商务网站为了吸引用户的关注，通常将商品的很多属性也纳入到商品名称中，使得商品名称中包括了冗余的信息，并产生不一致性.为解决这一的问题，提出了一个基于自注意力机制的商品名称精简模型，并针对自注意力机制网络无法直接捕捉商品名称序列特征的问题，利用门控循环单元的时序特性对自注意力机制进行了时序增强，以较小的计算代价换取了商品命名精简任务整体性能的提升.在公开商品短标题数据集LESD4EC的基础上，构造了商品名称精简数据集LESD4EC_L和LESD4EC_S，并进行了模型验证.一系列的实验结果表明本，所提出的自注意力机制冗长商品名称精简方法相对于其他商品名称精简方法在效果上有较大的提升.

关键词: 自注意力机制, 商品名称精简, 门控循环单元

Abstract: E-commerce product title compression has received significant attention in recent years, since it can facilitate more specific information for cross-platform knowledge alignment and multi-source data fusion. Product titles usually contain redundant descriptions, which can lead to inconsistencies. In this paper, we propose self-attention based neural networks for this task. Given the fact that self-attention mechanism networks cannot directly capture sequence features of product names, we enhance the mapping networks with a dot-attention structure, which was computed for the query and key-value pairs by a gated recurrent unit (GRU) based recurrent neural network. The proposed method improves the analytical capability of the model at a lower relative computational cost. Based on data from LESD4EC, we built two E-commerce datasets of product core phrases named LESD4EC L and LESD4EC S; we subsequently tested the model on these two datasets. A series of experiments show that the proposed model achieves better performance in product title compression than existing techniques.

Key words: self-attention mechanism, product titles compression, gated recurrent units

中图分类号:

TP391

傅裕, 李优, 林煜明, 周娅. 基于自注意力机制的冗长商品名称精简方法[J]. 华东师范大学学报(自然科学版), 2019, 2019(5): 113-122,167.

FU Yu, LI You, LIN Yu-ming, ZHOU Ya. Self-attention based neural networks for product titles compression[J]. Journal of East China Normal University(Natural Sc, 2019, 2019(5): 113-122,167.

参考文献

[1] VASWANI A, SHAZEER N, PARMAR N, et al. Attention is all you need[C]//Advances in neural information processing systems. 2017:5998-6008.
[2] GONG Y, LUO X S, ZHU K Q, et al. Automatic generation of chinese short product titles for mobile display[J]. arXiv preprint arXiv:1803.11359, 2018.
[3] LIU Z Y, HUANG W Y, ZHENG Y B, et al. Automatic keyphrase extraction via topic decomposition[C]//Proceedings of the 2010 conference on empirical methods in natural language processing. Association for Computational Linguistics, 2010:366-376.
[4] ROSE S, ENGEL D, CRAMER N, et al. Automatic keyword extraction from individual documents[M]//Text mining:Applications and theory. Hoboken:A John Wiley and Sons, Ltd., 2010:1-20.
[5] MIHALCEA R, TARAU P. Textrank:Bringing order into text[C]//Proceedings of the 2004 conference on empirical methods in natural language processing. 2004.
[6] ZHAO W X, JIANG J, HE J, et al. Topical keyphrase extraction from Twitter[C]//Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics. Association for Computational Linguistics, 2011:379-388.
[7] HOCHREITER S, SCHMIDHUBER J. Long short-term memory[J]. Neural Computation, 1997, 9(8):1735-1780.
[8] CHO K, VAN MERRIENBOER B, GULCEHRE C, et al. Learning phrase representations using RNN encoder-decoder for statistical machine translation[C]//Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP). 2014:1724-1734.
[9] BAHDANAU D, CHO K, BENGIO Y. Neural machine translation by jointly learning to align and translate[J]. arXiv preprint arXiv:1409.0473, 2014.
[10] LUONG T, PHAM H, MANNING C D. Effective approaches to attention-based neural machine translation[C]//Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing. 2015:1412-1421.
[11] SUTSKEVER I, VINYALS O, LE Q V. Sequence to sequence learning with neural networks[C]//Advances in Neural Information Processing Systems. 2014:3104-3112.
[12] NALLAPATI R, ZHOU B W, DOS SANTOS C, et al. Abstractive text summarization using sequence-to-sequence RNNs and beyond[C]//Proceedings of The 20th SIGNLL Conference on Computational Natural Language Learning. 2016:280-290.
[13] NALLAPATI R, ZHAI F F, ZHOU B W. Summarunner:A recurrent neural network based sequence model for extractive summarization of documents[C]//Proceedings of the 31st AAAI Conference on Artificial Intelligence (AAAI-17). 2017:3075-3081.
[14] SEE A, LIU P J, MANNING C D. Get to the point:Summarization with pointer-generator networks[C]//Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1:Long Papers). 2017:1073-1083.
[15] VINYALS O, FORTUNATO M, JAITLY N. Pointer networks[C]//Advances in Neural Information Processing Systems 28(NIPS 2015). 2015:2692-2700.
[16] GOODFELLOW I, POUGET-ABADIE J, MIRZA M, et al. Generative adversarial nets[C]//Advances in Neural Information Processing Systems 27(NIPS 2014). 2014:2672-2680.
[17] ZHANG J, ZOU P, LI Z, et al. Multi-modal generative adversarial network for short product title generation in mobile e-commerce[C]//Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics:Human Language Technologies, Volume 2(Industry Papers). 2019:64-72.
[18] WANG J G, TIAN J F, QIU L, et al. A multi-task learning approach for improving product title compression with user search log data[C]//32nd AAAI Conference on Artificial Intelligence. 2018:451-458.
[19] KINGMA D P, BA J. Adam:A method for stochastic optimization[J]. arXiv preprint arXiv:1412.6980, 2014.
[20] LIN C Y, HOVY E. Automatic evaluation of summaries using n-gram co-occurrence statistics[C]//Proceedings of the 2003 Human Language Technology Conference of the North American Chapter of the Association for Computational Linguistics. 2003:150-157.

基于自注意力机制的冗长商品名称精简方法

Self-attention based neural networks for product titles compression

RichHTML

PDF

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 4

编辑推荐

Metrics

本文评价

[1]	王畅, 马丹, 许华容, 陈攀峰, 陈梅, 李晖. SA-MGKT: 基于自注意力融合的多图知识追踪方法[J]. 华东师范大学学报（自然科学版）, 2024, 2024(5): 20-31.
[2]	段志尚, 冉懿, 吕笃良, 祁杰, 钟佳晨, 袁培森. 基于残差网络和深度可分离卷积增强自注意力机制的窃电识别[J]. 华东师范大学学报（自然科学版）, 2023, 2023(5): 193-204.
[3]	黄彩蝶, 王昕萍, 陈良育, 刘勇. 基于堆叠门控循环单元残差网络的知识追踪模型研究[J]. 华东师范大学学报（自然科学版）, 2022, 2022(6): 68-78.
[4]	陈良健, 许建秋. 基于门控循环单元模型的在线路网匹配算法[J]. 华东师范大学学报（自然科学版）, 2020, 2020(6): 63-71.