面向初等数学的知识点关系提取研究

doi:10.3969/j.issn.1000-5641.2019.05.004

华东师范大学学报(自然科学版) ›› 2019, Vol. 2019 ›› Issue (5): 53-65.doi: 10.3969/j.issn.1000-5641.2019.05.004

• 数据驱动的计算教育学 • 上一篇下一篇

面向初等数学的知识点关系提取研究

杨东明, 杨大为, 顾航, 洪道诚, 高明, 王晔

华东师范大学数据科学与工程学院, 上海 200062

收稿日期:2019-07-29 出版日期:2019-09-25 发布日期:2019-10-11
通讯作者: 王晔,男,研究员,研究方向为Web数据管理、海量数据挖掘、分布式系统等.E-mail:ywang@dase.ecnu.edu.cn. E-mail:ywang@dase.ecnu.edu.cn
作者简介:杨东明,男,硕士研究生,研究方向为面向新硬件的大数据系统.E-mail:y1271752959m2@yahoo.com.
基金资助:
国家重点研发计划（2016YFB1000905）；国家自然科学基金（U1811264，61672234，61502236，61877018，61977025）；上海市科技兴农推广项目（T20170303）

Research on knowledge point relationship extraction for elementary mathematics

YANG Dong-ming, YANG Da-wei, GU Hang, HONG Dao-cheng, GAO Ming, WANG Ye

School of Data Science and Engineering, East China Normal University, Shanghai 200062, China

Received:2019-07-29 Online:2019-09-25 Published:2019-10-11

摘要/Abstract

摘要： 随着互联网技术的发展，在线教育已经改变了学生的学习方式.但由于缺乏完整的知识体系，在线教育存在着智能化程度低和“信息迷航”的问题.因此，构建知识体系成为在线教育平台的核心技术.知识点间的关系提取是知识体系构建的主要任务之一，目前比较高效的关系提取算法主要是监督式的.但是这类方法受限于文本质量低、语料稀缺、标签数据难获取、特征工程效率低、难以提取有向关系等挑战.为此，基于百科语料和远程监督思想，研究了知识点间的关系提取算法.提出了基于关系表示的注意力机制，该方法能够提取知识点间的有向关系信息.结合了GCN和LSTM的优势，提出了GCLSTM，该模型更好地提取了句子中的多点信息.基于Transformer架构和关系表示的注意力机制，提出了适用于有向关系提取的BTRE模型，降低了模型的复杂度.设计并实现了知识点关系提取系统.通过设计3组对比实验，验证了模型的性能和效率.

关键词: 知识体系构建, 关系提取, 注意力机制, 远程监督, Transformer

Abstract: With the development of Internet technology, online education has changed the learning style of students. However, given the lack of a complete knowledge system, online education has a low degree of intelligence and a/knowledge trek0problem. The relation-extraction concept is one of the key elements of knowledge system construction. Therefore, building knowledge systems has become the core technology of online education platforms. At present, the more efficient relationship extraction algorithms are usually supervised. However, such methods suffer from low text quality, scarcity of corpus, difficulty in labeling data, low efficiency of feature engineering, and difficulty in extracting directional relationships. Therefore, this paper studies the relation-extraction algorithm between concepts based on an encyclopedic corpus and distant supervision methods. An attention mechanism based on relational representation is proposed, which can extract the forward relationship information between knowledge points. Combining the advantages of GCN and LSTM, GCLSTM is proposed, which better extracts multipoint information in sentences. Based on the attention mechanism of Transform architecture and relational representation, a BTRE model suitable for the extraction of directional relationships is proposed, which reduces the complexity of the model. Hence, a knowledge point relationship extraction system is designed and implemented. The performance and efficiency of the model are verified by designing three sets of comparative experiments.

Key words: knowledge system construction, relation-extraction, attention mechanism, distant supervisor, Transformer

中图分类号:

TP301.6

杨东明, 杨大为, 顾航, 洪道诚, 高明, 王晔. 面向初等数学的知识点关系提取研究[J]. 华东师范大学学报(自然科学版), 2019, 2019(5): 53-65.

YANG Dong-ming, YANG Da-wei, GU Hang, HONG Dao-cheng, GAO Ming, WANG Ye. Research on knowledge point relationship extraction for elementary mathematics[J]. Journal of East China Normal University(Natural Sc, 2019, 2019(5): 53-65.

参考文献

[1] LIU H, MA W, YANG Y, et al. Learning concept graphs from online educational data[J]. Journal of Artificial Intelligence Research, 2016, 55:1059-1090.
[2] NOVAK J D, BOB GOWIN D, JOHANSEN G T. The use of concept mapping and knowledge vee mapping with junior high school science students[J]. Science education, 1983, 67(5):625-645.
[3] MIWA M, BANSAL M. End-to-End Relation Extraction using LSTMs on Sequencesand Tree Structures[C]//Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1:Long Papers), 2016:1105-1116.
[4] MINTZ M, BILIS S, SNOW R, et al. Distant supervision for relation extraction without labeled data[C]//Proceedings of the Joint Conference of the 47th Annual Meeting of the ACL and the 4th International Joint Conference on Natural Language Processing of the AFNLP:Volume 2, Association for Computational Linguistics, 2009:1003-1011.
[5] ZHOU P, SHI W, TIAN J, et al. Attention-based bidirectional long short-term memory networks for relation classification[C]//Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 2:Short Papers), 2016:207-212.
[6] LIN Y, SHEN S, LIU Z, et al. Neural relation extraction with selective attention over instances[C]//Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1:Long Papers), 2016:2124-2133.
[7] LUONG M T, PHAM H, MANNING C D. Effective approaches to attention-based neural machine translation[C]//Empirical Methods in Natural Language Processing, 2015:1412-1421.
[8] NGUYEN T H, GRISHMAN R. Relation extraction:Perspective from convolutional neural networks[C]//Proceedings of the 1st Workshop on Vector Space Modeling for Natural Language Processing, 2015:39-48.
[9] ZHANG D, WANG D. Relation classification via recurrent neural network[J]. CoRR abs/1508.01006, 2015.
[10] HASHIMOTO K, MIWA M, TSURUOKA Y, et al. Simple customization of recursive neural networks for semantic relation classification[C]//Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing, 2013:1372-1376.
[11] EBRAHIMI J, DOU D. Chain based RNN for relation classification[C]//Proceedings of the 2015 Conference of the North American Chapter of the Association for Computational Linguistics:Human Language Technologies, 2015:1244-1249.
[12] SUNDERMEYER M, SCHLÜTER R, NEY H. LSTM neural networks for language modeling[C]//Thirteenth annual conference of the international speech communication association, 2012.
[13] XU Y, MOU L, LI G, et al. Classifying relations via long short term memory networks along shortest dependency paths[C]//Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing, 2015:1785-1794.
[14] HOCHREITER S, SCHMIDHUBER J. Long short-term memory[J]. Neural computation, 1997, 9(8):1735-1780.
[15] ZENG D, LIU K, LAI S, et al. Relation classification via convolutional deep neural network[C]//25th International Conference on Computational Linguistics, Proceedings of the Conference:Technical Papers, August 23-29, 2014:2335-2344.
[16] DAUPHIN Y N, FAN A, AULI M, et al. Language modeling with gated convolutional networks[C]//Proceedings of the 34th International Conference on Machine Learning-Volume 70, 2017:933-941.
[17] KINCHIN I M, HAY D B, ADAMS A. How a qualitative approach to concept map analysis can be used to aid learning by illustrating patterns of conceptual development[J]. Educational research, 2000, 42(1):43-57.
[18] BAHDANAU D, CHO K, BENGIO Y. Neural machine translation by jointly learning to align and translate[C]//International Conference on Learning Representations, 2015.
[19] ZENG D, LIU K, CHEN Y, et al. Distant supervision for relation extraction via piecewise convolutional neural networks[C]//Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing, 2015:1753-1762.
[20] MNIH V, HEESS N, GRAVES A. Recurrent models of visual attention[C]//Advances in neural information processing systems, 2014:2204-2212.

面向初等数学的知识点关系提取研究

Research on knowledge point relationship extraction for elementary mathematics

RichHTML

PDF

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 15

编辑推荐

Metrics

本文评价

[1]	冯艳丽, 周宇, 黄福兴, 万俊岭, 袁培森. 基于SF-Transformer的智能教育平台短期电力负荷预测研究[J]. 华东师范大学学报（自然科学版）, 2024, 2024(5): 173-182.
[2]	王畅, 马丹, 许华容, 陈攀峰, 陈梅, 李晖. SA-MGKT: 基于自注意力融合的多图知识追踪方法[J]. 华东师范大学学报（自然科学版）, 2024, 2024(5): 20-31.
[3]	冯路平, 施力业, 吴雯, 郑骏, 胡文心, 郑巍. 基于偏好级别陌生人信息辅助的推荐系统[J]. 华东师范大学学报（自然科学版）, 2024, 2024(2): 53-64.
[4]	刘家伟, 林欣. 基于解耦常识性关联的图像描述生成算法[J]. 华东师范大学学报（自然科学版）, 2024, 2024(2): 131-142.
[5]	陈道佳, 陈志云. 分层级描述感知的个性化推荐系统[J]. 华东师范大学学报（自然科学版）, 2023, 2023(6): 73-84.
[6]	姜璐璐, 孙司琦, 邹海东, 陆丽娜, 冯瑞. 基于双视图特征融合的糖尿病视网膜病变分级[J]. 华东师范大学学报（自然科学版）, 2023, 2023(6): 39-48.
[7]	段志尚, 冉懿, 吕笃良, 祁杰, 钟佳晨, 袁培森. 基于残差网络和深度可分离卷积增强自注意力机制的窃电识别[J]. 华东师范大学学报（自然科学版）, 2023, 2023(5): 193-204.
[8]	葛进, 陆雪松. 基于UI图像的Web前端代码自动生成[J]. 华东师范大学学报（自然科学版）, 2023, 2023(5): 100-109.
[9]	武朝阳, 毛嘉莉. 基于神经网络的行驶时长预测[J]. 华东师范大学学报（自然科学版）, 2023, 2023(2): 106-118.
[10]	黄子寅, 吴苑斌. 基于影响函数的远程监督关系抽取[J]. 华东师范大学学报（自然科学版）, 2022, 2022(6): 79-86.
[11]	马依琳, 陶慧玲, 董启文, 王晔. 基于Transformer的多特征融合的航空发动机剩余使用寿命预测[J]. 华东师范大学学报（自然科学版）, 2022, 2022(5): 219-232.
[12]	童根梅, 朱敏. 基于双向长短记忆网络和门控注意力的文本分类网络[J]. 华东师范大学学报（自然科学版）, 2022, 2022(2): 67-75.
[13]	马晓琴, 郭小鹤, 薛峪峰, 杨琳, 陈远哲. 针对命名实体识别的数据增强技术[J]. 华东师范大学学报（自然科学版）, 2021, 2021(5): 14-23.
[14]	梁艳春, 房爱莲. 基于多通道卷积神经网络的中文文本关系抽取[J]. 华东师范大学学报（自然科学版）, 2021, 2021(3): 96-104.
[15]	李小昌, 陈贝, 董启文, 陆雪松. 基于自编码器的旅行同伴挖掘[J]. 华东师范大学学报（自然科学版）, 2020, 2020(5): 179-188.