华东师范大学学报(自然科学版) ›› 2026, Vol. 2026 ›› Issue (4): 134-142.doi: 10.3969/j.issn.1000-5641.2026.04.014

• • 上一篇    

基于语言相似度的低资源机器翻译迁移学习框架

殷炜, 俞黎阳*()   

  1. 华东师范大学 计算机科学与技术学院, 上海 200062
  • 收稿日期:2024-12-27 出版日期:2026-07-25 发布日期:2026-07-18
  • 通讯作者: 俞黎阳 E-mail:lyyu@cs.ecnu.edu.cn

Transfer learning framework based on linguistic similarity for low-resource neural machine translation

Wei YIN, Liyang YU*()   

  1. School of Computer Science and Technology, East China Normal University, Shanghai 200062, China
  • Received:2024-12-27 Online:2026-07-25 Published:2026-07-18
  • Contact: Liyang YU E-mail:lyyu@cs.ecnu.edu.cn

摘要:

在模型训练资源极其有限的情境下, 基于深度学习的机器翻译模型往往不能达到理想的效果. 现有的利用相似语言进行迁移学习的方法, 都是凭借直觉选择相似数据进行简单的预训练, 可能无法选择出最相似的语言或最大化发挥出预训练的优势. 针对以上问题, 提出了一种基于语言相似度的低资源机器翻译迁移学习框架. 该框架选择了5种低资源语言到英语的翻译任务, 在实验中选择了6种高资源语言用于迁移, 使用模型在这些高资源语言到英语的机器翻译数据集上进行预训练, 然后利用语言相似度指标选择与目标最相似的语言的翻译模型进行迁移, 最终通过改进微调策略进一步提升模型效果. 实验结果表明, 基于该训练框架的模型相较于基线模型有更好的效果, 为低资源机器翻译任务提供了一种可行高效且泛用的解决方向.

关键词: 机器翻译, 迁移学习, 语言相似度, 低资源

Abstract:

In contexts where training resources are extremely limited, neural machine translation models based on deep learning often fail to achieve their desired performance. Current methods in transfer learning that leverage similar languages rely on intuition to select analogous data for rudimentary pre-training and potentially fail to pinpoint the most similar languages or fully exploit the advantages of pre-training. Hence, a framework for low-resource machine translation transfer learning based on linguistic similarity is proposed. This framework selects five low-resource languages translated into English as tasks. Initially, six high-resource languages are chosen, and the model is pre-trained on machine translation datasets from these languages to English. Subsequently, employing linguistic similarity metrics, the translation model that is most similar to the target language pair is selected for transfer, ultimately resulting in enhanced model performance via refined fine-tuning strategies. The experimental findings demonstrate that models trained within this framework exhibit superior performance, compared with baseline models, to thereby offer a viable and versatile approach for low-resource machine translation tasks.

Key words: machine translation, transfer learning, linguistic similarity, low-resource

中图分类号: