华东师范大学学报（自然科学版） >

2024 , Vol. 2024 >Issue 5: 11 - 19

DOI: https://doi.org/10.3969/j.issn.1000-5641.2024.05.002

学习评价与推荐

OpenRank贡献度评估方法及其在开源课程中的实证研究

  • 王婕 ,
  • 黄温瑞 ,
  • 赵生宇 ,
  • 夏小雅 ,
  • 韩凡宇 ,
  • 王伟 ,
  • 张琰彬
展开
  • 1. 华东师范大学 数据科学与工程学院, 上海　200062
    2. 同济大学 电子与信息工程学院, 上海　201804

收稿日期: 2024-07-08

  网络出版日期: 2024-09-23

基金资助

国家自然科学基金 (62137001, 62277017)

收起

OpenRank contribution evaluation method and empirical study in open-source course

  • Jie WANG ,
  • Wenrui HUANG ,
  • Shengyu ZHAO ,
  • Xiaoya XIA ,
  • Fanyu HAN ,
  • Wei WANG ,
  • Yanbin ZHANG
Expand
  • 1. School of Data Science and Engineering, East China Normal University, Shanghai　200062, China
    2. School of Electronic and Information Engineering, Tongji University, Shanghai　201804, China

Received date: 2024-07-08

  Online published: 2024-09-23

Fold

摘要

提出了一种基于OpenRank的开源贡献度评价方法, 旨在解决开源项目实践中学生的贡献度量化评估问题. 以 “开源软件设计与开发”课程中的软件开发实践教学为背景, 设计了开源实践教学模式中学生的贡献度评价方法, 提出了一种基于开发者协作网络的OpenRank算法, 以评估学生在项目讨论、问题解决、代码编写等方面的贡献和价值. 实验结果表明, OpenRank与传统评分方法在评价学生表现方面具有一致性, 更能全面展示学生在开源项目中各个方面的贡献. 因此, OpenRank与传统评分方法的结合, 能更加科学、全面地评价学生在开源项目中的贡献度与综合技能.

关键词： 开源协作; 开源贡献度; 贡献度评价; 实证研究

本文引用格式

王婕 , 黄温瑞 , 赵生宇 , 夏小雅 , 韩凡宇 , 王伟 , 张琰彬 . OpenRank贡献度评估方法及其在开源课程中的实证研究[J]. 华东师范大学学报（自然科学版）, 2024 , 2024(5) : 11 -19 . DOI: 10.3969/j.issn.1000-5641.2024.05.002

Abstract

This study presents an OpenRank-based method for evaluating open-source contributions, designed to address the challenge of quantifying student contributions in open-source projects. Taking the “Open-Source Software Design and Development” course as a case study, we developed a method to assess student contributions in open-source practice. The OpenRank algorithm, which is based on developer collaboration networks, evaluates student contributions in discussions, problem-solving, and coding. Experimental results indicate that OpenRank not only aligns with traditional grading methods but also provides a more comprehensive view of student contributions. Combining OpenRank with traditional grading offers a more scientific and thorough evaluation of student contributions and skills in open-source projects.

Key words： open-source collaboration; open-source contribution; contribution evaluation; empirical research

参考文献

1 ELLIS H J C, HISLOP G W, JACKSON S, et al.. Team project experiences in humanitarian free and open source software (HFOSS). ACM Transactions on Computing Education, 2015, 15 (4): 18.
2 朝乐门.. 开源课程及数据科学导论的开源. 计算机科学, 2020, 47 (12): 114- 118..
3 荆琦, 冯惠.. 产教融合下的双轨制开源教学模式探索——以北京大学“开源软件开发基础及实践”课程为例. 高等工程教育研究, 2023, 41 (1): 14- 19..
4 黄启春.. 基于特色项目制与开源人才培养的软件工程专业学位研究生创新能力培养实践. 中国信息界, 2024, 22 (2): 25- 27..
5 KAN S H. Metrics and Models in Software Quality Engineering [M]. Boston: Addison-Wesley Professional, 2003.
6 WALSTON C E, FELIX C P.. A method of programming measurement and estimation. IBM Systems Journal, 1977, 16 (1): 54- 73..
7 GOUSIOS G, KALLIAMVAKOU E, SPINELLIS D. Measuring developer contribution from software repository data [C]// Proceedings of the 2008 International Working Conference on Mining Software Repositories. 2008: 129-132.
8 XIA X, WENG Z, WANG W, et al. Exploring activity and contributors on GitHub: Who, what, when, and where [C]// Proceedings of the 2022 29th Asia-Pacific Software Engineering Conference. 2022: 11-20.
9 PINTO G, FERREIRA C, SOUZA C, et al. Training software engineers using open-source software: The students’ perspective [C]// 2019 IEEE/ACM 41st International Conference on Software Engineering: Software Engineering Education and Training. 2019: 147-157.
10 SILVA J, WIESE I, GERMAN D M, et al. A theory of the engagement in open source projects via summer of code programs [C]// Proceedings of the 28th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering. 2020: 421-431.
11 HU Z, SONG Y, GEHRINGER E F. Open-source software in class: Students’ common mistakes [C]// Proceedings of the 40th International Conference on Software Engineering: Software Engineering Education and Training. 2018: 40-48.
12 HOLMES R, ALLEN M, CRAIG M. Dimensions of experientialism for software engineering education [C]// Proceedings of the 40th International Conference on Software Engineering: Software Engineering Education and Training. 2018: 31-39.
13 DEKOENIGSBERG G. How successful open source projects work, and how and why to introduce students to the open source world [C]// Proceedings of the 2008 21st Conference on Software Engineering Education and Training. 2008: 274-276.
14 TSAY J, DABBISH L, HERBSLEB J. Influence of social and technical factors for evaluating contribution in GitHub [C]// Proceedings of the 36th International Conference on Software Engineering. 2014: 356-366.
15 JOBLIN M, APEL S, HUMSEN C, et al. Classifying developers into core and peripheral: An empirical study on count and network metrics [C]// Proceedings of the 2017 IEEE/ACM 39th International Conference on Software Engineering. 2017: 164-174.
16 CHENG J, GUO J L C. Activity-based analysis of open source software contributors: Roles and dynamics [C]// Proceedings of the 2019 IEEE/ACM 12th International Workshop on Cooperative and Human Aspects of Software Engineering. 2019: 11-18.
17 PAGE L, BRIN S, MOTWANI R, et al. The PageRank citation ranking: Bring order to the web [C]// Proceedings of the 7th International World Wide Web Conference. 1998: 1-17.
18 LI J, WILLETT P.. ArticleRank: A PageRank-based alternative to numbers of citations for analysing citation networks. Aslib Proceedings, 2009, 61 (6): 605- 618.
19 LI Y, LI C, CHEN W. Research on influence ranking of Chinese movie heterogeneous network based on PageRank algorithm [C]// Proceedings of the Web Information Systems and Applications: 15th International Conference. 2018: 344-356.
Options
文章导航

/

〈 〉