华东师范大学学报（自然科学版） ›› 2025, Vol. 2025 ›› Issue (5): 151-161.doi: 10.3969/j.issn.1000-5641.2025.05.014

• 开源生态发展与治理 • 上一篇    

开源评价学: 基于评价学理论的开源生态系统评价框架与方法

赵生宇1(), 王伟2,*(), 韩凡宇2, 彭佳恒2, 游兰3   

  1. 1. 同济大学 计算机科学与技术学院, 上海　201804
    2. 华东师范大学 数据科学与工程学院, 上海　200062
    3. 湖北大学 计算机与信息工程学院, 武汉　430062
  • 收稿日期:2025-01-10 出版日期:2025-09-25 发布日期:2025-09-25
  • 通讯作者: 王伟 E-mail:frank_zsy@tongji.edu.cn;wwang@dase.ecnu.edu.cn
  • 作者简介:赵生宇, 男, 博士研究生, 研究方向为复杂网络分析. E-mail: frank_zsy@tongji.edu.cn
  • 基金资助:
    国家自然科学基金 (62137001, 62277017)

Open source evaluatology: A framework and methodology for evaluating open source ecosystems based on evaluatology

Shengyu ZHAO1(), Wei WANG2,*(), Fanyu HAN2, Jiaheng PENG2, Lan YOU3   

  1. 1. Department of Computer Science and Technology, Tongji University, Shanghai　201804, China
    2. School of Data Science and Engineering, East China Normal University, Shanghai　200062, China
    3. School of Computer Science and Information Engineering, Hubei University, Wuhan　430062, China
  • Received:2025-01-10 Online:2025-09-25 Published:2025-09-25
  • Contact: Wei WANG E-mail:frank_zsy@tongji.edu.cn;wwang@dase.ecnu.edu.cn

RichHTML

0

PDF

1

摘要：

开源生态系统作为现代软件产业的重要组成部分, 其评价问题日益受到学术界和产业界的关注. 然而, 当前开源评价方法存在评价标准不统一、评价过程缺乏理论支撑、评价结果可比性差等问题. 以评价学基础理论为指导, 提出了开源评价学这一新的交叉研究领域, 构建了面向开源生态系统的评价理论框架与方法体系. 主要内容: 基于评价学五大公理, 构建了开源评价学的理论体系, 提出了开源生态系统评价的基本概念、评价维度和评价标准; 设计了包含问题定义、任务实例、算法机制、实现实例和支撑系统5个层次的评价条件框架, 并提出了统计度量和网络度量相结合的评价模型; 基于GitHub数据集进行实验验证, 从开源仓库、开发者和社区3个维度对方法进行了有效性验证, 结果表明所提出的评价模型在开源应用中具有较强的适用性与解释力.

关键词: 开源评价学, 评价学, 开源生态系统, 评价框架, 评价方法

Abstract:

The open source ecosystem, as a critical component of the modern software industry, has garnered increasing attention from both academia and industry regarding its evaluation challenges. However, existing evaluation methods face issues such as inconsistent evaluation standards, lack of theoretical grounding, and poor comparability of evaluation results. Guided by foundational theories of evaluatology, this study introduced a novel interdisciplinary research domain, open source evaluatology, for the first time. It established a theoretical framework and methodological system for evaluating the open source ecosystem. The primary contributions of this paper include the following. Developing the theoretical foundation of open source evaluatology based on the five axioms of evaluatology and defining fundamental concepts, evaluation dimensions, and standards for open source ecosystem evaluation. Designing an evaluation conditions framework comprising five levels: problem definition, task instances, algorithm mechanisms, implementation examples, and supporting systems. A hybrid evaluation model combining statistical and network metrics was proposed. Based on the experiments conducted using the GitHub dataset, this study validated the proposed method from three dimensions: open source repositories, developers, and communities. The results demonstrated that the proposed evaluation model exhibited strong applicability and explanatory power in open source scenarios.

Key words: open source evaluatology, evaluatology, open source ecosystem, evaluation framework, evaluation methodology

中图分类号: