Evaluation framework EFI for measuring the impact of learning, education and training

Abstract

Abstract: This article introduces the Evaluation Framework EFI for the Impact Measurement of learning, education and training: The Evaluation Framework for Impact Measurement was developed for specifying the evaluation phase and its objectives and tasks within the IDEAL Reference Model for the introduction and optimization of quality development within learning, education and training. First, a description of the Evaluation Framework for Impact Measurement will be provided, followed by a brief overview of the IDEAL Reference Model. Finally, an example for the implementation of the Evaluation Framework for Impact Measurement within the ARISTOTELE project is presented.

Key words: evaluation framework EFI, impact measurement, IDEAL reference model, assessment, quality development, internal evaluation, external evaluation, indicators, strategic objectives, ARISTOTELE

CLC Number:

G436

C. M. STRACKE. Evaluation framework EFI for measuring the impact of learning, education and training[J]. Journal of East China Normal University(Natural Sc, 2014, 2014(2): 167-178.

References

［1］ ARISTOTELE (2012). The ARISTOTELE Evaluation Framework: Evaluation Methodologies and Pilot Trials Definitions (D9.2).

［2］ BERG B L. (1989). Qualitative Research Methods for the Social Sciences. Allyn and Bacon, Boston.

［3］ CHERMACK T J, KASSHANNA B K. The Use and Misuse of SWOT Analysis and Implications for HRD Professionals. In: Human Resource Development International 2007, 10(4): 383-399.

［4］ CHESBROUGH H W, WEST J, VANHAVERBEKE W. (2006). Open Innovation: Researching a New Paradigm. Oxford: Oxford University Press.

［5］ CROSBY P B. (1980). Quality is Free. The art of making quality certain. New York: McGraw-Hill.

［6］ DEMING W E. (1986). Out of the Crisis. Cambridge, MA: MIT.

［7］ DEMING W E. (1982). Quality, productivity and competitive position. Cambridge, MA: MIT.

［8］ DONABEDIAN A. (1980). The Definition of Quality and Approaches to Its Assessment ［= Explorations in Quality Assessment and Monitoring, vol. 1］. Ann Arbor: Health Administration Press, 1980.

［9］ DRUCKER P F. (1999). Management Challenges of the 21st Century. Harper Business, New York.

［10］ FEIGENBAUM A. (1986). Total Quality Control. Engineering and management. New York: McGraw-Hill.

［11］ GASSMANN O, ENKEL E, CHESBROUGH H W. The future of open innovation. R&D Management, 2010, 40(3): 213-221.

［12］ ISHIKAWA K. (1985). What is Total Quality Control? The Japanese Way. Englewood Cliffs, NJ: Prentice-Hall.

［13］ ISO 9000:2005 (2005). Quality Management Systems. Fundamentals and Vocabulary. Geneva: International Organisation of Standardization (ISO).

［14］ ISO 9001:2008 (2008). Quality Management Systems. Requirements. Geneva: International Organisation of Standardization (ISO).

［15］ ISO/IEC 19796-1:2005 (2005). Information Technology-Learning, Education, and Training—Quality Management, Assurance and Metrics—Part 1: General Approach. Geneva: International Organisation for Standardization (ISO).

［16］ JURAN J M. (1992). Juran on quality by design. The new steps for planning quality into goods and services. New York: Free Press.

［17］ JURAN J M. (Ed.) (1951). Quality Control Handbook. New York: McGraw-Hill. Patton, M. Q. (2002). Quantitative evaluation and research methods. Newbury Park: Sage Publications.

［18］ SINGH K. (2007). Quantitative Social research methods. New Delhi: Sage Publication.

［19］ SOIN S S. (1992). Total Quality Essentials. New York: McGraw-Hill.

［20］ STRACKE C M. (2013). “Open Learning: The Concept for Modernizing School Education and Lifelong Learning through the Combination of Learning Innovations and Quality”; in: Stracke, Christian M. (Ed.): Learning Innovations and Quality: The Future of Digital Resources, Berlin: Logos. p. 15-28.

［21］ STRACKE C M. (2012). “Learning Innovations and Learning Quality: Relations, Interdependences, and Future”; in: Stracke, Christian M. (Ed.): The Future of Learning Innovations and Learning Quality. How do they fit together?, Berlin: Gito. p. 13-25.

［22］ STRACKE C M. (2010a). “Quality development and standards in learning, education, and training: adaptation model and guidelines for implementations”; in: Информатизация образования и науки ［=Информике (Informika), ISSN 2073-7572］; Vol. 7 (3), 2010. Moscow (Russian Federation): Informika. p. 136-146.

［23］ STRACKE C M. (2010b). “Quality and Standards in Learning, Education, and Training: The Adaptation Model IDEA for the Introduction of Quality Development”; in: Proceedings of the International Conference on the Past and Future of e-Learning Standards. Tokyo (Japan). p. 26-36.

［24］ STRACKE C M. (2009). “Quality Development and Standards in e-Learning: Benefits and Guidelines for Implementations”; in: Proceedings of the ASEM Lifelong Learning Conference: e-Learning and Workplace Learning. Bangkok (Thailand) ［online available at: http://www.qualitydevelopment.eu/docs］.

［25］ STRACKE C M. (2006a). Process-oriented Quality Management. In Pawlowski J. & Ehlers, U. (Eds.) European Handbook on Quality and Standardisation in E-Learning. Berlin: Springer, 79-96.

［26］ STRACKE C M. (2006b). Interoperability and Quality Development in e-Learning. In Proceedings of the Asia-Europe e-Learning Colloquy. Seoul: e-ASEM ［online available at: http://www.qualitydevelopment.eu/docs］.

［27］ THOMPSON J L, MARTIN F. (2005). Strategic management: Awareness and change. London: Thomson learning.

[1]	XIE Yihan, LI Gen, YANG Mengjie, CHU Xiaoye. Health assessment of transboundary rivers based on the PSR and matter-element extension models: A case study of Taipu River [J]. Journal of East China Normal University(Natural Science), 2020, 2020(1): 110-122.
[2]	XIAO Bing, YANG Yin-chuan, LU Xin-yu, LI Xin-ran, HUANG Min-sheng, YIN Chao, HE Yan. Fuzzy comprehensive assessment of landscape water eco-compositive purifying process in Mengqing Garden [J]. Journal of East China Normal University(Natural Sc, 2019, 2019(4): 144-155.
[3]	HAN Yu-jie, SUN Wen, ZHANG Wen-wen. Evaluation of ecosystem services for urban forests in Shanghai based on a distribution measurement methodology [J]. Journal of East China Normal University(Natural Sc, 2019, 2019(2): 147-155.
[4]	CHEN Jie, SONG Cheng-Cheng, LI Meng-Ya, WANG Jun-. Potential hazard assessment of typhoon storm surge based on scenario simulation methodology in Yuhuan County, Zhejiang Province [J]. Journal of East China Normal University(Natural Sc, 2016, 2016(3): 125-135.
[5]	CAO Min, WU E-nuo, CHE Yue, CHEN Ting. Application of RBPs for the Habitat Assessment of Suzhou Creek [J]. Journal of East China Normal University(Natural Sc, 2012, 2012(4): 1-8.
[6]	CAO Min, WU E-nuo, CHE Yue, CHEN Ting. Application of RBPs for the habitat assessment of Suzhou Creek [J]. Journal of East China Normal University(Natural Sc, 2012, 2012(3): 130-137.
[7]	NIU Hai-yan, LIU Min, LU Min, QUAN Rui-song, ZHANG Li-jia,WANG Jing-jing, XU Shi-yuan. Risk assessment of typhoon hazard factors in China coastal areas [J]. Journal of East China Normal University(Natural Sc, 2011, 2011(6): 20-25,35.
[8]	ZHENG Wen-fa;CAI Yong-li;ZHOU Zhao-ying. Ecological suitability assessment of land for urban residential areas and optimum strategy: A case study ofFengxian District, Shanghai [J]. Journal of East China Normal University(Natural Sc, 2011, 2011(2): 108-118.
[9]	CHEN Liang;LIU Yi;YU Na;FENG Deng-xiang;LI Er-chao;JIA Yong-yi;CHEN Li-qiao. Preliminary study on the metazoan zooplankton community structure of Fenshuijiang Reservoir and water quality assessment [J]. Journal of East China Normal University(Natural Sc, 2010, 2010(6): 72-82.
[10]	LI Yan-yan;SHANG Kan-kan;DA Liang-jun;;WANG Juan;QI Yu-feng. Diversity, spatial pattern and dynamics of vegetation underurbanization in Shanghai (Ⅳ): Landscape-ecology effect harmony assessment of artificial plant communities (Chinese) [J]. Journal of East China Normal University(Natural Sc, 2009, 2009(6): 1-11.
[11]	QIN Yong-liang;YUAN Wen. Environmental flow calculation and assessmentin plain river network areas (Chinese) [J]. Journal of East China Normal University(Natural Sc, 2009, 2009(6): 71-78.
[12]	JI Xia-wei;CAI Yong-li;ZUO Jun-jie;LUO Kun. Assessment and restoration schemes of ecology and landscape ofquarries on Jiulong Mountain in Shandong province (Chinese) [J]. Journal of East China Normal University(Natural Sc, 2009, 2009(6): 79-88.
[13]	ZHANG Hongwei;;WU Jian;;CHE Yue;LI Wei;TONG Chunfu. Environmental impact assessment of Qingcaosha Reservoirconstruction project in the Yangtze Estuary [J]. Journal of East China Normal University(Natural Sc, 2009, 2009(3): 38-47.
[14]	JIANG Xue-qin;YU Na;MAO Kai-yun;LIU Yi;LI Er-chao;CHEN Li-qiao . Assessment of algal diversity and water quality in the foururban rivers of Shanghai in winter （Chinese） [J]. Journal of East China Normal University(Natural Sc, 2009, 2009(2): 78-87.
[15]	CHEN Li-qiao;LI Yun-kai;HOU Jun-li;LI Kai;CHEN Yong. A Survey of Managements of Non-indigenous Species via Ballast Water Transport(Chinese) [J]. Journal of East China Normal University(Natural Sc, 2005, 2005(5/6): 40-48.