Research on Data-Driven Quantitative Evaluation Model of Higher Education Teaching Effectiveness
Main Article Content
Abstract
Current evaluation of teaching effectiveness in higher education often relies on final grades or subjective student evaluations, which cannot adequately reflect dynamic learning behaviors or provide interpretable quantitative evidence. To address this problem, this paper proposes a data-driven quantitative evaluation model for higher education teaching effectiveness. First, four types of heterogeneous data from academic affairs systems, online learning platforms, classroom interaction tools, and assignment submission systems are fused to construct derived features such as learning engagement, knowledge mastery slope, assignment timeliness, and class participation activity. Second, a hierarchical prediction model is built using a weighted fusion strategy combining XGBoost and LightGBM. Third, the SHAP method is introduced to rank feature contributions and provide individual-level interpretability. The model is evaluated through five-fold cross-validation, feature ablation, and cross-course rotation testing. Experimental results show that the proposed ensemble model achieves 91.6% accuracy, with process-behavior features contributing substantially to prediction performance. The average cross-course accuracy reaches 86.7%, indicating good transferability. The study provides an interpretable technical framework for quantitative teaching-effectiveness evaluation.
Downloads
Article Details

This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors who publish with this journal agree to the following terms:
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).
References
A. Perkash, Q. Shaheen, R. Saleem, et al., “Feature optimization and machine learning for predicting students’ academic performance in higher education institutions, ” Education and Information Technologies, vol. 29, no. 16, pp. 21169-21193, 2024, doi: 10.1007/s10639-024-12698-9.
K. Liu, J. Yao, D. Tao, et al., “Influence of individual-technology-task-environment fit on university student online learning performance: The mediating role of behavioral, emotional, and cognitive engagement, ” Education and Information Technologies, vol. 28, no. 12, pp. 15949-15968, 2023, doi: 10.1007/s10639-023-11833-2.
Y. Li, Q. Jiang, W. Xiong, et al., “Investigating behavior patterns of students during online self-directed learning through process mining, ” Education and Information Technologies, vol. 28, no. 12, pp. 15765-15787, 2023, doi: 10.1007/s10639-023-11830-5.
Y. Wu, “Data driven pedagogy in physical education a new paradigm in teaching effectiveness, ” Scientific Reports, pp. 15(1), 2025, doi: 10.1038/s41598-025-27746-8.
Feng X.Neutrosophic-Plithogenic Quantum State Modeling for Big Data and Artificial Intelligence-Driven Teaching Effectiveness in Higher Education, “Neutrosophic Sets & Systems, ” 2025; 91.
A. Nammakhunt, P. Porouhan, and W. Premchaiswadi, “Creating and collecting e-learning event logs to analyze learning behavior of students through process mining, ” International Journal of Information and Education Technology, vol. 13, no. 2, pp. 211-222, 2023, doi: 10.18178/ijiet.2023.13.2.1798.
X. Wang, “Enhancing English teaching effectiveness in vocational colleges: a data-driven approach using machine learning and adaptive learning models[J].International Journal of Information and Communication Technology, ” vol. 26, no. 24, pp. 1-14, 2025, doi: 10.1504/IJICT.2025.147133.
A. Omariba, “Enhancing Student Outcomes through AI-Driven Personalized Learning: A Study on Implementation and Effectiveness at the Universities in Kenya, ” East African Journal of Education Studies, pp. 8(2), 2025, doi: 10.37284/eajes.8.2.3048.
J. Lukose and A. Agbeyangi, “Effectiveness of digital learning tools in upper secondary education: A data-driven sentiment analysis approach, ” International Journal of Innovative Research & Scientific Studies, pp. 8(6), 2025, doi: 10.53894/ijirss.v8i6.9511.
M. Afzaal, A. Zia, J. Nouri, et al., “Informative feedback and explainable AI-based recommendations to support students’ self-regulation, ” Technology, Knowledge and Learning, vol. 29, no. 1, pp. 331-354, 2024, doi: 10.1007/s10758-023-09650-0.
D. Hooshyar and Y. Yang, “Problems with SHAP and LIME in interpretable AI for education: A comparative study of posthoc explanations and neural-symbolic rule extraction, ” IEEE Access, vol. 12, no. 12, pp. 137472-137490, 2024, doi: 10.1109/ACCESS.2024.3463948.