Collaborative Recommendation of Innovation, Entrepreneurship, and Professional Courses Using a Multimodal ViT Transformer Fusion Model
Main Article Content
Abstract
In the context of the deep integration of innovation and entrepreneurship education with professional education, existing course recommendation systems still suffer from single data sources, insufficient feature mining, and weak collaboration among heterogeneous courses. These limitations hinder the effective alignment between curriculum resources and students’ comprehensive development needs. To address these issues, this paper proposes a collaborative recommendation method based on a multimodal ViT–Transformer fusion model. A multimodal dataset integrating structured course and academic data, unstructured textual information, and visual teaching resources is first constructed. Visual features are extracted using the ViT model, textual semantic features are mined through Transformer encoders, and structured data are processed by embedding layers to achieve deep representation of multidimensional features. An attention-based feature interaction module is further designed to strengthen the correlation mining between innovation and entrepreneurship courses and professional courses, thereby improving collaborative matching across course types. Experiments based on real teaching scenarios verify the effectiveness of the proposed model in recommendation accuracy, recall, F1-score, and synergy indicators. The method also provides a useful reference for multimodal information fusion and heterogeneous information propagation in intelligent engineering education systems.
Downloads
Article Details
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors who publish with this journal agree to the following terms:
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).
References
Ministry of Education, “Implementation Opinions on Deepening the Reform of Innovation and Entrepreneurship Education in Higher Education Institutions,” 2015.
M. Zhang and C. Wang, “The Logic, Path, and Guarantee of the Integration of Innovation and Entrepreneurship Education and Professional Education,” Higher Education Research, vol. 41, no. 3, pp. 70–76, 2020.
J. Li and M. Liu, “The current situation and optimization path of college course recommendation system,” China Electronic Education, no. 5, pp. 108–114, 2021.
N. Wang and M. Li, “Research on Course Recommendation Model Based on Multimodal Data,” Computer Engineering and Applications, vol. 58, no. 12, pp. 231–238, 2022.
W. Zhang and L. Wang, “A review of the application research of deep learning in course recommendation systems,” Pattern Recognition and Artificial Intelligence, vol. 34, no. 8, pp. 721–730, 2021.
C. Liu and Q. Chen, “Design of Collaborative Recommendation System for Innovation and Entrepreneurship and Professional Courses,” Education and Career, no. 12, pp. 86–91, 2020.
A. Dosovitskiy, L. Beyer, A. Kolesnikov, et al., “An image is worth 16x16 words: Transformers for image recognition at scale,” Proceedings of the International Conference on Learning Representations, 2021.
A. Vaswani, N. Shazeer, N. Parmar, et al., “Attention is all you need,” Proceedings of the 31st International Conference on Neural Information Processing Systems, pp. 5998–6008, 2017.
M. Li and Y. Wang, “University course recommendation algorithm based on user collaborative filtering,” Computer Application Research, vol. 36, no. 7, pp. 2065–2068, 2019.
H. Zhang and Q. Liu, “Research on Course Association Recommendation Based on Collaborative Filtering of Items,” Computer Engineering and Science, vol. 42, no. 3, pp. 532–537, 2020.
L. Wang and X. Chen, “Personalized Course Recommendation Model Based on Content Features,” Research on Electronic Education, no. 8, pp. 98–103, 2018.
Y. Zhao and M. Sun, “Design of a College Course Recommendation System with Hybrid Collaborative Filtering,” Computer Engineering, vol. 46, no. 6, pp. 280–285, 2020.
Y. Koren, R. Bell, and C. Volinsky, “Matrix factorization techniques for recommender systems,” Computer, vol. 42, no. 8, pp. 30–37, 2009.
M. Chen and J. Li, “Research on Course Recommendation Model Based on CNN-LSTM,” Data Analysis and Knowledge Discovery, vol. 5, no. 3, pp. 102–109, 2021.
J. Liu and L. Wang, “Time series course recommendation model based on Transformer,” Computer Applications, vol. 42, no. 7, pp. 2115–2121, 2022.
T. Baltrušaitis, C. Ahuja, and L. P. Morency, “Multimodal machine learning: A survey and taxonomy,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 41, no. 2, pp. 423–443, 2018.
Q. Chen and M. Li, “Research on the Application of ViT Model in Image Semantic Understanding,” Computer Science, vol. 49, no. 5, pp. 1–9, 2022.
J. Yang and Q. Chen, “Research progress of Transformer models in natural language processing,” Computer Engineering and Applications, vol. 57, no. 10, pp. 1–15, 2021.
Q. Zhang and M. Chen, “Analysis and Recommendation of Teaching Video Content Based on Multimodal Data,” Laboratory Research and Exploration, vol. 42, no. 2, pp. 151–156, 2023.
J. Li and Q. Zhang, “A student learning status assessment model based on multimodal data fusion,” China Electronic Education, no. 7, pp. 112–118, 2022.
F. Zhu and W. Hu, “A review of collaborative filtering recommendation algorithms,” Computer Science, vol. 47, no. 2, pp. 1–11, 2020.
C. Wang, “Research and Application of Content Recommendation Algorithm,” Computer Engineering and Design, vol. 40, no. 9, pp. 2678–2683, 2019.
J. Zhong, “The Application of Collaborative Education Theory in Higher Education,” Education Research, no. 4, pp. 98–105, 2021.
L. Ye, “Application of multimodal data fusion technology in the field of education,” China Distance Education, no. 6, pp. 34–41, 2020.
B. Zong, “Research on Multimodal Feature Extraction and Fusion Methods,” Computer Application Research, vol. 38, no. 8, pp. 2321–2326, 2021.
D. Zhang, “A review of multimodal fusion strategies,” Pattern Recognition and Artificial Intelligence, vol. 35, no. 3, pp. 267–276, 2022.
M. Qian, “Application of Attention Mechanism in Multimodal Fusion,” Computer Engineering, vol. 47, no. 8, pp. 1–9, 2021.
L. Ye, “Principles and Applications of Vision Transformer Model,” Computer Science, vol. 48, no. 7, pp. 2–10, 2021.
M. Xie, “Research on Self Attention Mechanism of Transformer Model,” Computer Engineering and Applications, vol. 56, no. 12, pp. 1–8, 2020.
Q. Tong, “Text semantic feature extraction based on Transformer,” Chinese Journal of Information Science, vol. 35, no. 4, pp. 56–63, 2021.