Construction and Empirical Study of Digital Literacy Evaluation Model for Young Vocational Education Teachers Based on Multimodal Data
Main Article Content
Abstract
With the increasing deployment of intelligent teaching environments and wireless digital infrastructures, efficient multimodal information acquisition and transmission have become essential for objective assessment in vocational education. To overcome the subjectivity and limited dimensionality of conventional evaluation methods, this study proposes a digital literacy evaluation model for young vocational education teachers based on a multimodal Transformer fusion network. Semantic representations of instructional texts are extracted using BERT, spatiotemporal behavioral features from classroom videos are learned through 3D Convolutional Neural Networks, and emotional acoustic characteristics are obtained from speech signals using OpenSMILE and temporal modeling. A cross-modal attention mechanism constrained by the Technological Pedagogical Content Knowledge (TPACK) framework is introduced to integrate heterogeneous information and dynamically optimize feature weighting across instructional scenarios. An end-to-end multi-task prediction architecture subsequently generates quantitative evaluations for six digital literacy dimensions with enhanced interpretability. Experimental results demonstrate approximately 92% classification accuracy on the test set, while quantitative scores for all six secondary dimensions exceed 85.5 in both theoretical instruction and practical training environments. The proposed framework establishes a high-precision and objective assessment methodology for teacher digital literacy and provides an effective engineering solution for multimodal data fusion, intelligent educational sensing, and distributed information processing. Furthermore, its multimodal perception and communication framework offers valuable insights for electromagnetic-enabled smart education systems, wireless sensing platforms, and next-generation intelligent information transmission technologies.
Downloads
Article Details
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors who publish with this journal agree to the following terms:
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).
References
S. Wahjusaputri and I. Nastiti T, “Digital literacy competency indicator for Indonesian high vocational education needs,” Journal of Education and Learning (EduLearn), vol. 16, no. 1, pp. 85-91, 2022, doi: 10.11591/edulearn.v16i1.20390.
W. Jia and X. Huang, “Digital literacy and vocational education: Essential skills for the modern workforce,” International Journal of Academic Research in Business and Social Sciences, vol. 13, no. 5, pp. 2195-2202, 2023, doi: 10.6007/IJARBSS/v13-i5/17080.
D. Jatmoko, S. Suyitno, S. Rasul M, M. Nurtanto, N. Kholifah, A. Masek, and R. Nur H, “The factors influencing digital literacy practice in vocational education: A structural equation modeling approach,” European Journal of Educational Research, vol. 12, no. 2, pp. 1109-1121, 2023, doi: 10.12973/eu-jer.12.2.1109.
T. Nguyen L A and A. Habók, “Tools for assessing teacher digital literacy: a review,” Journal of Computers in Education, vol. 11, no. 1, pp. 305-346, 2024, doi: 10.1007/s40692-022-00257-5.
A. Azman N, I. Hamzah M, and H. Baharudin, “Digital teaching strategies of Islamic Education teachers: A case study in primary schools,” International Journal of Learning, Teaching and Educational Research, vol. 24, no. 3, pp. 562-585, 2025, doi: 10.26803/ijlter.24.3.27.
M. Korkmaz and O. Akçay A, “Determining digital literacy levels of primary school teachers,” Journal of Learning and Teaching in Digital Age, vol. 9, no. 1, pp. 1-16, 2024, doi: 10.53850/joltida.1175453.
C. Buchan M, J. Bhawra, and R. Katapally T, “Navigating the digital world: development of an evidence-based digital literacy program and assessment tool for youth,” Smart Learning Environments, vol. 11, no. 1, pp. 8-32, 2024, doi: 10.1186/s40561-024-00293-x.
E. Ye¸silyurt and R. Vezne, “Digital literacy, technological literacy, and internet literacy as predictors of attitude toward applying computer-supported education,” Education and information technologies, vol. 28, no. 8, pp. 9885-9911, 2023, doi: 10.1007/s10639-022-11311-1.
D. Villar-Onrubia, L. Morini, I. Marín V, and F. Nascimbeni, “Critical digital literacy as a key for (post) digital citizenship: an international review of teacher competence frameworks,” Journal of E-Learning and Knowledge Society, vol. 18, no. 3, pp. 128-139, 2022.
E. Avinç and F. Doğan, “Digital literacy scale: Validity and reliability study with the rasch model,” Education and information Technologies, vol. 29, no. 17, pp. 22895-22941, 2024, doi: 10.1007/s10639-024-12662-7.
M. Gümüş M and V. Kukul, “Developing a digital competence scale for teachers: validity and reliability study,” Education and information technologies, vol. 28, no. 3, pp. 2747-2765, 2023, doi: 10.1007/s10639-022-11213-2.
N. Khan, A. Sarwar, B. Chen T, and S. Khan, “Connecting digital literacy in higher education to the 21st century workforce,” Knowledge Management & E-Learning, vol. 14, no. 1, pp. 46-61, 2022, doi: 10.34105/j.kmel.2022.14.004.
G. Barboutidis and E. Stiakakis, “Identifying the factors to enhance digital competence of students at vocational training institutes,” Technology, knowledge and learning, vol. 28, no. 2, pp. 613-650, 2023, doi: 10.1007/s10758-023-09641-1.
M. Dong L, C. Jiao B, and Zhang Q L.Research on Evaluation Index of Digital Literacy of Mathematics Teachers in Primary and Secondary Schools, “Modern Educational Technology,” 2025; 35(4):35-43, doi: 10.3969/j.issn.1009-8097.2025.04.004.
H. Choudhary and N. Bansal, “Barriers affecting the effectiveness of digital literacy training programs (DLTPs) for marginalised populations: a systematic literature review,” Journal of Technical Education and Training, vol. 14, no. 1, pp. 110-127, 2022, doi: 10.30880/jtet.2022.14.01.010.
N. Tytova and K. Mereniuk, “Digital literacy of future teachers in the realities of large-scale military aggression (Ukrainian experience),” Futurity Education, vol. 2, no. 3, pp. 50-61, 2022.
A. Orakova, F. Nametkulova, G. Issayeva, S. Mukhambetzhanova, M. Galimzhanova, and G. Rezuanova, “The relationships between pedagogical and technological competence and digital literacy level of teachers,” Journal of Curriculum Studies Research, vol. 6, no. 1, pp. 1-21, 2024, doi: 10.46303/jcsr.2024.2.
L. Naz F, A. Raheem, U. Khan F, and W. Muhammad, “An effect of digital literacy on the academic performance of universitylevel students,” Journal of Positive School Psychology, vol. 6, no. 8, pp. 10720-10732, 2022.
N. Kholifah, I. Kusumawaty, M. Nurtanto, F. Mutohhari, D. Isnantyo F, and H. Subakti, “Designing the structural model of students’ entrepreneurial personality in vocational education: An empirical study in Indonesia,” Journal of Technical Education and Training, vol. 14, no. 3, pp. 1-17, 2022, doi: 10.30880/jtet.2022.14.03.001.
S. Getenet, C. Haeusler, P. Redmond, R. Cantle, and V. Crouch, “First-year preservice teachers’ understanding of digital technologies and their digital literacy, efficacy, attitude, and online learning engagement: Implication for course design,” Technology, Knowledge and Learning, vol. 29, no. 3, pp. 1359-1383, 2024, doi: 10.1007/s10758-023-09724-z.
B. Espejo Villar L, L. Lázaro Herrero, and G. Álvarez-López, “UNESCO strategy and digital policies for teacher training: The deconstruction of innovation in Spain,” Journal of New Approaches in Educational Research, vol. 11, no. 1, pp. 15-30, 2022, doi: 10.7821/naer.2022.1.812.
C. Weninger, “Digital literacy as ideological practice,” Elt Journal, vol. 77, no. 2, pp. 197-206, 2023, doi: 10.1093/elt/ccad001.
A. Morgan, R. Sibson, and D. Jackson, “Digital demand and digital deficit: conceptualising digital literacy and gauging proficiency among higher education students,” Journal of Higher Education Policy and Management, vol. 44, no. 3, pp. 258-275, 2022, doi: 10.1080/1360080X.2022.2030275.
P. Reddy, K. Chaudhary, B. Sharma, and S. Hussein, “Essaying the design, development and validation processes of a new digital literacy scale,” Online Information Review, vol. 47, no. 2, pp. 371-397, 2023, doi: 10.1108/OIR-10-2021-0532.
Y. Yim I H and J. Su, “Artificial intelligence literacy education in primary schools: a review,” International Journal of Technology and Design Education, vol. 35, no. 5, pp. 2175-2204, 2025, doi: 10.1007/s10798-025-09979-w.
O. Derevyanchuk, N. Ridei, N. Tytova, V. Ravlyuk, and O. Yatsko, “Implementation of the STEM project “modeling of spatial images of stellated Poyhedra” in the professional training of future vocational education teachers,” Edelweiss Applied Science and Technology, vol. 9, no. 1, pp. 89-105, 2025, doi: 10.55214/25768484.v9i1.3623.
Z. Abiddin N, I. Ibrahim, and A. Aziz S A, “Advocating digital literacy: Community-based strategies and approaches,” Academic Journal of Interdisciplinary Studies, vol. 11, no. 1, pp. 198-211, 2022, doi: 10.36941/ajis-2022-0018.
K. Budiarto M, R. Karsidi, and A. Rahman, “E-Learning platform for enhancing 21st century skills for vocational school students: A systematic literature review,” Electronic Journal of E-Learning, vol. 22, no. 5, pp. 76-90, 2024, doi: 10.34190/ejel.22.5.3417.
T. Junaedi A, P. Panjaitan H, I. Yovita, K. Veronica, N. Renaldo, and J. Jahrizal, “Advancing digital and technology literacy through qualitative studies to bridging the skills gap in the digital age,” Journal of Applied Business and Technology, vol. 5, no. 2, pp. 123-133, 2024, doi: 10.35145/jabt.v5i2.170.
Demir, Kürat, and M. Yavuz, “Evaluation of Teachers’ Motivation in Terms of Research Literacy,” Research on Education & Psychology (REP), vol. 9, no. 2, 2025, doi: 10.54535/rep.1757746.
S. Nurhayati, A. Fitri, R. Amir, and Z. Zalisman, “Analysis of the implementation of training on digital-based learning media to enhance teachers’ digital literacy,” Al-Ishlah: Jurnal Pendidikan, vol. 16, no. 1, pp. 545-557, 2024, doi: 10.35445/alishlah.v16i1.4029.
I. Iskandar, S. Sumarni, R. Dewanti, and A. Asnur M N, “Infusing Digital Literacy in Authentic Academic Digital Practices of English Language Teaching at Universities,” International Journal of Language Education, vol. 6, no. 1, pp. 75-90, 2022, doi: 10.26858/ijole.v6i1.31574.
I. Kazanidis and N. Pellas, “Harnessing generative artificial intelligence for digital literacy innovation: A comparative study between early childhood education and computer science undergraduates,” Ai, vol. 5, no. 3, pp. 1427-1445, 2024, doi: 10.3390/ai5030068.
H. Tinmaz, M. Fanea-Ivanovici, and H. Baber, “A snapshot of digital literacy,” Library Hi Tech News, vol. 40, no. 1, pp. 20-23, 2023, doi: 10.1108/LHTN-12-2021-0095.
M. Shvardak, M. Ostrovska, N. Bryzhak, A. Predyk, and L. Moskovchuk, “The Use of Digital Technologies in Professional Training of Primary School Teachers,” International Electronic Journal of Elementary Education, vol. 16, no. 3, pp. 363-376, 2024, doi: 10.26822/iejee.2024.337.
S. Korir and P. Ngetich, “The Role of Digital Literacy Integration in TVET Curricula for Future Workforce Preparedness in Kenya,” Africa Journal of Technical and Vocational Education and Training, vol. 11, no. 1, pp. 2-10, 2026, doi: 10.69641/afritvet.2026.111198.
S. Andriyani, S. Haq M, M. Sholeh, et al., “Teacher Digital Literacy and Merdeka Curriculum Readiness: The Role of Learning Communities in Preparing 21st-Century Competencies in Secondary Schools,” Journal of Innovation and Research in Primary Education, vol. 5, no. 1, pp. 147-157, 2026, doi: 10.56916/jirpe.v5i1.2692.
H. Nakamura, “Digital Literacy and Critical Thinking Skills among Secondary Students,” Global Dialogues in Humanities and Pedagogy, vol. 4, no. 10, pp. 24-35, 2026.
Q. Sultonova D, “Youth Of Uzbekistan And Digital Literacy: Current Status, Development Factors, And Policy-Ecosystem Pathways,” TLEP – International Journal of Multidiscipline, vol. 3, no. 2, pp. 33-40, 2026.
I. Rikmasari, L. Yuliandini, S. Sugiarti, et al., “Reconstructing Teacher Professionalism: Integrating Digital Literacy and Innovative Pedagogy in the Era of Technological Disruption,” Journal of Innovation and Research in Primary Education, vol. 5, no. 1, pp. 1232-1243, 2026, doi: 10.56916/jirpe.v5i1.3011.
M. YU and S. FAN, “Exploration of the Talent Training Mode of Vocational Undergraduate Universities in the Era of Digital Intelligence,” US-China Education Review, vol. 16, no. 1, pp. 5-10, 2026, doi: 10.17265/2161-623X/2026.01.002.
F. Damayanti, A. Musliman, A. Stiawan R, et al., “Integration of Artificial Intelligence Based Digital Media in Science Learning Activities to Improve Critical Thinking Skills of Vocational High School Students,” Jurnal Pendidikan Sains Indonesia (Indonesian Journal of Science Education), vol. 14, no. 1, pp. 12-20, 2026, doi: 10.24815/jpsi.v14i1.93.
A. Zarqan I, Y. Nugraha D, G. Sitompul, et al., “Technology-Based Startup Ideas and MVP Development: A Digital Literacy Perspective among High School Students,” Journal of Management and Business Analytics, vol. 2, no. 1, pp. 93-107, 2026.
A. Andika, “Digital Literacy and Self-Efficacy Development Strategies for Technostress Coping Among Older Lecturers in Higher Education Institutions,” Jurnal Rumpun Manajemen dan Ekonomi, vol. 3, no. 1, pp. 191-199, 2026.
N. Delanoy, “Leveraging Strategic Partnerships to Enhance Digital and AI Literacy Among Preservice and In-service Teachers,” Journal of Digital Life and Learning, vol. 6, no. 1, pp. 204-225, 2026, doi: 10.51357/jdll.v6i1.362.