Dynamic optimization method for personalized vocal training program driven by reinforcement learning
Main Article Content
Abstract
This paper proposes a personalized vocal training program dynamic optimization method based on reinforcement learning to address the problems of static solidification and poor adaptability of traditional vocal training programs, as well as the lack of dynamic optimization capabilities in existing intelligent vocal systems, making it difficult to achieve personalized teaching. Based on the theory of vocal music, audio signal processing technology, and deep reinforcement learning algorithms, an end-to-end cloud multi-source data acquisition architecture is built to preprocess and extract features from singing audio, behavioral, and physiological data. A high-dimensional continuous state space and a discrete continuous mixed action space are constructed. Design a multi-objective weighted reward function and temporal enhancement module with improved PPO algorithm as the core, to achieve real-time dynamic adjustment of training content, difficulty, duration, and rest strategy.
Downloads
Article Details

This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors who publish with this journal agree to the following terms:
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).
References
T. Lan, “Integrating Chinese Operatic Vocal Techniques Into Contemporary Commercial Music Pedagogy: The Lan Tianyang Cross-System Vocal Training Model”, Journal of voice: official journal of the Voice Foundation, 2026, doi: 10.1016/J.JVOICE.2026.04.011.
L. S. Thai, D. M. Anh, P. T. Hieu, et al., “Research and development of VR system for training vocal music in Vietnam”, Computers & Education: X Reality, vol. 8, Art. no. 100154, 2026, doi: 10.1016/J.CEXR.2026.100154.
Y. Li and J. Liang, “Managing Musical Knowledge Through Virtual Reality: A Case Study of Vocal Training Transformation”, International Journal of Knowledge Management (IJKM), vol. 21, no. 1, pp. 1–18, 2025, doi: 10.4018/IJKM.392408.
Y. Xie, “Designing music education curriculum in a multicultural environment: Vocal training in China”, International Journal of Music Education, vol. 43, no. 3, pp. 356–371, 2025, doi: 10.1177/02557614231221144.
L. Zong, “Evaluation on the Effect of Enhancing Vocal Music Training Experience with Virtual Reality Technology”, International Journal of Web-Based Learning and Teaching Technologies (IJWLTT), vol. 20, no. 1, pp. 1–20, 2025, doi: 10.4018/IJWLTT.382590.
M. Gai, “Implementation of an Innovative Approach to Vocal Training in College: The Case of Artificial Intelligence Technologies NSynth, Sing Like Me, and Flow Machines”, The Asia-Pacific Education Researcher, vol. 34, no. 5, pp. 1–11, 2025, doi: 10.1007/S40299-025-01003-Y.
Z. Chen and J. Tao, “Exploring the Effects of Vocal Training Programs on the Skills and Development of Chorus Performers”, Journal of voice: official journal of the Voice Foundation, 2025, doi: 10.1016/J.JVOICE.2025.01.016.
S. Prados-Bravo, D. González-Rodríguez, and A. Rodríguez-Esteban, “Evaluating the Inclusion of Vocal Training in Spain’s Teacher Education: A Quantitative Analysis”, Education Sciences, vol. 14, no. 12, p. 1358, 2024, doi: 10.3390/EDUCSCI14121358.
Y. Shi, “The use of mobile internet platforms and applications in vocal training: synergy of technological and pedagogical solutions”, Interactive Learning Environments, vol. 31, no. 6, pp. 3780–3791, 2023, doi: 10.1080/10494820.2021.1943456.
D. Du, “Retraction notice to ‘Using mobile apps in vocal training to develop creative thinking’ [Thinking Skills and Creativity Volume 44, June 2022, 101020]”, Thinking Skills and Creativity, vol. 46, Art. no. 101167, 2022, doi: 10.1016/J.TSC.2022.101167.
S. Doganyigit and O. F. Islim, “Virtual reality in vocal training: a case study”, Music Education Research, vol. 23, no. 3, pp. 391–401, 2021, doi: 10.1080/14613808.2021.1879035.
S. Graf, A. Bungenstock, L. Richter, et al., “Acoustically Induced Vocal Training for Individuals With Impaired Hearing”, Journal of voice: official journal of the Voice Foundation, vol. 37, no. 3, pp. 374–381, 2021, doi: 10.1016/J.JVOICE.2021.01.020.
“FORECASTING METHOD OF VOCAL TRAINING PREFERENCE BASED ON BEHAVIORAL PSYCHOLOGY”, vol. 33, no. S6, pp. 93– 0, 2021.
Y. Z., “Application of vocal training in the treatment of voice diseases of music majors”, BASIC & CLINICAL PHARMACOLOGY & TOXICOLOGY, vol. 127, p. 215, 2020.
E. Babacan, A. Özçimen, and H. C. Kav¸sat, “The Problem of Voice Break at Register Transition During Vocal Training and The Approaches Towards The Solution of This Problem”, Art Vision, vol. 26, no. 45, pp. 463–475, 2020, doi: 10.32547/ATAUNIGSED.645346.
X. S., “The Reform and Innovation of Vocality Training Mode in Colleges and Universities Under the Diversified Teaching Mode”, BASIC & CLINICAL PHARMACOLOGY & TOXICOLOGY, vol. 126, pp. 319– 320, 2020.
X. Yang, E. D. Sadika, G. B. Pratama, et al., “An Analysis on Serious Games and Stakeholders’ Needs for Vocal Training Game Development”, Communication Sciences & Disorders, vol. 24, no. 3, pp. 800–813, 2019, doi: 10.12963/csd.18531.
Voixtek Vr LLC, “Patent Application Titled ‘Interactive Training Tool For Use In Vocal Training’ Published Online (USPTO 20190266914)”, Medical Patent Business Week, 2019.
H. Kawahara, K. Sakakibara, E. Haneishi, et al., “Real-time and interactive tools for vocal training based on an analytic signal with a cosine series envelope”, CoRR, abs/1909.03650, 2019.
T. Bano, “Michael Blakemore: Young actors neglect vocal training”, The Stage, no. 11, p. 5, 2017.