Martial Arts Routine Action Recognition and Scoring Using YOLOv8 and OpenPose
Main Article Content
Abstract
Martial arts routines are highly dynamic, multi-pose, and fast-paced, posing significant challenges to automated recognition and scoring. Such complex spatiotemporal characteristics are also representative of intelligent sensing tasks in advanced electromagnetic-aware environments, where robust human motion perception is essential for integrated visual and wireless monitoring systems. This paper proposes a joint framework combining YOLOv8 and time-optimized OpenPose to mitigate pose estimation jitter and detection inaccuracies caused by rapid motion and occlusion in human motion analysis. YOLOv8 first performs high-precision human target detection using bounding boxes to define regions of interest, after which the cropped images are processed by OpenPose to extract 17 keypoints, with IoU matching ensuring cross-frame identity association for temporal consistency. The keypoint sequence is modeled as a multi-channel time series and refined through a bidirectional LSTM network to predict smooth pose trajectories. The optimized keypoints are further used to calculate joint angles and movement velocities, which are integrated with dynamic thresholds for motion segmentation. DTW-based alignment and similarity matching with a standard motion library are subsequently employed to evaluate posture accuracy, motion amplitude, and rhythmic consistency, producing a comprehensive scoring result. Experimental results demonstrate average mAP@0.5 values of 0.863–0.942 (FPS 115.2–124.3), average PCK values of 88.7%–90.3% under occlusion (average MPJPE 48.2–51.6 pixels), and Pearson correlation coefficients of 0.925–0.941 for scoring consistency across diverse martial arts routines. The proposed framework provides an effective solution for intelligent motion analysis and offers technical reference for multimodal perception and dynamic scene understanding in advanced electromagnetic sensing applications.
Downloads
Article Details
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors who publish with this journal agree to the following terms:
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).
References
Y. Pang, Y. Wang, Q. Wang, F. Li, C. Zhang, and C. Ding, “Applications of AI in martial arts: A survey,” Proceedings of the Institution of Mechanical Engineers, Part P: Journal of Sports Engineering and Technology, vol. 239, no. 2, pp. 301-331, 2025, doi: 10.1177/17543371241273827.
Y. Shang, “Advancing Martial Arts Training: Neural Network-Based Recognition and Assistance Systems in Biotechnological Applications,” Journal of Commercial Biotechnology, vol. 29, no. 5, pp. 84-94, 2024, doi: 10.5912/jcb1913.
Z. Li, “A method for recognising wrong actions of martial arts athletes based on keyframe extraction,” International Journal of Biometrics, vol. 16, no. 3-4, pp. 256-271, 2024, doi: 10.1504/IJBM.2024.138228.
L. Song, R. A. B. A. Rashid, Y. Li, and B. Wang, “Predictive Decision Analytics for Membership Retention and Expansion in Martial Arts Organisations,” Decision Making: Applications in Management and Engineering, vol. 8, no. 2, pp. 21-35, 2025, doi: 10.31181/dmame8220251474.
Y. Hou, F. M. Seydou, and S. Kenderdine, “Unlocking a multimodal archive of Southern Chinese martial arts through embodied cues,” Journal of Documentation, vol. 80, no. 5, pp. 1148-1166, 2024, doi: 10.1108/JD-01-2022-0027.
C. R. Chung, S. C. Yeh, E. H. K. Wu, and S. Y. Lin, “Qigong master: A Qigong-based attention training game using action recognition and balance analysis,” IEEE Transactions on Games, vol. 16, no. 2, pp. 376-383, 2023, doi: 10.1109/TG.2023.3274148.
J. Zhuang, J. Sun, and G. Yuan, “Arrhythmia diagnosis of young martial arts athletes based on deep learning for smart medical care,” Neural Computing and Applications, vol. 35, no. 20, pp. 14641-14652, 2023, doi: 10.1007/s00521-021-06159-4.
V. H. Le, “Deep learning-based for human segmentation and tracking, 3D human pose estimation and action recognition on monocular video of MADS dataset,” Multimedia Tools and Applications, vol. 82, no. 14, pp. 20771-20818, 2023, doi: 10.1007/s11042-022-13921-w.
X. Cui and R. Hu, “Application of intelligent edge computing technology for video surveillance in human movement recognition and Taekwondo training,” Alexandria Engineering Journal, vol. 61, no. 4, pp. 2899-2908, 2022, doi: 10.1016/j.aej.2021.08.020.
X. Sun, Y. Wang, and J. Khan, “Hybrid LSTM and GAN model for action recognition and prediction of lawn tennis sport activities,” Soft Computing, vol. 27, no. 23, pp. 18093-18112, 2023, doi: 10.1007/s00500-023-09215-4.
V. Romanenko, S. Piatysotska, L. Podrigalo, M. Baibikov, N. Boychenko, and O. Volodchenko, “Methodology for evaluating the" Go/No-Go" reaction in martial arts,” Journal of Physical Education and Sport, vol. 24, no. 12, pp. 2139-2146, 2024, doi: 10.7752/jpes.2024.12312.
M. Rodrigo, C. Cuevas, D. Berjón, and N. García, “Automatic highlight detection in videos of martial arts tricking,” Multimedia Tools and Applications, vol. 83, no. 6, pp. 17109-17133, 2024, doi: 10.1007/s11042-023-16003-7.
S. Qu, “Cloud IoT-Oriented Neural Network-Based Taekwondo Teaching Scheme,” Journal of Multimedia Information System, vol. 11, no. 1, pp. 83-96, 2024, doi: 10.33851/JMIS.2024.11.1.83.
H. Mohammadzade, S. Hosseini, M. R. Rezaei-Dastjerdehei, and M. Tabejamaat, “Dynamic time warping-based features with class-specific joint importance maps for action recognition using Kinect depth sensor,” IEEE Sensors Journal, vol. 21, no. 7, pp. 9300-9313, 2021, doi: 10.1109/JSEN.2021.3051497.
L. Pei, S. Xia, L. Chu, F. Xiao, Q. Wu, W. Yu, et al., “MARS: Mixed virtual and real wearable sensors for human activity recognition with multidomain deep learning model,” IEEE Internet of Things Journal, vol. 8, no. 11, pp. 9383-9396, 2021, doi: 10.1109/JIOT.2021.3055859.
Y. Qiao, “Application of Virtual Simulation Technology in Martial Arts Routine Movement Analysis,” Journal of Electronics and Information Science, vol. 8, no. 4, pp. 7-13, 2023, doi: 10.23977/jeis.2023.080402.
F. E. Ait-Bennacer, A. Aaroud, K. Akodadi, and B. Cherradi, “Applying Deep Learning and Computer Vision Techniques for an e-Sport and Smart Coaching System Using a Multiview Dataset: Case of Shotokan Karate,” Int. J. Online Biomed. Eng, vol. 18, no. 12, pp. 35-53, 2022, doi: 10.3991/ijoe.v18i12.30893.
L. Li and K. Wang, “Research on automatic recognition method of basketball shooting action based on background subtraction method,” International Journal of Biometrics, vol. 14, no. 3-4, pp. 318-335, 2022, doi: 10.1504/IJBM.2022.124676.
R. Dang, C. Liu, M. Liu, and Q. Chen, “Channel attention and multi-scale graph neural networks for skeleton-based action recognition,” AI Communications, vol. 35, no. 3, pp. 187-205, 2022, doi: 10.3233/AIC-210250.
H. Liang, “Role of artificial intelligence algorithm for taekwondo teaching effect evaluation model,” Journal of Intelligent & Fuzzy Systems, vol. 40, no. 2, pp. 3239-3250, 2021, doi: 10.3233/JIFS-189364.