Multi-target Tracking Algorithm for Film and Video under Multi-Layer Convolution Feature
Main Article Content
Abstract
Accurate multi-target tracking in film and video has become increasingly important for intelligent visual perception systems and electromagnetic-enabled sensing applications, where robust signal representation and feature propagation are essential for reliable scene understanding. This study investigates the accuracy and precision of multi-target character tracking in film and video by employing a multi-layer convolution feature framework integrated with convolutional neural networks (CNNs). In the proposed neural network architecture, video data are processed through multiple convolution and pooling layers followed by fully connected layers, while the Rectified Linear Unit (ReLU) is adopted as the activation function to enhance network performance. Experimental results demonstrate that the proposed method achieves a multiple object tracking accuracy (MOTA) of 56.8%, a multiple object tracking precision (MOTP) of 79.8%, and an Identification F-score (IDF1) of 60.1%. On the MOT16 benchmark, the proposed approach improves MOTA, MOTP, and IDF1 by 1.8%, 4.0%, and 2.7%, respectively, compared with the Dynamic Memory based Attention Network (DMAN), indicating superior tracking consistency and feature discrimination across different video sequences. The results confirm that the CNN-based multi-target tracking framework significantly enhances MOTA and IDF1 while providing a reliable computational foundation for intelligent visual sensing and signal processing systems in advanced communication and electromagnetic perception environments.
Downloads
Article Details
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors who publish with this journal agree to the following terms:
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).
References
H. Wang, L. Ding, R. Guan, et al., “Effects of advancing internet technology on Chinese employment: a spatial study of inter-industry spillovers,” Technological Forecasting and Social Change, vol. 161, 120259, 2020, doi: 10.1016/j.techfore.2020.120259.
B. Johnston A N, J. Barton M, A. Williams-Pritchard G, et al., “Youtube for millennial nursing students; using internet technology to support student engagement with bioscience,” Nurse education in practice, vol. 31, pp. 151-155, 2018, doi: 10.1016/j.nepr.2018.06.002.
J. Chiu C, C. Tasi W, L. Yang W, et al., “How to help older adults learn new technology? Results from a multiple case research interviewing the internet technology instructors at the senior learning center,” Computers & Education, vol. 129, pp. 61-70, 2019, doi: 10.1016/j.compedu.2018.10.020.
J. Yan, W. Pu, S. Zhou, et al., “Collaborative detection and power allocation framework for target tracking in multiple radar system,” Information Fusion, vol. 55, pp. 173-183, 2020, doi: 10.1016/j.inffus.2019.08.010.
A. Liu and S. Zhao, “High-performance target tracking scheme with low prediction precision requirement in WSNs,” International Journal of Ad Hoc and Ubiquitous Computing, vol. 29, no. 4, pp. 270-289, 2018, doi: 10.1504/IJAHUC.2018.096081.
A. Altan and R. Hacıoğlu, “Model predictive control of three-axis gimbal system mounted on UAV for real-time target tracking under external disturbances,” Mechanical Systems and Signal Processing, vol. 138, 106548, 2020, doi: 10.1016/j.ymssp.2019.106548.
L. Sun and Y. Li, “Multi-target pig tracking algorithm based on joint probability data association and particle filter,” International Journal of Agricultural and Biological Engineering, vol. 14, no. 4, pp. 199-207, 2021, doi: 10.25165/IJABE.V14I4.6105.
M. Ullah, H. Ullah, and A. Cheikh F, “Single shot appearance model (ssam) for multi-target tracking,” Electronic Imaging, vol. 2019, no. 7, pp. 466-1-466-6, 2019, doi: 10.2352/ISSN.2470-1173.2019.7.IRIACV-466.
H. Chen, Z. He, and B. Liu, “Sensor control method based on information entropy measure for multi-target tracking,” Control and Decision, vol. 33, no. 2, pp. 337-344, 2018, doi: 10.13195/j.kzyjc.2016.1424.
Y. Li, J. Zhao, Z. Lv, et al., “Medical image fusion method by deep learning,” International Journal of Cognitive Computing in Engineering, vol. 2, pp. 21-29, 2021, doi: 10.1016/j.ijcce.2020.12.004.
L. Sun, Y. Zou, Y. Li, et al., “Multi target pigs tracking loss correction algorithm based on Faster R-CNN,” International Journal of Agricultural and Biological Engineering, vol. 11, no. 5, pp. 192-197, 2018, doi: 10.25165/j.ijabe.20181105.4232.
S. He, S. Shin H, and A. Tsourdos, “Multi-sensor multi-target tracking using domain knowledge and clustering,” IEEE Sensors Journal, vol. 18, no. 19, pp. 8074-8084, 2018, doi: 10.1109/JSEN.2018.2863105.
E. Delande, J. Houssineau, J. Franco, et al., “A new multi-target tracking algorithm for a large number of orbiting objects,” Advances in Space Research, vol. 64, no. 3, pp. 645-667, 2019, doi: 10.1016/j.asr.2019.04.012.
Y. Tian, A. Dehghan, and M. Shah, “On detection, data association and segmentation for multi-target tracking,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 41, no. 9, pp. 2146-2160, 2018, doi: 10.1109/TPAMI.2018.2849374.
W. Yi, Y. Yuan, R. Hoseinnezhad, et al., “Resource scheduling for distributed multi-target tracking in netted colocated MIMO radar systems,” IEEE Transactions on Signal Processing, vol. 68, pp. 1602-1617, 2020, doi: 10.1109/TSP.2020.2976587.
B. Traore B, B. Kamsu-Foguem, and F. Tangara, “Deep convolution neural network for image recognition,” Ecological Informatics, vol. 48, pp. 257-268, 2018, doi: 10.1016/j.ecoinf.2018.10.002.
M. Xin and Y. Wang, “Research on image classification model based on deep convolution neural network,” EURASIP Journal on Image and Video Processing, vol. 2019, no. 1, pp. 1-11, 2019, doi: 10.1186/s13640-019-0417-8.
A. Sharma, E. Vans, D. Shigemizu, et al., “DeepInsight: A methodology to transform a non-image data to an image for convolution neural network architecture,” Scientific reports, vol. 9, no. 1, pp. 1-7, 2019, doi: 10.1038/s41598-019-47765-6.
T. Shanthi and S. Sabeenian R, “Modified Alexnet architecture for classification of diabetic retinopathy images,” Computers & Electrical Engineering, vol. 76, pp. 56-64, 2019, doi: 10.1016/j.compeleceng.2019.03.004.
S. Lu, Z. Lu, and D. Zhang Y, “Pathological brain detection based on AlexNet and transfer learning,” Journal of computational science, vol. 30, pp. 41-47, 2019, doi: 10.1016/j.jocs.2018.11.008.
M. Hosny K, A. Kassem M, and M. Fouad M, “Classification of skin lesions into seven classes using transfer learning with AlexNet,” Journal of digital imaging, vol. 33, no. 5, pp. 1325-1334, 2020, doi: 10.1007/s10278-020-00371-9.
J. Kadam V, M. Jadhav S, and K. Vijayakumar, “Breast cancer diagnosis using feature ensemble learning based on stacked sparse autoencoders and softmax regression,” Journal of medical systems, vol. 43, no. 8, pp. 1-11, 2019, doi: 10.1007/s10916-019-1397-z.
J. Yang, Y. Bai, F. Lin, et al., “A novel electrocardiogram arrhythmia classification method based on stacked sparse auto-encoders and softmax regression,” International Journal of Machine Learning and Cybernetics, vol. 9, no. 10, pp. 1733-1740, 2018, doi: 10.1007/s13042-017-0677-5.
L. Chen, M. Zhou, W. Su, et al., “Softmax regression based deep sparse autoencoder network for facial emotion recognition in human-robot interaction,” Information Sciences, vol. 428, pp. 49-61, 2018, doi: 10.1016/j.ins.2017.10.044.
D. Liang C, L. Wang, Y. Yao X, et al., “Multi-target tracking of networked heterogeneous collaborative robots in task space,” Nonlinear Dynamics, vol. 97, no. 2, pp. 1159-1173, 2019, doi: 10.1007/s11071-019-05038-x.
H. Kim S and L. Choi H, “Convolutional neural network for monocular vision-based multi-target tracking,” International Journal of Control, Automation and Systems, vol. 17, no. 9, pp. 2284-2296, 2019, doi: 10.1007/s12555-018-0134-6.
T. Tesfaye Y, E. Zemene, A. Prati, et al., “Multi-target tracking in multiple non-overlapping cameras using fastconstrained dominant sets,” International Journal of Computer Vision, vol. 127, no. 9, pp. 1303-1320, 2019, doi: 10.1007/s11263-019-01180-6.
I. Ahmed, S. Din, G. Jeon, et al., “Towards collaborative robotics in top view surveillance: A framework for multiple object tracking by detection using deep learning,” IEEE/CAA Journal of Automatica Sinica, vol. 8, no. 7, pp. 1253-1270, 2020, doi: 10.1109/JAS.2020.1003453.
L. Li, X. Wang, Z. Liu, et al., “A novel intuitionistic fuzzy clustering algorithm based on feature selection for multiple object tracking,” International Journal of Fuzzy Systems, vol. 21, no. 5, pp. 1613-1628, 2019, doi: 10.1007/s40815-019-00645-7.
W. Gan, S. Wang, X. Lei, et al., “Online CNN-based multiple object tracking with enhanced model updates and identity association,” Signal Processing: Image Communication, vol. 66, pp. 95-102, 2018, doi: 10.1016/j.image.2018.05.008.