Application of Multispectral Image Analysis Based on Transformer Model in the Restoration of Fine Fiber Materials in Ancient Murals
Main Article Content
Abstract
Accurate identification of micro-damage in fiber-based mural materials is essential for quantitative restoration and non-destructive cultural heritage conservation. Since multispectral imaging exploits the interaction between electromagnetic waves and material surfaces to reveal spectral responses that are invisible in conventional imaging, it provides an effective foundation for fine structural analysis. This study proposes a Transformer-based multispectral image analysis framework for the restoration of ancient mural fiber materials. The method constructs a spectral–spatial joint representation through channel-level fusion and positional encoding and employs multi-head self-attention to capture weak cross-band fracture features and long-range contextual dependencies. An end-to-end decoding strategy with cross-scale feature fusion is further designed to achieve pixel-level segmentation and quantitative characterization of fiber microcracks. Experiments conducted on 128 multispectral mural images demonstrate an Intersection over Union of 90.2% for longitudinal crack detection, a damage density estimation error of 0.05, and over 88.3% of crack width predictions with an absolute error below 0.15 mm. The proposed framework enables reliable nondestructive assessment of mural fiber degradation while providing a transferable spectral analysis strategy for electromagnetic imaging, intelligent material inspection, and related engineering applications involving multispectral sensing.
Downloads
Article Details
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors who publish with this journal agree to the following terms:
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).
References
V. Rajakumaran, S. Guessasma, A. D’Orlando, A. Melelli, M. Scheel, T. Weitkamp, et al., “Impact of Defects on Tensile Properties of Ancient and Modern Egyptian Flax Fibers: Multiscale X-Ray Microtomography and Numerical Modeling,” Fibers, vol. 12, no. 12, pp. 111, 2024, doi: 10.3390/fib12120111.
A. Parsa Sadr, S. Maraghechi, A. S. J. Suiker, and E. Bosco, “Chemo-mechanical ageing of paper: effect of acidity, moisture and micro-structural features,” Cellulose, vol. 31, no. 11, pp. 6923-6944, 2024, doi: 10.1007/s10570-024-06005-5.
E. Grifoni, L. Bonizzoni, M. Gargano, J. Melada, N. Ludwig, S. Bruni, et al., “Hyper-dimensional Visualization of Cultural Heritage: A Novel Multi-analytical Approach on 3D Pomological Models in the Collection of the University of Milan,” ACM Journal on Computing and Cultural Heritage (JOCCH), vol. 15, no. 2, pp. 34, 2022, doi: 10.1145/3477398.
E. Adamopoulos, C. Colombero, C. Comina, F. Rinaudo, M. Volinia, M. Girotto, et al., “Integrating Multiband Photogrammetry, Scanning, and GPR for Built Heritage Surveys: The Façades of Castello del Valentino,” ISPRS Annals of the Photogrammetry Remote Sensing and Spatial Information Sciences, vol. VIII-M-1-2021, pp. 1-8, 2021, doi: 10.5194/isprs-annals-VIII-M-1-2021-1-2021.
X. Ju, X. Zhao, and S. Qian, “TransMF: Transformer-Based Multi-Scale Fusion Model for Crack Detection,” Mathematics, vol. 10, no. 13, pp. 2354, 2022, doi: 10.3390/math10132354.
K. Ren, W. Sun, X. Meng, and G. Yang, “MSFDN: multi-scale spatial-spectral-frequency joint denoising network for hyperspectral images,” Geo-spatial Information Science, pp. 28(6), 2844–2863, 2025, doi: 10.1080/10095020.2025.2477552.
E. Zhao, N. Qu, Y. Wang, and C. Gao, “Spectral Reconstruction from Thermal Infrared Multispectral Image Using Convolutional Neural Network and Transformer Joint Network,” Remote Sensing, vol. 16, no. 7, pp. 1284, 2024, doi: 10.3390/rs16071284.
T. Li and Y. Gu, “Progressive Spatial–Spectral Joint Network for Hyperspectral Image Reconstruction,” IEEE Transactions on Geoscience and Remote Sensing, vol. 60, pp. 1-14, 2022, doi: 10.1109/TGRS.2021.3079969.
Q. Gu, H. Luan, K. Huang, and Y. Sun, “Hyperspectral Image Classification Using Multi-Scale Lightweight Transformer,” Electronics, vol. 13, no. 5, pp. 949, 2024, doi: 10.3390/electronics13050949.
X. Qiao, S. K. Roy, and W. Huang, “Multiscale Neighborhood Attention Transformer with Optimized Spatial Pattern for Hyperspectral Image Classification,” IEEE Transactions on Geoscience and Remote Sensing, vol. 61, pp. 1-15, 2023, doi: 10.1109/TGRS.2023.3314550.
Y. He, H. Li, M. Zhang, S. Liu, C. Zhu, B. Xin, et al., “Hyperspectral and Multispectral Remote Sensing Image Fusion Based on a Retractable Spatial–Spectral Transformer Network,” Remote Sensing, vol. 17, no. 12, pp. 1973, 2025, doi: 10.3390/rs17121973.
X. Qin, H. Song, J. Fan, and K. Zhang, “Spatio-spectral Cross-Attention Transformer for Hyperspectral image and Multispectral image fusion,” Remote Sensing Letters, vol. 14, no. 12, pp. 1303-1314, 2023, doi: 10.1080/2150704X.2023.2288069.
X. Wu, Y. Yu, and Y. Li, “A damage detection network for ancient murals via multi-scale boundary and region feature fusion,” npj Heritage Science, vol. 13, no. 1, pp. 82, 2025, doi: 10.1038/s40494-025-01546-9.
E. Adamopoulos, “Learning-based classification of multispectral images for deterioration mapping of historic structures,” Journal of Building Pathology and Rehabilitation, vol. 6, no. 1, pp. 41, 2021, doi: 10.1007/s41024-021-00136-z.
L. Es Sebar, L. Lombardo, P. Buscaglia, T. Cavaleri, A. Lo Giudice, A. Re, et al., “3D Multispectral Imaging for Cultural Heritage Preservation: The Case Study of a Wooden Sculpture of the Museo Egizio di Torino,” Heritage, vol. 6, no. 3, pp. 2783-2795, 2023, doi: 10.3390/heritage6030148.
Y. Li, Y. Yu, and X. Wu, “A dual-encoder hierarchical feature fusion network for ancient mural disease detection,” npj Heritage Science, vol. 13, pp. 284, 2025, doi: 10.1038/s40494-025-01844-2.
Z. Xu, X. Zhang, W. Chen, J. Liu, T. Xu, and Z. Wang, “MuralDiff: Diffusion for Ancient Murals Restoration on Large-Scale Pre-Training,” IEEE Transactions on Emerging Topics in Computational Intelligence, vol. 8, no. 3, pp. 2169-2181, 2024, doi: 10.1109/TETCI.2024.3359038.
J. Zhou, G. Zhao, and Y. Li, “Vison Transformer-Based Automatic Crack Detection on Dam Surface,” Water, vol. 16, no. 10, pp. 1348, 2024, doi: 10.3390/w16101348.
E. A. Shamsabadi, C. Xu, and D. Dias-da-Costa, “Robust crack detection in masonry structures with transformers,” Measurement, vol. 200, Art. no. 111590, 2022, doi: 10.1016/j.measurement.2022.111590.
T. Ye, M. He, Y. Wang, J. Wang, L. Zhu, and J. Zhang, “An Optimized Intelligent Segmentation Algorithm for Concrete Cracks Based on Transformer,” Electronics, vol. 14, no. 9, pp. 1720, 2025, doi: 10.3390/electronics14091720.