Immersive Reconstruction of Jinhua Intangible Cultural Heritage Space Based on NeRF and Panoramic Image Stitching
Main Article Content
Abstract
Accurate three-dimensional reconstruction from limited image data and inconsistent geometry remains a central challenge in cultural-heritage digitization and engineering scene modeling. This problem is also relevant to electromagnetic measurement environments, where sparse-view reconstruction can support virtual testing of antenna sites, propagation scenarios, and complex indoor scenes. To solve this issue, this paper proposes an immersive reconstruction method integrating Neural Radiance Fields and deep panoramic image stitching. The method uses the continuous modeling capability of NeRF for geometric restoration and panoramic stitching to enhance texture integrity. Its implementation includes deep-guided multi-frame stitching, continuous geometric modeling and color fitting through NeRF, and texture-stitching optimization using the PatchMatch algorithm. The process shows strong adaptability under limited image input. Experimental results confirm that the NeRF fusion model maintains stable reconstruction even with only four input frames, reaching an SSIM of 0.65 and a chamfer distance of 0.45. It also achieves good texture continuity in challenging areas, with LPIPS scores not exceeding 0.151. The system provides a strong immersive experience, with a distortion score above 0.9, while maintaining practical efficiency at high resolution. These results provide a useful benchmark for high-fidelity geometric and textural reconstruction in heritage spaces and related electromagnetic scene-digitalization tasks.
Downloads
Article Details
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors who publish with this journal agree to the following terms:
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).
References
D. Shao, K. J. Zoh, and Y. Xie, “The Spatial Differentiation Mechanism of Intangible Cultural Heritage and Its Integration with Tourism Development Based on Explainable Machine Learning and Coupled Coordination Models: a Case Study of the Jiang-Zhe-Hu in China,” Heritage Science, vol. 12, no. 1, pp. 1-22, 2024, doi: 10.1186/s40494-024-01528-3.
B. Tu and Y. Chen, “Research on the Realization Path of Intangible Cultural Heritage Inheritance from the Perspective of Public Cultural Services: a Case Study of Yao Long-Drum Dance in S Town,” Humanities and Social Science Research, vol. 8, no. 2, pp. 30-30, 2025, doi: 10.30560/hssr.v8n2p30.
J. Zhao, “Digital Protection and Inheritance Path of Intangible Cultural Heritage Based on Image Processing Algorithm,” Scalable Computing: Practice and Experience, vol. 25, no. 6, pp. 4720–4728, 2024, doi: 10.12694/scpe.v25i6.3287.
˙I. D. A. Ergin, “Digital Approach in Conservation of Heritage: 3D Virtual Reconstruction Applications in Ancient Cities,” Journal of Architectural Sciences and Applications, vol. 8, no. 2, pp. 969-987, 2023, doi: 10.30785/mbud.1312738.
A. G. Pirbazari and S. K. Tabrizi, “RecorDIM of Iran’s Cultural Heritage Using an Online Virtual Museum, Considering the Coronavirus Pandemic,” ACM Journal on Computing and Cultural Heritage (JOCCH), vol. 15, no. 2, pp. 1-14, 2022, doi: 10.1145/3500925.
B. Liang, K. Sriruksa, N. Wongpongkham, and A. Sriruksa, “Digital Reconstruction of the Snake King Festival Intangible Cultural Heritage in Zhanghu Town: a Multidimensional AI-enabled Animation Approach,” Journal of Ecohumanism, vol. 3, no. 8, pp. 9995–10012, 2024, doi: 10.62754/joe.v3i8.5612.
F. Colonnese, “Architectural Intangible Heritage and Graphic Reconstruction,” Terminological and Philological Notes. SCIRES-IT-SCIentific RESearch and Information Technology, vol. 13, no. 1, pp. 15-30, 2023, doi: 10.2423/i22394303v13n1p15.
D. Yan, “From Physical to Virtual: Enhancing the Representation of Intangible Cultural Heritage Using Mixed Reality,” Journal of Posthumanism, vol. 5, no. 2, pp. 1541–1556, 2025, doi: 10.63332/joph.v5i2.537.
H. U. Jeong, J. Kim, J. Kong, and R. Y. C. Kim, “Applied Practices on Digital Historical Data Transformation Based on Intangible Cultural Heritage with Metaverse Approach,” International Journal of Advanced Smart Convergence, vol. 13, no. 3, pp. 279-286, 2024, doi: 10.7236/IJASC.2024.13.3.279.
S. Zeng, X. Li, J. Tan, and X. Li, “Research on Digital Activation and Derivative Morphogenetic Design Methods for Peking Opera Intangible Cultural Heritage Based on Motion Capture,” The Design Journal, vol. 28, no. 3, pp. 502-524, 2025, doi: 10.1080/14606925.2025.2467621.
Y. X. Tan, S. S. Fan, X. D. Zeng, and R. X. Wang, “3-D Reconstruction for Thermal Infrared Images of Substation Equipment Based on Visual SLAM and Cascade MVSNet,” IEEE Sensors Journal, vol. 24, no. 7, pp. 11693-11704, 2024, doi: 10.1109/jsen.2024.3360439.
T. Wang and V. J. L. Gan, “Multi-View Stereo for Weakly Textured Indoor 3D Reconstruction,” Computer-Aided Civil and Infrastructure Engineering, vol. 39, no. 10, pp. 1469-1489, 2024, doi: 10.1111/mice.13149.
H. Huang, X. Yan, Y. Zheng, J. He, L. Xu, and D. Qin, “Multi-View Stereo Algorithms Based on Deep Learning: a Survey,” Multimedia Tools and Applications, vol. 84, no. 6, pp. 2877-2908, 2025, doi: 10.1007/s11042-024-20464-9.
B. K. Lee, B. Kim, W. J. Yoo, M. Ahn, and S. J. Han, “A Study on the Application of ColMap in 3D Reconstruction for Cultural Heritage Restoration,” Journal of the Korea Society of Computer and Information, vol. 28, no. 8, pp. 95-101, 2023, doi: 10.9708/jksci.2023.28.08.095.
F. Rahman and A. Nayak, “Drone-Based 3D Modeling for the Conservation and Restoration of Heritage Buildings,” AIS-Architecture Image Studies, vol. 6, no. 1, pp. 46-55, 2025, doi: 10.48619/ais.v6i1.1090.
A. Keyvanfar, A. Shafaghat, and M. S. F. Rosley, “Performance Comparison Analysis of 3D Reconstruction Modeling Software in Construction Site Visualization and Mapping,” International Journal of Architectural Computing, vol. 20, no. 2, pp. 453-475, 2022, doi: 10.1177/14780771211066876.
J. Zhang, J. Zhang, S. Mao, M. Ji, G. Wang, and Z. Chen, “GigaMVS: a Benchmark for Ultra-Large-Scale GIGAPIXEL-Level 3D Reconstruction,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 44, no. 11, pp. 7534-7550, 2021, doi: 10.1109/TPAMI.2021.3115028.
Q. Zou and F. Liu, “3D Reconstruction of Optical Building Images Based on Improved 3D-R2N2 Algorithm,” Tehnički vjesnik, vol. 30, no. 5, pp. 1594-1602, 2023, doi: 10.17559/TV-20230323000469.
G. Mazzacca, A. Karami, S. Rigon, E. M. Farella, P. Trybala, and F. Remondino, “NeRF for Heritage 3D Reconstruction,” International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, vol. 48, no. M-2-2023, pp. 1051-1058, 2023, doi: 10.5194/isprs-Archives-XLVIII-M-2-2023-1051-2023.
D. Harisanty, K. L. B. Obille, N. E. V. Anna, E. Purwanti, and F. Retrialisca, “Cultural Heritage Preservation in the Digital Age, Harnessing Artificial Intelligence for the Future: a Bibliometric Analysis,” Digital Library Perspectives, vol. 40, no. 4, pp. 609-630, 2024, doi: 10.1108/DLP-01-2024-0018.