ScaleNet-NO: A Multi-Scale Neural Operator for Fluid Mechanics Problems and General PDE Solving
Main Article Content
Abstract
Neural operators have shown strong potential for solving partial differential equations (PDEs) by learning mappings between high-dimensional function spaces. However, many existing models struggle to capture both high-frequency details and multi-scale structures, which are critical in turbulent flows, porous media heterogeneity, aerodynamic boundary layers, and Maxwell-type electromagnetic wave propagation. To overcome these limitations, this paper proposes ScaleNet-NO, a neural operator integrating two innovations: a Multi-Scale Parallel Large Convolution Kernel (MSPLCK) module for extended local context and fine-scale feature extraction, and an enhanced U-Net path for high-frequency representation. The MSPLCK module uses parallel large convolution kernels with effective receptive fields of 19, 13, and 7, enabling simultaneous modeling of meso-scale structures and localized features. Experiments on seven solid- and fluid-mechanics benchmarks show substantial gains, with relative error reductions of 59.0%, 34.6%, and 47.7% on Pipe, Airfoil, and Darcy flow compared with U-NO, and improvements over the state-of-the-art LSM model. ScaleNet-NO provides a general framework for complex PDE solving, with potential for fluid dynamics and electromagnetic-wave simulation.
Downloads
Article Details
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors who publish with this journal agree to the following terms:
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).
References
N. Kovachki et al., “Neural operator: Learning maps between function spaces with applications to PDEs,” Journal of Machine Learning Research, vol. 24, no. 89, pp. 1–97, 2023.
S. Goswami, M. Yin, Y. Yu, and G. E. Karniadakis, “A physics-informed variational DeepONet for predicting crack path in quasi-brittle materials,” Computer Methods in Applied Mechanics and Engineering, vol. 391, Art. no. 114587, 2022.
T. Kurth et al., “Fourcastnet: Accelerating global high-resolution weather forecasting using adaptive Fourier neural operators,” in Proceedings of the Platform for Advanced Scientific Computing Conference, 2023, pp. 1–11.
L. Lu, P. Jin, G. Pang, Z. Zhang, and G. E. Karniadakis, “Learning nonlinear operators via DeepONet based on the universal approximation theorem of operators,” Nature Machine Intelligence, vol. 3, no. 3, pp. 218– 229, 2021.
Z. Li et al., “Fourier neural operator for parametric partial differential equations,” 2020.
T. Tripura and S. Chakraborty, “Wavelet neural operator: A neural operator for parametric partial differential equations,” 2022.
Q. Cao, S. Goswami, and G. E. Karniadakis, “Laplace neural operator for solving differential equations,” Nature Machine Intelligence, vol. 6, no. 6, pp. 631–640, 2024.
J. W. Cooley, P. A. Lewis, and P. D. Welch, “The fast Fourier transform and its applications,” IEEE Transactions on Education, vol. 12, no. 1, pp. 27–34, 2007.
M. Abdar et al., “A review of uncertainty quantification in deep learning: Techniques, applications and challenges,” Information Fusion, vol. 76, pp. 243–297, 2021.
M. Ramezankhani, A. Deodhar, R. Y. Parekh, and D. Birru, “An advanced physics-informed neural operator for comprehensive design optimization of highly-nonlinear systems: An aerospace composites processing case study,” Expert Systems with Applications, vol. 142, Art. no. 109886, 2025.
X. Yu et al., “SepONet: Efficient large-scale physics-informed operator learning,” in NeurIPS 2024 Workshop on Data-driven and Differentiable Simulations, Surrogates, and Solvers, 2024.
P. Xiao, M. Zheng, A. Jiao, X. Yang, and L. Lu, “Quantum DeepONet: Neural operators accelerated by quantum computing,” vol. 9, Art. no. 1761, 2025.
M. del Carmen Calderon-Moreno, “Universality of derivative and antiderivative operators with holomorphic coefficients,” Annales Polonici Mathematici, vol. 77, pp. 197–207, 2001.
S. Karumuri, L. Graham-Brady, and S. Goswami, “Physics-informed latent neural operator for real-time predictions of time-dependent parametric PDEs,” 2025.
J. P. Cunningham and Z. Ghahramani, “Linear dimensionality reduction: Survey, insights, and generalizations,” Journal of Machine Learning Research, vol. 16, no. 1, pp. 2859–2900, 2015.
D. Zhang, “Wavelet transform,” in Fundamentals of Image Data Mining: Analysis, Features, Classification and Retrieval. Springer, 2019, pp. 35– 44.
T. Tripura and S. Chakraborty, “Wavelet neural operator for solving parametric partial differential equations in computational mechanics problems,” Computer Methods in Applied Mechanics and Engineering, vol. 404, Art. no. 115783, 2023.
M. A. Rahman, Z. E. Ross, and K. Azizzadenesheli, “U-no: U-shaped neural operators,” 2022.
S. Wang, H. Wang, and P. Perdikaris, “On the eigenvector bias of Fourier feature networks: From regression to solving multi-scale PDEs with physics-informed neural networks,” Computer Methods in Applied Mechanics and Engineering, vol. 384, Art. no. 113938, 2021.
J. T. Oden, S. Prudhomme, A. Romkes, and P. T. Bauman, “Multiscale modeling of physical phenomena: Adaptive control of models,” SIAM Journal on Scientific Computing, vol. 28, no. 6, pp. 2359–2389, 2006.
L. Lu, Q. Xiong, B. Xu, and D. Chu, “Mixdehazenet: Mix structure block for image dehazing network,” in 2024 International Joint Conference on Neural Networks (IJCNN), 2024, pp. 1–10.
O. Ronneberger, P. Fischer, and T. Brox, “U-net: Convolutional networks for biomedical image segmentation,” in International Conference on Medical Image Computing and Computer-Assisted Intervention, 2015, pp. 234– 241.
H. Wang, Q. Wang, M. Gao, P. Li, and W. Zuo, “Multi-scale location-aware kernel representation for object detection,” in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2018, pp. 1248–1257.
F. E. Browder, “Approximation by solutions of partial differential equations,” American Journal of Mathematics, vol. 84, no. 1, pp. 134–160, 1962.
Z. Li et al., “Neural operator: Graph kernel network for partial differential equations,” 2020.
T. Xu, D. Liu, P. Hao, and B. Wang, “Variational operator learning: A unified paradigm marrying training neural operators and solving partial differential equations,” Journal of the Mechanics and Physics of Solids, vol. 190, Art. no. 105714, 2024.
T. Zhang and X. Zhu, “A solution method for partial differential equations by fusing Fourier operators and U-Net,” vol. 13, no. 7, Art. no. 1033, 2025.
W. Liu, M. Yagoubi, and M. Schoenauer, “Multi-resolution graph neural networks for PDE approximation,” in International Conference on Artificial Neural Networks, 2021, pp. 151–163.
R. J. Gladstone, H. Rahmani, V. Suryakumar, H. Meidani, M. D’Elia, and A. Zareei, “GNN-based physics solver for time-independent PDEs,” 2023.
Y. Hu, T. Zhao, S. Xu, Z. Xu, and L. Lin, “Neural-PDE: A RNN based neural network for solving time dependent PDEs,” 2020.
D. P. Kingma and J. Ba, “Adam: A method for stochastic optimization,” 2014.
D. Hendrycks and K. Gimpel, “Gaussian error linear units (GELUs),” 2016.