Sparsely connected rank-inspired neural network
Yunqing Huang, Wu Su, Nianyu Yi, Peimeng Yin
arXiv:2609.30750·math.NA·Published 2026-09-25
We propose a Sparsely Connected Rank-Inspired Neural Network (SCRINN) for function approximation and the numerical solution of partial differential equations (PDEs). By introducing a structured sparse connectivity architecture and an orthogonality- and normalization-guided loss function, SCRINN constructs an approximately orthonormal neural basis while promoting progressive rank growth of its evaluation matrix and reducing the number of trainable parameters. A two-stage framework is developed, in which an approximately orthonormal neural basis is first constructed, and the output weights are subsequently determined using least-squares methods. Numerical experiments on function approximation and a variety of steady-state, time-dependent, and nonlinear PDEs demonstrate that SCRINN consistently achieves high approximation accuracy with substantially lower training costs. The code is publicly available on GitHub.
TopicsDynamical Systems & PDE Learning
Tagspartial-differential-equations
arXiv categoriesmath.NA
arXiv abstract pagePDF