Sparsely connected rank-inspired neural network

Yunqing Huang, Wu Su, Nianyu Yi, Peimeng Yin

arXiv:2609.30750·math.NA·Published 2026-09-25

We propose a Sparsely Connected Rank-Inspired Neural Network (SCRINN) for function approximation and the numerical solution of partial differential equations (PDEs). By introducing a structured sparse connectivity architecture and an orthogonality- and normalization-guided loss function, SCRINN constructs an approximately orthonormal neural basis while promoting progressive rank growth of its evaluation matrix and reducing the number of trainable parameters. A two-stage framework is developed, in which an approximately orthonormal neural basis is first constructed, and the output weights are subsequently determined using least-squares methods. Numerical experiments on function approximation and a variety of steady-state, time-dependent, and nonlinear PDEs demonstrate that SCRINN consistently achieves high approximation accuracy with substantially lower training costs. The code is publicly available on GitHub.

TopicsDynamical Systems & PDE Learning

Tagspartial-differential-equations

arXiv categoriesmath.NA

arXiv abstract pagePDF