The minimal width of neural networks and immersions of real projective space

Abstract

We investigate the minimal width of deep neural networks that can approximate all continuous functions from $\mathbb{R}^n$ to $\mathbb{R}^m$ in the topology of uniform convergence on compact subsets. We show that whenever the real projective space $\mathbb{RP}^{n-1}$ admits a smooth immersion into $\mathbb{R}^n$, the minimal width is at least $n+\min\{n,m\}$, assuming that the activation function is continuous and monotone. As a consequence, the minimal width of ReLU networks is $n+m$ whenever $n$ is equal to 2, 3, 4, 7 or 8 and $1\le m \le n$, extending results of Hanin-Sellke and Hwang. This suggests an intriguing connection between the approximation theory of neural networks and differential topology.

The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.

More in Machine Learning (Statistics)

• arXiv preprint · 14 October 2026

  Subdata Selection for Measurement-Constrained Linear Regression under Model Misspecification

  Yundi Kong, Min Yang and Ping-Shou Zhong
• arXiv preprint · 15 October 2026

  Efficient Agnostic Learning of Univariate Densities Under Local Differential Privacy

  Mohammad Afzali, Hassan Ashtiani and Sivan Sabato
• arXiv preprint · 14 October 2026

  Large-Step Last-Iterate Convergence of Random-Reshuffling Stochastic Gradient Descent

  Zijun Chen and Zihan Zhang
• arXiv preprint · 15 October 2026

  Score Mismatch and Set-Constrained Sampling in Zero-Shot Conditional Discrete Diffusion

  Renxiang Huang, Yuchen Liang, Yingbin Liang and 2 others
• arXiv preprint · 14 October 2026

  State-Matched Sequence Conformal Prediction

  Ruihang Han and Li-Hsiang Lin

All new papers in Machine Learning (Statistics)