arXiv preprint ·
Two $\operatorname{ReLU}$ Layers is All You Need
- Published
- Source
- arXiv preprint, posted before peer review
- Original
- Read it at arXiv
- Topics
Abstract
We prove that every $\operatorname{ReLU}$ network can be exactly simulated by a $\operatorname{ReLU}$ network with two hidden layers. We present two proofs: one that is based on fillings in homological algebra and a direct combinatorial proof.
The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.
Read it on ReadSearch
Each opens after you create an account, and brings you back to this paper.
More in Computational Complexity
CyberHull: Deterministic Malicious URL Isolation via Convex Hull
How to Walk a Dog in Parallel: On Parallel Computation of the Discrete Frechet Distance
Splitting Planar Necklaces with Few Straight Cuts
Coresets for $k$-Means: When Does Uniform Sampling Suffice?
A Bochner Weitzenböck Decomposition for Cellular Sheaf Laplacians, Curvature and Neural Sheaf Diffusion
Get the few papers worth your time in Computational Complexity every morning.
ReadSearch reads the new papers in your field each day and brings you the few worth reading, each with its key finding in a sentence.