arXiv preprint ·
Polynomial Residual Networks are Generically Identifiable
- Published
- Source
- arXiv preprint, posted before peer review
- Original
- Read it at arXiv
- Topics
Abstract
We prove identifiability results for constant-width residual networks with polynomial activations and bias terms. For activations of degree at least five with generic coefficients, the fiber over a generic parameter is a singleton. For activations of degree at least three with no linear term after a suitable translation of the input, the generic fiber is given by translating biases and then scaling weights and translated biases by real roots of unity. These results specialize to networks without bias terms. With the same proof technique, we further derive necessary conditions for critical points of the ResNet parametrization, that are central in singular learning theory.
The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.
Read it on ReadSearch
Each opens after you create an account, and brings you back to this paper.
More in Machine Learning
MDS Algebraic Geometry Codes of Square-Root Length on Hyperelliptic Curves
Structure and Exact Certification of Nonnegative Tensor Decompositions
Geometric Obstructions and Sharp Genus Dependence in LCD Scalings
On the gradient conjecture at infinity: Finite spherical length for gradient trajectories of definable potentials
Substantially Improved Rate and Distance for Addressable Transversal Phase Gates
Get the few papers worth your time in Machine Learning every morning.
ReadSearch reads the new papers in your field each day and brings you the few worth reading, each with its key finding in a sentence.