Resolution-Independent Analysis of Encoder--Decoder Operator Learning via Limiting Kernels

Abstract

Operator learning is formulated on function spaces, but training data are typically available only through finite-dimensional representations. In encoder--decoder architectures, a matrix-valued kernel on the encoded space induces an operator-valued kernel on the original function spaces, and the corresponding reproducing kernel Hilbert spaces are isometrically isomorphic. As the input and output resolutions increase, the induced kernels converge to a limiting kernel, in the sense of operator-norm convergence of their associated integral operators, allowing regularity assumptions to be stated independently of the encoding resolution. For regularized stochastic gradient descent, we establish upper bounds for decreasing and fixed step sizes, separating the encoding and regularization terms from optimization terms of order \(t^{-θ}\) and \(T^{-θ'}\), respectively, for any \(θ,θ'\in(0,1)\). We further prove lower bounds showing that these encoding-induced terms are generally unavoidable. The analysis is further extended to encoder--decoder neural networks through the limiting neural tangent kernel (NTK), yielding error bounds with an additional finite-width term and polynomial parameter and sample complexity guarantees when the encoding errors decay algebraically. The framework covers matrix-valued kernels constructed from radial and dot product kernels, NTKs arising from wide encoder--decoder neural networks, and encoder--decoder pairs based on Fourier, Legendre polynomial, wavelet, PCA, or pointwise sampling representations.

The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.

More in Machine Learning (Statistics)

• arXiv preprint · 14 September 2026

  Matrix Spencer: Eight Standard Deviations Suffice and an Almost-Linear Time Algorithm for Dense Input

  Zhao Song and Lichen Zhang
• arXiv preprint · 9 September 2026

  Nonmaximal sums of maximally monotone operators under Rockafellar's constraint qualification

  Weifeng Yang
• arXiv preprint · 15 September 2026

  Rank-One Matrix Discrepancy and Algorithmic Kadison--Singer

  Ekene Ezeunala and Haotian Jiang
• arXiv preprint · 7 September 2026

  Kolmogorov--Arnold stability for discontinuous functions

  Sviatoslav V. Dzhenzher
• arXiv preprint · 16 September 2026

  A Walk From Free Probability to Matrix Discrepancy II: Weaver's Problem and the Kadison-Singer Conjecture

  Tarun Kathuria

All new papers in Machine Learning (Statistics)