arXiv preprint ·

Spectral Landmarks: Alignment of Landmark Kernel Translates with the Leading Eigenfunctions of a Kernel Operator

Jeanie Schreiber

Published
Source
arXiv preprint, posted before peer review
Original
Read it at arXiv
Topics
Numerical AnalysisMachine LearningFunctional AnalysisMetric Geometry

Abstract

We study the problem of choosing $m$ landmark points so that the span of the kernel translates is as close as possible to the leading $s$-dimensional eigenspace of a positive-definite kernel. The natural measure is the Hilbert-Schmidt operator discrepancy between the reproducing-kernel-Hilbert-space (RKHS) projectors onto the two subspaces. We give a closed form spectral alignment function in terms of the truncated Mercer kernel and relate it to the classical integrated power function (Nyström trace error) through a two-sided sandwich bound. Minimizing the function by gradient descent on the landmark coordinates produces landmark sets that are evenly spaced. Theoretical results show that optimal configurations are those whose eigenfunction sampling matrix is a scaled isometry. On homogeneous spaces these are exactly the minimal equal-weight cubature rules for products of leading eigenfunctions, and for every $m\ge s$ they are the configurations whose sampled eigenfunctions form a unit-norm tight frame. Experiments on $\mathbb{S}^1$ and $\mathbb{S}^2$ agree with the theory. On the circle, with $s\le2m$ and a moderate bandwidth, every random start converges to equispaced landmarks, and on the sphere the optimizer recovers the regular tetrahedron, octahedron, and icosahedron from random starts. Finally, we analyze the numerical conditioning of the problem.

The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.

Read it on ReadSearch

Each opens after you create an account, and brings you back to this paper.

Already a reader? Sign in

All new papers in Numerical Analysis

Get the few papers worth your time in Numerical Analysis every morning.

ReadSearch reads the new papers in your field each day and brings you the few worth reading, each with its key finding in a sentence.

Papers belong to their authors and publishers; every page here links to the original. All research topics