arXiv preprint ·
Relax-and-Sparsify Approximation Algorithms for Sparse Ridge Regression
- Published
- Source
- arXiv preprint, posted before peer review
- Original
- Read it at arXiv
- Topics
Abstract
This paper studies sparse ridge regression in the low-rank, high-dimensional setting that often arises when data collection is expensive. By exploiting the low-rank structure, we develop approximation algorithms within a relax-and-sparsify framework: solve a convex relaxation and then sparsify its solution to satisfy the original sparsity constraint. Specifically, we establish a tight rank-dependent sparsity bound for the convex relaxation by decomposing its support into two parts. This decomposition in turn motivates two approximation strategies, parameter reduction and binary redistribution, each exploiting a different part. Experiments on synthetic and real datasets show that the binary redistribution algorithms outperform the benchmarks in most instances.
The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.
Read it on ReadSearch
Each opens after you create an account, and brings you back to this paper.
More in Optimization & Control
Set-based State Estimation for Unknown Dynamical Systems from Noisy Output Data with Probabilistic Guarantees
On the Convergence of Continuous-Time AdamW
Parallelizable Interior-Point ADMM for Block-Structured Nonconvex Programs
PISG: Constraint-Aligned Signal Amplification for Diffusion-Based Combinatorial Optimization
Correspondence-Free Camera Pose Estimation by Matching Moments
Get the few papers worth your time in Optimization & Control every morning.
ReadSearch reads the new papers in your field each day and brings you the few worth reading, each with its key finding in a sentence.