arXiv preprint ·
The Geometry of Multitask Learning: Sharp Rates for Shared Subspace Estimation
- Published
- Source
- arXiv preprint, posted before peer review
- Original
- Read it at arXiv
- Topics
Abstract
Learning a shared subspace in multitask learning is an important statistical problem, yet exact rates remain poorly understood in many of the formal settings considered in the literature. To address this gap, which arises from limitations of existing upper-bound techniques, we propose a general multitask lemma. The lemma provides sufficient conditions for fast subspace estimation in generic multitask settings, in the form of geometric conditions on the task regression functions and their estimators. We subsequently show that the multitask lemma yields sharp minimax rates---previously unknown---for linear regression and classification in the regimes considered, and rates matching up to logarithmic factors for additive-noise regression.
The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.
Read it on ReadSearch
Each opens after you create an account, and brings you back to this paper.
More in Machine Learning (Statistics)
Non-Asymptotic Confidence Regions for Separable Nonlinear Models
Bethe Hessian Recovery through the Kesten-Stigum Regime
Statistical Analysis of Synthetic Data with Verification: A Linear Regression Framework
On Statistical-Computational Gaps in Graph Combinatorial Testing Problems
Optimal Neural Estimation for High-Dimensional Nonparametric Regression under Multisource Covariate Shift
Get the few papers worth your time in Machine Learning (Statistics) every morning.
ReadSearch reads the new papers in your field each day and brings you the few worth reading, each with its key finding in a sentence.