Robust Multi-Task Learning for Principal Component Analysis

Abstract

Principal component analysis (PCA) is a fundamental tool for learning low-dimensional structure from high-dimensional data. When data are collected from multiple sources, the underlying task distributions may exhibit unknown degrees of similarity, with some tasks potentially arising from arbitrary distributions. We propose new multi-task PCA procedures that exploit similarity structure across tasks to improve eigenspace estimation while remaining robust to outlier tasks. We establish non-asymptotic convergence rates and show that the proposed procedures attain minimax optimal rates in a range of regimes. One of the procedures builds on the matrix-depth notion of Chen, Gao, and Ren (2018) and can achieve the optimal dependence of the estimation error on the proportion of outlier tasks, addressing a key challenge in robust multi-task learning. Extensive simulations and real-data analyses demonstrate the effectiveness of the proposed methods.

The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.

More in Statistics Theory

• arXiv preprint · 17 September 2026

  Next-token functional estimation

  Milind Nakul, Vidya Muthukumar and Ashwin Pananjady
• arXiv preprint · 18 September 2026

  Schedule optimization for tau-leaping in masked discrete diffusion

  Cecilia Secchi and Giacomo Zanella
• arXiv preprint · 17 September 2026

  Sharp spectral norm concentration of sparse random tensors

  Zhixin Zhou and Yizhe Zhu
• arXiv preprint · 18 September 2026

  Locally Private Inference for Riemannian Stochastic Optimization

  Xiaotian Chang, Yangdi Jiang and Qirui Hu
• arXiv preprint · 17 September 2026

  Parallelism, critical windows, and separations among diffusion language models

  Sitan Chen and Liye Wang

All new papers in Statistics Theory