Estimation of the Label-Noise Transition Matrix with Performance Guarantees via Selective Classification

Abstract

Modern machine learning depends heavily on massive datasets, but obtaining high-quality annotations at scale is often expensive. As a result, learning from noisily-labeled data has become common, making accurate estimation of the label-noise transition matrix crucial. However, existing transition matrix estimators rely on the fragile estimation of class-posteriors and do not provide finite-sample performance guarantees. In this work, we propose a novel methodology to estimate the transition matrix based on one-sided selective classification. This approach bypasses class-posterior estimation, provides finite-sample performance guarantees, and leverages flexible learning methods for binary classification. Moreover, we introduce effective algorithms to implement the proposed methodology and provide their refined finite-sample performance bounds.

The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.

More in Machine Learning (Statistics)

• arXiv preprint · 30 September 2026

  Optimal VC Dimension of Contrastive Learning with Margin

  Dionysis Arvanitakis, Vaggos Chatziafratis, Yiyuan Luo and 1 other
• arXiv preprint · 1 October 2026

  Learning Multiple Timescales for Goal-Conditioned Reinforcement Learning

  Pedro Robles Dutenhefner, Dikshant Shehmar, Wagner Meira and 1 other
• arXiv preprint · 30 September 2026

  Optimal Allocation and Volume under Surface

  Kai Feng, Han Hong, Jessie Li and 1 other
• arXiv preprint · 1 October 2026

  Block Optimism for Nonstationary Bandits with Latent Linear Dynamics

  Taehyun Hwang, Hyunjun Choi, Heesang Ann and 1 other
• arXiv preprint · 30 September 2026

  Sharp Statistical Rates for Asynchronous TD Learning with Markovian Data

  Yang Peng

All new papers in Machine Learning (Statistics)