arXiv preprint ·
Extreme Binary Classification: Extreme Value Theory for Extreme Constraint on False Negative
- Published
- Source
- arXiv preprint, posted before peer review
- Original
- Read it at arXiv
- Topics
Abstract
While binary classification is one of the most extensively studied problems in machine learning, the regime in which the goal is to learn a classifier with an almost zero false negative rate remains largely unexplored. In this paper, we introduce the Extreme Binary Classification problem, where the objective is to learn a classifier whose false negative rate $α$ is constrained by $ε_{N_1}=o_{N_1\to\infty}(1/N_1)$, with $N_1$ denoting the number of positive examples in the training set. To address this problem, we propose a threshold adaptation method theoretically grounded in guarantees derived from Extreme Value Theory, together with a feature selection procedure based on a permutation test applied to sample maxima. Experimental results on four real-world datasets of varying sizes demonstrate that our approach compares favorably with state-of-the-art methods. In addition, we illustrate its interpretability through an application to a cancer screening dataset.
The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.
Read it on ReadSearch
Each opens after you create an account, and brings you back to this paper.
More in Machine Learning (Statistics)
Finite-Rank Logistic Gaussian Processes with Exact Likelihood for Conditional Density Estimation
TypedBench: A Benchmark for Calibration, Framing Sensitivity, and Cost in System One Decision Models
Learning joint probabilistic weather forecasts from station observations alone
Automated Detection of Match Phases in Football from Spatio-Temporal Tracking Data Using Graph Neural Networks
Credit Attribution in Timestamped Soccer Networks Using Multivariate Hawkes Processes
Get the few papers worth your time in Machine Learning (Statistics) every morning.
ReadSearch reads the new papers in your field each day and brings you the few worth reading, each with its key finding in a sentence.