arXiv preprint ·
Credal Machine Learning for Risk-Averse Decision Making
- Published
- Source
- arXiv preprint, posted before peer review
- Published in
- arXiv
- DOI
- 10.48550/arxiv.2610.12115
- Original
- Read it at arXiv
- Cited by
- 0 works, as OpenAlex counts them
- Topics
In brief
A Safety Margin for Risky Predictions
The authors represent uncertainty about the true loss distribution using credal sets—sets of plausible probability distributions. They pair a learner that outputs these sets with a decision rule that selects a single predictive distribution for CVaR minimization, and report reliable avoidance of catastrophic decisions across classification, distribution shift, and reinforcement learning, with little sacrifice in expected performance.
What they found: The authors report that their approach reliably avoids catastrophic decisions in classification, under distribution shift, and in reinforcement learning. They also report sacrificing little in expected performance, suggesting the added caution does not require a large average-performance trade-off.
AI-written summary. Check anything you rely on against the original paper.
Abstract
In many machine learning applications, it is necessary to guard against worst-case scenarios and predictions that could result in substantial losses. In principle, this can be achieved by training risk-averse predictive models that minimize loss functions such as conditional value-at-risk (CVaR), rather than relying on models that perform well on average. In practice, however, the effectiveness of this approach to risk aversion is undermined by the learner's uncertainty regarding the true loss distribution and, consequently, the true CVaR. To achieve reliable risk-aversion, we propose a method in which this (epistemic) uncertainty is represented in terms of credal sets, i.e., sets of probability distributions. More specifically, we develop an efficient yet reliable learner that produces predictions in the form of credal sets and combine it with a novel decision rule that maps each credal set to a single predictive distribution for CVaR minimization. Across classification, under distribution shift, and in reinforcement learning, our approach reliably avoids catastrophic decisions, while sacrificing little in expected performance.
The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.
Read it on ReadSearch
Each opens after you create an account, and brings you back to this paper.
More in Machine Learning
Decision-Sufficient Posterior Approximation
Scalable Learning of Determinantal Point Processes with Kernel-Structured Interactions
A General $\widetildeΩ(\sqrt{T γ_T})$ Lower Bound for Kernel Bandits
Two-way Guidance: Simultaneous Learning of Summary Statistics for Generative Bayes
Accelerating Non-Smooth and Heavy-Tailed Sampling
Get the few papers worth your time in Machine Learning every morning.
ReadSearch reads the new papers in your field each day and brings you the few worth reading, each with its key finding in a sentence.