arXiv preprint ·
Time to Fake It: Continual Machine Learning Intensifies Unfairness in Deepfake Detection
- Published
- Source
- arXiv preprint, posted before peer review
- Published in
- arXiv
- DOI
- 10.48550/arxiv.2610.21974
- Original
- Read it at arXiv
- Cited by
- 0 works, as OpenAlex counts them
- Topics
In brief
When Deepfake Detectors Forget, Fairness Slips
The study tracks four fairness dimensions as detectors learn from a chronological sequence of 11 real-world deepfake generation methods. It finds that accuracy losses typically worsen unfairness, while fairness improvements are scarce, and that the patterns depend on both the learning method and demographic intersections.
What they found: Across the chronological sequence of 11 real-world deepfake generation methods, the study tracks four fairness dimensions across diverse demographics. It reports that accuracy degradation typically exacerbates unfairness, while fairness improvements remain scarce over time. Fairness patterns vary with both the continual-learning algorithm and demographic intersections.
AI-written summary. Check anything you rely on against the original paper.
Abstract
Deepfake detectors safeguard against misinformation, rendering their failures as much a societal as a technical concern. As generators constantly evolve, detectors trained on static datasets miss newly arising threats, while progressive training interferes catastrophically. Yet, mitigating forgetfulness in terms of accuracy, the prevalent focus of continual learning (CL), is insufficient to reflect real-world impact. We therefore scrutinize the effects of CL methods with respect to evolving fairness. To this end, we analyze four dimensions of fairness across diverse demographics for detectors trained progressively on a chronological sequence of 11 real-world deepfake generation methods. Tracking fairness metrics over time, we expose non-trivial interplays between performance and fairness that depend on both the choice of CL algorithm and demographic intersections. We find accuracy degradation to typically exacerbate unfairness and, conversely, fairness improvements to remain scarce over time. Dissecting the CL method families (rehearsal, prompts, regularization), we observe that inequitable forgetting is not explained by underrepresentation alone, but likely entangled with representation learning. We thus issue a call to action for CL methods to take social outcomes into account when balancing the stability-plasticity tradeoff.
The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.
Read it on ReadSearch
Each opens after you create an account, and brings you back to this paper.
More in Machine Learning
SCARCE: Emergent Institutions in Long-Horizon Multi-Agent Coding Systems
Between Spoilers and Guesswork: Avoiding Over-Specification in Coding Benchmarks
Recursive Reward Improvement via Adversarial Meta-Prompt Evolution
StoBasket: Joint Upsell and Cross-Sell Optimization for Contribution Margin
ReviewPilot: A Multi-Agent System for Screening and Data Extraction in Systematic Reviews
Get the few papers worth your time in Machine Learning every morning.
ReadSearch reads the new papers in your field each day and brings you the few worth reading, each with its key finding in a sentence.