arXiv preprint ·
Beyond the Model: The Critical Role of Data Filtering in Clinical Machine Learning
- Published
- Source
- arXiv preprint, posted before peer review
- Published in
- arXiv
- DOI
- 10.48550/arxiv.2610.06640
- Original
- Read it at arXiv
- Cited by
- 0 works, as OpenAlex counts them
- Topics
In brief
The Hidden Science of Data Filtering
The paper argues that filtering decisions should be treated as part of the scientific method, not just as preprocessing. It also makes the case for transparent, explainable pipelines that show why records were filtered and how those choices affect the data and model performance.
What they found: The paper’s central finding is a methodological point: filtering choices can alter clinical data’s statistical structure and the apparent complexity of a prediction task. Instead, it argues that researchers should explain their filtering decisions and investigate how those decisions affect the dataset and model performance. The work also notes that its source code is available on GitHub.
AI-written summary. Check anything you rely on against the original paper.
Abstract
Machine learning (ML) studies using clinical data often rely on preprocessing and filtering pipelines before model development. The filtering decisions made in these pipelines can alter the dataset's statistical structure and may artificially reduce or increase the complexity of the prediction task. We argue that filtering choices should be treated as part of the scientific method rather than as a routine preprocessing step. We further discuss the need for explainable and transparent preprocessing pipelines that allow researchers to understand why specific filtering choices are made and how these choices affect the resulting data distribution and model performance. All of the source code for this work is available on GitHub.
The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.
Read it on ReadSearch
Each opens after you create an account, and brings you back to this paper.
More in Machine Learning
Visual Grounding Safety in Vision-Language Models
SkillFormer: Skill-Decomposed Adaptation for Audio Language Models
Spacecraft Rendezvous Trajectory Generation with Modular Constraints via Diffusion Model Composition
Preserving Unstable Modes Through Inverse Dynamics in JEPA World Models
When Does a Diffusion Model Decide What to Draw ?
Get the few papers worth your time in Machine Learning every morning.
ReadSearch reads the new papers in your field each day and brings you the few worth reading, each with its key finding in a sentence.