arXiv preprint ·
Does Vision-Language Pretraining Granularity Matter? A Controlled Evaluation of Vision-Language Objectives Across Chest X-Ray Interpretation Tasks
- Published
- Source
- arXiv preprint, posted before peer review
- Original
- Read it at arXiv
- Topics
Abstract
Vision-language pretraining objectives differ in the spatial granularity of their supervision, yet the implications of this distribution for chest X-ray interpretation remain underexplored. We present a controlled study that isolates the pretraining objective: holding the encoder and pretraining data fixed, we train nine objectives spanning global and local contrastive learning, captioning, and their combinations, and evaluate across five chest X-ray tasks of increasing spatial granularity. We find that (i) pretraining granularity aligns with task granularity at the extremes, with local objectives leading on abnormality detection and global objectives on classification; (ii) local objectives are surprisingly competitive on global-level generation and question answering tasks; (iii) the merits of captioning and contrastive learning reverse across granularity levels; and (iv) among combinations, mixing captioning and contrastive supervision is strongest on classification and in distribution generation, while pairing two captioning objectives generalizes best on zero-shot report generation. These results show that no single objective is universally optimal, and that the interaction of objective type, granularity, and task governs downstream performance.
The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.
Read it on ReadSearch
Each opens after you create an account, and brings you back to this paper.
More in Computer Vision
Image Reconstruction from Phase with Untrained Neural Priors
Scalable In-Domain Self-Supervised Foundation Model for Dense Representation Transfer in High-Resolution Plant Imaging
Learning Polarization Image Restoration with General Restoration Priors
Active Data Acquisition with Side Information via Discrete Diffusion Priors
Quantum Diffusion Models for Medical Image Analysis
Get the few papers worth your time in Computer Vision every morning.
ReadSearch reads the new papers in your field each day and brings you the few worth reading, each with its key finding in a sentence.