Healthy Counterfactual Generation via Diffusion Inpainting for Mammography Classification

Abstract

False negatives remain a critical limitation of computer-aided diagnosis (CAD) systems for breast cancer screening due to delayed detection and treatment. To address this issue, we propose a counterfactual data augmentation strategy that generates healthy mammograms by "erasing" lesions from anomalous images, thereby enriching the training distribution. We train a Denoising Diffusion Probabilistic Model on BI-RADS 1 (healthy) mammograms and use a RePaint-based sampling strategy to inpaint realistic normal tissue within annotated lesion bounding boxes. The resulting healthy counterfactuals replace annotated lesion regions with realistic healthy tissue while preserving patient-specific anatomical structure, as supported by similarity metrics between real and generated images. Image realism was further assessed by radiologists and found to be consistent with the original dataset quality. We evaluate counterfactual augmentation across four representative classifier architectures: a convolutional neural network (ConvNeXt), a vision transformer (ViT), a vision-language model pre-trained on mammogram-report pairs (Mammo-CLIP) and a multi-scale attention-based multiple-instance learning framework (FPN-MIL). Experiments conducted on the VinDr-Mammo dataset show improvements in sensitivity across all architectures, particularly at 80\% fixed specificity, contributing towards more reliable CAD systems for breast cancer. Code is available at: https://github.com/ines03garcia/diffusion-based-counterfactual-generation.

The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.

More in Computer Vision

• arXiv preprint · 8 October 2026

  Mid-Training Language Models on Raw Video

  Jaedong Hwang, Xiaoqian Shen, Ernie Chang and 9 others
• arXiv preprint · 9 October 2026

  Structure-Aware Matching for Robust UAV Thermal-to-Satellite Geo-Localization

  Chun Liu, Yuxin Wang, Zhenxiang Huo and 3 others
• arXiv preprint · 8 October 2026

  Expression-Diverse References for Identity-Preserving Video Generation

  Tianwen Fu, Wenbin Teng, Gonglin Chen and 3 others
• arXiv preprint · 9 October 2026

  APEX: Asynchronous Prefix Denoising for Extreme Compression

  David Dinkevich, Nisan Chiprut, Yoav HaCohen and 1 other
• arXiv preprint · 8 October 2026

  Transforming Image Editors into Video Editors

  Feng Wang, Zijie Li, Ceyuan Yang and 2 others

All new papers in Computer Vision