LUMEN: Geometry-Guided Diffusion Model for Spatially-Varying HDR Illumination Estimation

Abstract

Estimating scene illumination from images is challenging as lighting is inherently spatially varying, depending on geometry, occlusion, and light sources. Existing methods incorporate geometric cues by deriving local environment maps or probe-based representations, but largely rely on regression or parametric models, resulting in over-smoothed lighting and limited realism. We revisit spatially-varying illumination estimation from a generative perspective and introduce LUMEN, a geometry-conditioned diffusion framework for synthesizing high-dynamic-range (HDR) environment maps at arbitrary spatial locations from single or multi-view images. Specifically, we reconstruct a coarse 3D scene from input images and render partial environment maps at arbitrary locations to encode visibility and spatial structure. These signals are fused with multi-view image features and fed into a diffusion transformer to generate full HDR environment maps. To train the model, we build a synthetic dataset of 700 indoor scenes with dense spatial supervision, including multi-view RGB images, depth, and HDR illumination at multiple sampled locations. This dataset enables the model to learn spatially consistent lighting distributions across diverse scenes. Extensive experiments demonstrate that LUMEN significantly improves visual fidelity and spatial coherence compared to prior approaches.

The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.

More in Computer Vision

• arXiv preprint · 1 November 2026

  IMPACT: Image-Conditioned Motion with Physics-Aware Collision and Trajectory Guidance for Video Generation

  Shiwei Yang, Yunlong Yu, Zhao Wang and 1 other
• arXiv preprint · 2 November 2026

  The DynaCell Evaluation Suite for Dynamic 3D Virtual Staining of Live Cells

  Alexandr A. Kalinin, Dihan Zheng, Taylla Milena Theodoro and 12 others
• arXiv preprint · 1 November 2026

  Vocabulary Aligned Explanations for Computer Vision Models

  Erfan Mirhaji, Nikhil Krishnaswamy, Jill Zarestky and 3 others
• arXiv preprint · 2 November 2026

  Findings-aware Language-Image Pretraining for CT Volume Interpretation

  Takuro Shimaya, Junya Inoh and Masahiro Saiko
• arXiv preprint · 1 November 2026

  SpecUltra: A Unified Foundation Model for Heterogeneous Spectral Images

  Weili Kong, Baisen Liu, Xiaojun Bi and 1 other

All new papers in Computer Vision