arXiv preprint ·
DinoMUSE: A DINOv2-guided Framework for Unsupervised Lateral Motion Estimation in Ultrasound Elastography
- Published
- Source
- arXiv preprint, posted before peer review
- Original
- Read it at arXiv
- Topics
Abstract
Quasi-static ultrasound elastography (USE) is a non-invasive imaging method for assessing soft tissue mechanical properties. Limited by low resolution, low sampling frequency and lack of phase information in the lateral direction, accurate lateral motion estimation remains a critical bottleneck in USE. Existing methods mainly rely on local image matching and physical constraints (such as tissue incompressibility assumption and effective Poisson's ratio), which lack sufficient contextual information. We present DinoMUSE, a DINO-guided mixture-of-experts (MoE) framework for unsupervised lateral motion estimation in USE. DinoMUSE incorporates high-level visual representations learned by DINOv2 into the motion estimation network to provide global contextual guidance. To facilitate effective interaction between DINOv2 features and local matching features, an MoE-based feature-fusion module adaptively transforms and integrates the two representations. Evaluations against NCC, GLUE, RAFT, and sPICTURE on simulation and in-vivo breast datasets show that DinoMUSE substantially improves lateral estimation accuracy while maintaining competitive axial performance. Specifically, DinoMUSE reduces the mean square error (MSE) of lateral displacement and strain estimation by 60% and 65%, respectively, compared with a SOTA algorithm on the simulation dataset. For in-vivo breast data, DinoMUSE achieves axial strain SNR and CNR of 5.70 and 4.82, and lateral strain SNR and CNR of 4.61 and 2.23, compared to 4.11 and 3.32, and 4.57 and 2.13 for the best competing method, alongside improved lesion visualization. These findings indicate the potential of leveraging transferable visual representations and adaptive feature fusion to improve lateral motion estimation in USE. The code is available at xxxxxxxx.
The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.
Read it on ReadSearch
Each opens after you create an account, and brings you back to this paper.
More in Image & Video Processing
Measurement-Adaptive Light-Cone Transform for Robust Non-Line-of-Sight Imaging
Severity-Channel Conditioning: An Injection-Level Study for Consumer-Device Deblurring
Stabilizing Illumination Conditioning in SSM-Based Low-Light Image Enhancement with Bottleneck Prompt Sidecars
Beyond Geometric Closure: Measuring and Diagnosing Mechanical Consistency in Visual Dynamics
FlashReFocus: Interactive Image Refocusing in Seconds
Get the few papers worth your time in Image & Video Processing every morning.
ReadSearch reads the new papers in your field each day and brings you the few worth reading, each with its key finding in a sentence.