arXiv preprint ·
EVISTA: Unified Multimodal Video Search with Evidence-Aware Temporal Path Optimization
- Published
- Source
- arXiv preprint, posted before peer review
- Original
- Read it at arXiv
- Topics
Abstract
In the era of big data, precise event retrieval from large video collections has become increasingly important and challenging. In particular, locating multiple events from the same video in their temporal order is difficult when different events are described by different types of evidence, such as visual content, on-screen text, and spoken words. We develop EVISTA, a unified multimodal video retrieval system for the Ho Chi Minh City AI Challenge 2026, which integrates visual-semantic, OCR, ASR, object, and metadata search over a shared keyframe index, and propose TEMPO-P, an evidence-aware temporal path optimization method for ordered multi-event retrieval. Building EVISTA for this task reveals two limitations of independent event retrieval: a relevant video may be missed when one event is weakly retrieved, and independently retrieved event candidates may be temporally inconsistent or unable to represent events defined primarily by text or speech. TEMPO-P addresses these limitations by aggregating candidate videos across events and modalities, jointly scoring keyframes using visual, OCR, and ASR evidence, and selecting a compact temporally ordered path within each video through dynamic programming. On five organizer queries and 36 additional multi-event queries, TEMPO-P matches visual-only temporal alignment on visually described events (R@1 0.42 for both) and retrieves queries containing text-defined events, which visual-only alignment cannot represent (R@1 0.38). TEMPO-P is integrated into EVISTA as its ordered-event retrieval mode.
The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.
Read it on ReadSearch
Each opens after you create an account, and brings you back to this paper.
More in Information Retrieval
Co-adaptive Rule Routing and Constraining for Structured Knowledge Retrieval
Retrieving Complementary Evidence for Multi-Hop RAG with Semantic Gain Graphs
RES-MR: Risk-Aware Reasoning for Explainable and Safe Medication Recommendation
Understanding ChatGPT Citations: Evidence from Production Web Search Across Model Generations
Toward Explainability in Multimodal Recommendation
Get the few papers worth your time in Information Retrieval every morning.
ReadSearch reads the new papers in your field each day and brings you the few worth reading, each with its key finding in a sentence.