LOCUS: Landmark-Oriented Container Discrimination Using Spatial Graphs

Abstract

As robots are increasingly deployed in unstructured, real-world environments, the ability to reason about complex spatial and semantic relationships among objects remains a fundamental challenge in enabling robust and generalizable manipulation and navigation. For example, deciding where to search for an object that is not in plain sight depends on where it is physically plausible as well as semantically likely. Popular methods such as cosine similarity with CLIP struggle to disambiguate between spatially and semantically similar objects that could contain a target object. We propose Landmark-Oriented Container Discrimination Using Spatial Graphs (LOCUS). To jointly reason about spatial information and semantics, we train a GNN to update CLIP embeddings on a full environment scene graph by passing embedding information between nodes based on proximity. CLIP embeddings, augmented by semantic knowledge from a fusion of household ontologies provide a robust semantic signal. We evaluate in simulation on a noiseless scene graph from simulator metadata, making the approach detection-agnostic. Our approach outperforms random, CLIP, Tidybot, and an LLM planner in the majority of room classes and configurations in simulation. To show our approach is robust to scene graph node placement and label noise, we demonstrate a physical mobile manipulator running in an exploration pipeline start-to-finish including scene graph labels from Detic.

The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.

More in Robotics

• arXiv preprint · 2 October 2026

  Mind the Refinement Gap: When Safe High-Level Robot Plans Produce Unsafe Executions

  Stabak Das, Priyesh Ranjan, Xiangfang Li and 1 other
• arXiv preprint · 3 October 2026

  Autoware in Construction: Gap Analysis and LiDAR Perception Toward Off-Road Autonomous Driving

  Yu Otsuki, Teja Emmey, Sena Matsushita and 2 others
• arXiv preprint · 2 October 2026

  A Passive AI System for Verifying Physical State on Automated Liquid Handlers

  Junqiong Joanne Qiu, Zeckria Kamrany, Ananya Anand and 7 others
• arXiv preprint · 3 October 2026

  CurveCodec 2: Skeleton-agnostic animation compression with a learned entropy model

  Mingyi Shi, Huancheng Lin, Xuelin Chen and 1 other
• arXiv preprint · 2 October 2026

  DeltaWorld: Physically Consistent Interactive World Simulators via Action-Conditioned Latent Increment Learning

  Boyuan Hou, Xiaoge Cao, Chaofan Zhang and 2 others

All new papers in Robotics