arXiv preprint ·
MotionAnimator: Semantic-to-Motion Reasoning for Animating Part-Structured 3D Assets in XR
- Published
- Source
- arXiv preprint, posted before peer review
- Original
- Read it at arXiv
- Topics
Abstract
3D digital assets are increasingly used in education, simulation, design, and immersive content creation, yet most remain behaviorally inert: they provide geometry and component structure but lack the semantic annotations, motion constraints, and executable behaviors needed to function as dynamic objects in Extended Reality (XR). Animating such assets therefore still requires manual rigging, object-specific templates, or substantial programming expertise. We introduce MotionAnimator, an intent-driven, part-aware XR animation authoring system that transforms semantically unlabeled, part-structured 3D assets into executable animations from natural-language instructions. Rather than generating code directly from text, MotionAnimator externalizes object understanding and motion reasoning into explicit semantic and motion representations. It grounds object identity, semantic parts, and functional directions, constructs a structured plan that coordinates object- and part-level motion, and translates the plan into executable Unity behavior. On a benchmark of 90 prompts across 30 objects, MotionAnimator demonstrated reliable semantic grounding and coordinated animation generation across diverse objects and animation intents. An exploratory user study further provided insights into users' experiences with MotionAnimator and highlighted its potential for part-aware XR animation authoring. These findings demonstrate how explicit semantic and motion representations can bridge high-level user intent and executable behavior, enabling existing part-structured assets to support coordinated XR animations beyond object-level transformations and predefined behaviors.
The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.
Read it on ReadSearch
Each opens after you create an account, and brings you back to this paper.
More in Human-Computer Interaction
Impact of Expertise and Trust on AI-assisted Work
ArguScale: Evidence-Grounded Human-AI Sensemaking Across Concurrent Live Conversations
sGLP: Simulating People with Stochastic Agents
AuthScribe: Supporting Agency and Authorship in LLM-Assisted Reflective Journaling
Rethinking Opinion Measurement Interfaces for Human-in-the-Loop Optimization
Get the few papers worth your time in Human-Computer Interaction every morning.
ReadSearch reads the new papers in your field each day and brings you the few worth reading, each with its key finding in a sentence.