M2Tok: Multi-head Multi-codebook Discrete Action Tokenization for Vision-Language-Action Models

Abstract

Recent advancements have successfully adapted autoregressive language models to process multimodal signals, such as images and actions. Since raw action signals are continuous, effective tokenization is essential to map high-dimensional inputs into compact discrete tokens for autoregressive processing. However, existing discrete action tokenizers often suffer from high reconstruction loss, failing to preserve the fine-grained dynamics required for precise control. This "discretization bottleneck" significantly limits the performance ceiling of downstream Vision-Language-Action (VLA) models. To address this, we propose ${M}^2$Tok, a Multi-head Multi-codebook Action Tokenizer designed to minimize reconstruction error and enhance policy performance. Our approach introduces two key structural innovations: (1) we decompose the latent action features into multiple heads, enabling the model to implicitly align specific heads with distinct action dimensions; (2) we assign independent codebooks to each head for quantization. By leveraging the combinatorial nature of multiple codebooks, we significantly expand the representational expressivity of the tokenizer, leading to substantially lower reconstruction loss compared to previous methods. We evaluate the ${M}^2$Tok-based VLA on the RoboTwin, Simpler-Env, and 3 zero-shot real-world tasks. Experimental results demonstrate our method not only achieves superior reconstruction fidelity but also significantly boosts the success rate of VLA models. Comprehensive ablation studies further confirm the effectiveness of the multi-head and multi-codebook mechanisms. Code is available at https://github.com/cpaaax/M2Tok.

The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.

More in Robotics

• arXiv preprint · 16 September 2026

  Feedback-Modulated Harmonic Policies for Quadruped Locomotion

  Yixuan Jia, Steven Roche and Jonathan P. How
• arXiv preprint · 17 September 2026

  CoreSense: Traceable Failure Recall and Conflict-Aware Belief Gating for Auditable Robot Decisions

  Zoe Li
• arXiv preprint · 16 September 2026

  Missing Bridges: Composition-Aware Active Imitation Learning

  Maxwell J. Jacobson, Ahmed H Qureshi and Yexiang Xue
• arXiv preprint · 17 September 2026

  AMB3R-SLAM: Kilometer-scale SLAM with Hierarchical Backend

  Hengyi Wang and Lourdes Agapito
• arXiv preprint · 16 September 2026

  Causal-History Test-Time Scaling for Failure Recovery in Autoregressive World-Action Models

  Lin Li, Long Chen, Kwunhang and 10 others

All new papers in Robotics