VLCQ: Post-training quantization for deep neural networks using variable length coding

Abstract

Quantization plays a crucial role in efficiently deploying deep learning models on resource-constrained devices. Post-training quantization does not require access to the original dataset or retraining the full model. Current methods that achieve high performance close to baseline results typically require INT8 fixed-point integers. However, achieving higher model compression with lower bit-widths often leads to significant performance degradation. In this paper, we propose VLCQ, a post-training quantization method that relaxes the fixed-point encoding constraint, enabling more flexible exploration of quantization techniques through variable-length encoding. This approach achieves competitive or improved performance while reducing bit-widths, without requiring access to training data or model fine-tuning. Extensive experiments on image classification, segmentation, and object detection demonstrate that VLCQ improves model compression and accuracy compared with state-of-the-art post-training quantization approaches. For per-channel quantization, VLCQ surpasses FP32 accuracy and Piece-Wise Linear Quantization (PWLQ) on most evaluated models, achieving up to 6x compression compared with FP32 and up to 1.7x compared with PWLQ. When prioritizing compression with limited accuracy loss, VLCQ achieves up to 12.25x compression compared with FP32 with less than 4% performance degradation. For per-tensor quantization, VLCQ is competitive with Data-Free Quantization (DFQ), while providing greater flexibility to achieve lower bit rates across different tasks and models.

The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.

More in Computer Vision

• arXiv preprint · 10 October 2026

  Dissecting the Carbon-SLO Tension in Geo-Distributed LLM Serving

  Burak Topcu, Musa Cim, Zuhal Ozturk and 1 other
• arXiv preprint · 12 October 2026

  GPU Goldmines: Tunable WebGPU Kernels for Edge LLM Inference

  Rithik Sharma, Reese Levine, Zheyuan Chen and 3 others
• arXiv preprint · 10 October 2026

  UAV-Mounted Hybrid RIS-Assisted ISAC-RSMA: Performance Analysis with Imperfect CSI and SIC

  Chandan Kumar Singh, Arthur Sousa de Sena, Smriti Uniyal and 3 others
• arXiv preprint · 13 October 2026

  AlignPred: Error-Controlled KV Cache Compression via Alignment and Predictive Coding

  Xu Yang, Jiapeng Zhang, Zhiwei Zuo and 5 others
• arXiv preprint · 13 October 2026

  How Reliable Are Large Language Models for Soil Organic Carbon Assessment? An Australian Benchmark

  Yingxuan Cheng, Tong Li, Yayong Li and 5 others

All new papers in Computer Vision