arXiv preprint ·
An Introduction to Compression-Based Machine Learning
- Published
- Source
- arXiv preprint, posted before peer review
- Published in
- arXiv
- DOI
- 10.48550/arxiv.2609.21309
- Original
- Read it at arXiv
- Cited by
- 0 works, as OpenAlex counts them
- Topics
In brief
Unlocking AI with Compression Techniques
This paper formalizes various strategies for integrating compression into machine learning and introduces a design framework that shows these methods can compete with traditional approaches, especially in challenging areas like malware detection.
What they found: The study found that integrating compression techniques into machine learning can yield notable accuracy gains, with improvements of up to 0.62. The authors validated their framework by testing it against traditional methods, particularly excelling in malware detection. Overall, the findings suggest that compression-based approaches can be a viable alternative to conventional machine learning strategies.
AI-written summary. Check anything you rely on against the original paper.
Abstract
Any lossless compression algorithm (like gzip) may be converted into a machine learning method, via either Normalized Compression Distance or the Minimum Description Length principle. Any auto-regressive model may be converted into a lossless compression method via entropy coding. This seemingly circular dependence has unrealized potential in modern artificial intelligence and machine learning, and we survey and formalize the various strategies that have been used to leverage compression for machine learning. We introduce and empirically validate a design framework for compression-based ML, finding compression-based methods competitive with conventional baselines and decisively stronger on malware. We find that varying these design choices yields accuracy gains of up to 0.62.
The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.
Read it on ReadSearch
Each opens after you create an account, and brings you back to this paper.
More in Machine Learning
M2G-LLM: Enhancing Clinical Prediction via Multimodal Graph Reasoning and LLM Context Injection
SPIBER: Reconstructing Free Energy Landscapes from Short, Unconverged Trajectories with Generative Flow Networks
TierKV: Long-Context On-Device LLMs via Predictive Multi-Tier KV Caching
Mask-Aware Execution for Efficient JEPA Training
Implicit Rule Induction with Test-Time Task Embeddings in ARC-like Tasks
Get the few papers worth your time in Machine Learning every morning.
ReadSearch reads the new papers in your field each day and brings you the few worth reading, each with its key finding in a sentence.