arXiv preprint ·
MemeTAG: Keyword-Driven Meme Classification through Tag Embedding Reconstruction
- Published
- Source
- arXiv preprint, posted before peer review
- DOI
- 10.1109/WACV61042.2026.00741
- Original
- Read it at arXiv
- Topics
Abstract
The proliferation of harmful internet memes poses a significant societal threat, yet their automated classification remains a formidable algorithmic challenge due to the nuanced, multimodal nature of their content. To address this, we introduce MemeTAG, a novel dual-objective framework that pioneers a keyword-aware approach to meme classification. Our core innovation is a two-part semantic guidance mechanism: first, we leverage a pretrained Vision-Language Model to generate a set of descriptive keywords, that capture the high-level semantics. Second, we introduce the Aggregated Tag Inference Network (ATIN), an attention-based module that distills these keywords into a single, rich semantic embedding. This embedding serves as a target for a novel auxiliary reconstruction loss, which compels the model to learn deeply aligned visual and textual features. This approach, combined with an efficient three-stage training strategy, establishes a new state-of-the-art on the HarMeme, Hateful Memes Challenge (HMC), and PrideMM datasets, decisively outperforming existing state-of-the-art methods.
The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.
Read it on ReadSearch
Each opens after you create an account, and brings you back to this paper.
More in Computer Vision
BinoGen: Scaling egocentric binocular data for embodied visual perception and learning
Omni Demand Understanding: A Benchmark for Contextual User-Intent Inference in Multimodal Interaction
The Spoken Wikipedia Presentation Corpus
Visual Autoregressive Priors for RAW-to-sRGB Image Signal Processing
Style as Cover: Deep Image Steganography via Stylized Transmission
Get the few papers worth your time in Computer Vision every morning.
ReadSearch reads the new papers in your field each day and brings you the few worth reading, each with its key finding in a sentence.