Enhancing Sentiment Classification on Small Datasets through Data Augmentation and Transfer Learning

Abstract

Small-scale sentiment classification often suffers from data scarcity, which limits the generalization ability of the models. This study evaluates and compares the effectiveness of three data augmentation strategies: Easy Data Augmentation (EDA), back-translation, and contextual token substitution (nlpaug-style), with both traditional machine learning classifiers (Logistic Regression, Random Forest) and transformer-based models (BERT). We perform a comprehensive empirical comparison with low-resource sentiment datasets by summarizing the results of recent studies and performing targeted head-to-head experiments. Our findings indicate that all augmentation methods improve performance. Contextual augmentation yields the most consistent gains for BERT models, while EDA and back-translation provide greater benefits for traditional classifiers. These insights help guide the selection of data augmentation techniques tailored to model type and dataset size, filling a critical gap in research on data augmentation for sentiment classification on small datasets.

The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.

More in Machine Learning

• arXiv preprint · 30 October 2026

  MUON-RT Reusing the Teacher's Trajectory for Momentum-Free Muon for LLM Self-Distillation

  Aryan Das, Vinay Kumar Verma and Aakansha Mishra
• arXiv preprint · 31 October 2026

  Spotting the Artificial: Dialogic Humor Improvisation in Humans and LLMs

  Lizeth Palacios Patiño, Ximena Gutierrez-Vasques and Daniel Rodriguez
• arXiv preprint · 30 October 2026

  Language Models Show a "Women-Are-Wonderful" Effect in Blame Attribution That is Not Just Leniency

  Anika Sharma, Snehalkumar 'Neil' S. Gaikwad, Snigdha Chaturvedi and 1 other
• arXiv preprint · 31 October 2026

  Swap, Replicate, Read the Mass: A Protocol for Auditing Demographic Bias in System One Decision Models

  Alejandro Mozo Quesada, Sergio Gálvez Rojas and Francisco López Valverde
• arXiv preprint · 30 October 2026

  HyperRepair: Recovering Forgotten General Capabilities of Fine-Tuned Language Models

  Junrong Tang, Jianghui Wang, Hao Kong and 2 others

All new papers in Machine Learning