arXiv preprint ·
Lightweight Machine Learning for Classifying Disaster-Related Social Media Posts
- Published
- Source
- arXiv preprint, posted before peer review
- Original
- Read it at arXiv
- Topics
Abstract
Classifying disaster-related social-media posts into humanitarian information labels is challenging because individual messages are typically short and context-limited, humanitarian categories can overlap semantically, and the CrisisBench label distribution is strongly imbalanced. This study investigates whether lightweight lexical machine-learning methods can provide effective and computationally efficient classification under these conditions. Using the CrisisBench v1.0 English humanitarian task, comprising 87,455 records across predefined Train, Development and Test splits, we conduct a controlled comparison of TF-IDF representations and lightweight classifiers, with Macro-F1 as the primary model-selection metric. Beyond aggregate predictive performance, the study jointly examines per-label behaviour, directional error patterns, relative decision margins, computational requirements, and the effect of domain-specific training through a tropical-cyclone specialist model. The selected balanced LinearSVC with unigram-bigram TF-IDF and C=0.5 achieved an Accuracy of 0.8282, a Macro-F1 of 0.6578 and a Weighted-F1 of 0.8315 on the held-out Test split. Lower decision margins were substantially associated with prediction errors, while the tropical-cyclone specialist achieved modestly higher in-domain aggregate performance with substantially lower feature and fitting requirements. The study contributes a controlled, label-sensitive and resource-aware evaluation of lightweight humanitarian text classification that characterises not only aggregate performance, but also where these models fail and how their behaviour changes under domain-specific training.
The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.
Read it on ReadSearch
Each opens after you create an account, and brings you back to this paper.
More in Networking & Internet
Blackbox Performance Analysis of LLM-based Network Control
A Dual-Uplink Dual-Satellite Architecture for Entanglement Distribution
K-AoI: A Spatio-Temporal Synchronization Metric for Digital Twin-based Teleoperation in Dynamic Network Environments
Preventing Data Hallucinations in Agentic AI for Optical Network Troubleshooting
Robust Lightweight IoT Device Fingerprinting Under Network Traffic Anomalies
Get the few papers worth your time in Networking & Internet every morning.
ReadSearch reads the new papers in your field each day and brings you the few worth reading, each with its key finding in a sentence.