AfriGuard: Safety and Robust Refusal For African Languages

Abstract

Large language models (LLMs) designed to interact with users are typically trained to respond appropriately to harmful or toxic content. However, ensuring appropriate responses becomes more challenging in diverse linguistic and cultural contexts, where safety risks may be expressed or interpreted differently. Building safe AI systems therefore requires detecting safety risks, understanding their nature, and responding appropriately, while accounting for linguistic and cultural variations that add complexity to each stage. In this work, we introduce AfriGuard, a culturally grounded multilingual dataset for studying harmful intent, safety-category understanding, and refusal behavior across 10 African languages and English. Our findings reveal that guardrail models underperform both open- and closed-source LLMs on safety-intent and safety-category classification, while models show limited understanding of appropriate safety behavior, scoring below 60% F1. We further find that models often fail to respond appropriately to unsafe prompts not because they explicitly refuse, but because they produce linguistically inadequate responses that result in incidental non-assistance rather than proper refusals. Finally, using AfriGuard, we develop efficient guardrail models that achieve performance competitive with models up to 30x larger, introduce refusal detectors that improve average performance by 43.9% over existing detectors, and demonstrate that supervised fine-tuning can substantially improve overall safety performance.

The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.

More in Computation & Language / NLP

• arXiv preprint · 19 October 2026

  Cognitive Maps in Large Language Models

  Albert Qin, Jonathan Cohen and Gautam Reddy
• arXiv preprint · 20 October 2026

  The Router Already Knows

  Andrew Bistras and Marty Johnson
• arXiv preprint · 19 October 2026

  Text Dominance in Paralinguistic Conflict: Tracing Suppression Through Audio LLM Circuits

  Ankur Banerjee, Vishnu Guntakala, Danity Pike and 3 others
• arXiv preprint · 20 October 2026

  Harness Self-Evolution for Long-Horizon Terminal Agents

  Ruhan Wang, Yucheng Shi, Zongxia Li and 6 others
• arXiv preprint · 19 October 2026

  Curriculum Learning Teaches LLMs Long-Horizon Implicit Reasoning, Up To A Limit

  Jimson Huang, Maxwell Nickell, Ruowang Zhang and 1 other

All new papers in Computation & Language / NLP