arXiv preprint ·
The Language of Instruction: Genre and Generative AI
- Published
- Source
- arXiv preprint, posted before peer review
- Original
- Read it at arXiv
- Topics
Abstract
This article argues that instruction-fine-tuned language models should be understood as implementing a genre, what is proposed as the instructional-conversational genre. This genre is an amalgamation of discursive language from prior conversations between generative models and humans recursively run through these massive neural networks. It is instantiated in applications through instruction fine-tuning, the inclusion of a pretext known as a system prompt, and the formalization of inputs in mark-up languages characterized by the use of special tokens and role assignment in turntaking structures.
The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.
Read it on ReadSearch
Each opens after you create an account, and brings you back to this paper.
More in Computation & Language / NLP
Thumb on the scale: Using traditional wargaming adjudication practices to improve AI-judged evaluations and grading
Propasafe-Hybrid: A Text-Based Hybrid Propaganda Detection Tool
Playing Bias: Epistemic Games for Interpreting Text-to-Image Models
Incremental Predictive Value of LLM Tutoring Interactions for Student Performance
Forging Emotions: a deep learning experiment on emotions and art
Get the few papers worth your time in Computation & Language / NLP every morning.
ReadSearch reads the new papers in your field each day and brings you the few worth reading, each with its key finding in a sentence.