arXiv preprint ·
Alignment via Generalization
- Published
- Source
- arXiv preprint, posted before peer review
- Original
- Read it at arXiv
- Topics
Abstract
AI systems can become better at achieving the goals we give them without becoming better at doing what we actually want. Studying this alignment problem rigorously requires a framework connecting measurable performance to intended behavior. We propose Aligned-PAC learning, whose central idea is to reduce alignment to generalization: does success on the requirements used for training extend to requirements the system has not encountered? Rather than express our entire intention through a single training objective, we represent its different aspects through a collection of specific requirements. This perspective already yields strong theoretical results. We show how independent evaluation can provide rigorous evidence of alignment across the represented requirements, and establish how much evaluation is needed. We also develop an optimization method that, under explicit assumptions, combines learned models to satisfy the training requirements. The framework does not solve alignment in full: choosing requirements that faithfully capture our intentions, and understanding when learning will generalize to unseen requirements, remain open challenges. It provides a foundation for making these questions precise and studying them with the tools of learning theory.
The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.
Read it on ReadSearch
Each opens after you create an account, and brings you back to this paper.
More in Machine Learning
Continual Learning Exam: Benchmarking Long-Horizon RSI and Experiential Learning in LLM Agents
Dream to Assist: Intent-Conditioned World Models for Shared Vehicle Control
A Nonconvex Framework for Joint Sparse Sample Weighting and Parameter Estimation
AdaTutor: Adaptive Tutoring through Pedagogical Strategy Selection
How Do Small Coding Agents Use Code Graphs and Embeddings?
Get the few papers worth your time in Machine Learning every morning.
ReadSearch reads the new papers in your field each day and brings you the few worth reading, each with its key finding in a sentence.