arXiv preprint ·
On Stochastic Continuous-Time Linear System Identification for Adaptive Stabilization
- Published
- Source
- arXiv preprint, posted before peer review
- Original
- Read it at arXiv
- Topics
Abstract
Learning to stabilize an unknown continuous-time stochastic linear system is a central problem in control theory and reinforcement learning. This paper numerically studies data-driven identification of such systems with possibly unstable dynamics for the purpose of stabilization. We present a method that learns a stabilizing gain from observed trajectories, and examine how the failure probability, namely the probability that the learned gain does not stabilize the system, depends on the amount of data, dimension, noise intensity, excitation, and controllability. Numerical experiments on an unstable batch-reactor benchmark show that the squared identification error decays inversely with the aggregate observation time, that is, the combined length of all trajectories, while the failure probability decays exponentially in the same quantity. Hence, despite instability, a single long trajectory can achieve similar stabilization performance to that of many short trajectories of the same total length. We also observe \emph{signal saturation}: stronger excitation improves stabilization only logarithmically with the excitation strength. Finally, we show experimentally that accurate identification of the full dynamics is \emph{not} necessary for successful stabilization.
The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.
Read it on ReadSearch
Each opens after you create an account, and brings you back to this paper.
More in Machine Learning (Statistics)
Nonparametric GARCH: An Iterated Neural Estimator
Efficient Proper Agnostic Learning of Halfspaces
Descending Everest, Part II: Oracle Complexity of Minimizing a Sum of Convex $(L_0,L_1)$-Smooth Functions
Where Is a Prediction Model Miscalibrated, and for Whom? Local Audits in Outcome-Learned Pockets
Statistical Machine Learning for Medicinal Plant Leaves Classification
Get the few papers worth your time in Machine Learning (Statistics) every morning.
ReadSearch reads the new papers in your field each day and brings you the few worth reading, each with its key finding in a sentence.