arXiv preprint ·
Endogenous Exploration in Reinforcement Learning with Intrinsic Curiosity
- Published
- Source
- arXiv preprint, posted before peer review
- DOI
- 10.20944/preprints202608.1449.v1
- Original
- Read it at arXiv
- Topics
Abstract
We propose a reinforcement learning framework in which exploration is driven by intrinsic curiosity, designed for scenarios where environments are non-stationary and rewards are sparse, delayed, uninformative, or absent. In our model, action selection is guided by a combination of external rewards and an epistemic motivation mechanism that biases the agent toward structured exploratory directions. The central hypothesis is that effective exploration emerges at intermediate levels of incoherence, while performance degrades under both overly rigid and overly disordered dynamics. To test this idea, we implement the framework on top of a Liquid State Machine (LSM) substrate and evaluate it on two standard benchmarks: the discrete-action LunarLanderv2 and the continuous-control BipedalWalkerv3. The proposed method achieves competitive performance on both tasks relative to established deep RL algorithms, including Proximal Policy Optimization (PPO) and Intrinsic Curiosity Module (ICM). We further show that the curiosity window is not recovered in Active Inference agents under the same analysis, suggesting that the proposed dynamics capture a distinct exploration regime
The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.
Read it on ReadSearch
Each opens after you create an account, and brings you back to this paper.
More in Machine Learning
Beyond Homoscedasticity: Decoupled Uncertainty Optimization for Deep Imbalanced Regression
Nonlinear elliptic homogenization with the parametric Deep Ritz method
Solution-space heterogeneity shapes federated learning dynamics across partial differential equations
Diagonal Attenuation: A Finite-Sample Correction for PCA
Amortizing Scaling Law Construction Costs
Get the few papers worth your time in Machine Learning every morning.
ReadSearch reads the new papers in your field each day and brings you the few worth reading, each with its key finding in a sentence.