MLP-Initialized Reinforcement Learning for Exit Timing in SPX Short-Straddle Portfolios

Abstract

This paper studies exit timing for SPX short-straddle portfolios using a two-stage supervised and reinforcement-learning framework. Historical episodes first generate ex-post optimal hold/exit labels for training a multilayer perceptron (MLP) using only contemporaneously available state variables at deployment. The trained MLP then initializes reinforcement-learning actors that are fine-tuned with a risk-aware trading reward. Out-of-sample evaluation over 2024-2026 shows that the supervised MLP substantially outperforms passive holding and representative fixed-time and profit-and-loss-based exit rules. Across seven independent seeds, MLP-initialized Actor-Critic averages 37.54% cumulative return and a Sharpe ratio of 1.705, compared with 35.01% and 1.651 for the supervised MLP. Actor-Critic trained from scratch averages only 0.18% return. These findings show that oracle-guided supervised learning provides a stable foundation for reward-based policy fine-tuning in a sparse and path-dependent option-exit problem.

The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.

More in Trading & Market Microstructure

• arXiv preprint · 9 October 2026

  FOMO: FLEX Options and Market Outcomes

  Shivesh Prakash, Frank Ferstler and Nicholas Pezolano
• arXiv preprint · 10 October 2026

  Exact Phase-Type Point Processes for Certified Measurement and Prediction of Event Streams

  Sayak Dutta
• arXiv preprint · 11 October 2026

  Do Rollups Self-Organize? Multi-Agent Reinforcement Learning in the EIP-4844 Blob Fee Market

  Alessio Brini
• arXiv preprint · 8 October 2026

  Diffusive Market Impact: A Consistent Microfoundation

  Julius F. Bonart
• arXiv preprint · 12 October 2026

  Neural Estimation of Irreversibility in Real and Simulated Limit Order Book Paths

  Hyeonjun Yeo, Doohwi Cha and Yoontae Hwang

All new papers in Trading & Market Microstructure