arXiv preprint ·
Optimal portfolio and consumption under no-shorting constraints: The exploratory formulation and reinforcement learning
- Published
- Source
- arXiv preprint, posted before peer review
- Original
- Read it at arXiv
- Topics
Abstract
We develop a reinforcement-learning framework for the continuous-time optimal portfolio-consumption via utility maximization under no-shorting portfolio constraints. We adopt the exploratory formulation under entropy regularization and impose no-shorting constraint through a componentwise nonnegative conditional-mean constraint on the class of admissible randomized policies, while the sampled actions are allowed to be negative during the training. For CRRA utility, we derive the homothetic value function and the optimal Gaussian portfolio and Gibbs consumption policies under some model conditions and establish a verification theorem. These results allow compatible parameterizations in actor, critic, and $q$ functions for a constrained policy-iteration algorithm. Policy evaluation uses trajectory-based moment conditions, and policy improvement uses fitted coefficients to solve a convex quadratic program over the nonnegative orthant without requiring market coefficients as inputs. The mean constraint preserves tractable Gaussian exploration throughout parameter learning, while modal deployment converts the learned randomized policies into deterministic controls. In particular, the Gaussian mode coincides with its constrained mean and hence satisfies no-shorting constraint, and the Gibbs mode determines the deployed consumption rule.
The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.
Read it on ReadSearch
Each opens after you create an account, and brings you back to this paper.
More in Portfolio Management
Non-asymptotic analysis of SGLD with discontinuous stochastic gradients: a new route to portfolio CVaR minimization
Interpretable Allocation and Model-Predictive Rebalancing of Equity Portfolios, Tested on Real and Synthetic Markets
Specification LASSO and a Flexible Characteristics-Based Asset Pricing Model
Sparse Autoencoders as Implicit Diversification Regularisers for Cross-Sectional Cryptocurrency Returns
Penalize the Common Trade: A Collision-Aware Layer for Learned Portfolios
Get the few papers worth your time in Portfolio Management every morning.
ReadSearch reads the new papers in your field each day and brings you the few worth reading, each with its key finding in a sentence.