Integrable building blocks for symplectic neural networks: learned-type layers, fiber-preserving layers, and what a single layer can do

Abstract

Exactly symplectic neural networks are built almost exclusively from shear maps and gain expressivity only through depth. We ask what else a single explicit symplectic layer can be. Observing that every layer in use is the exact flow of a Hamiltonian that is a function of commuting integrals, we obtain three families of layers: a learned-type layer, in which every conjugate pair is rotated, squeezed or sheared by a state-dependent amount and the type is found by training; moving-plane shears, residual symplectic maps outside the known ridge-function class; and fiber-preserving layers, which combine an unconstrained point transformation with a fiber translation at the cost of one linear solve. We characterize residual symplectic layers $x \mapsto x + J\nabla H(x)$: in one degree of freedom they are exactly the shears along a line, while from two degrees of freedom on a strictly larger class exists. Conjugating a learned-type layer by a symplectic network yields an exact one-parameter group with an exactly conserved learned Hamiltonian. In experiments on sixteen systems with one to forty degrees of freedom, against SympNets, HénonNets and learned-plane shear networks, layers built on nonlinear integrals are far more accurate when the Hamiltonian contains functions of those integrals. On nonlinear Schrödinger lattices with six to forty sites, twist layers alternating with linear symplectic maps are over a hundred times more accurate than every shear-based network, and with an on-site potential of learned form three to four orders of magnitude more accurate. On chains of Tao oscillators with the step size as an input, stretch layers are 45 to 70 times more accurate than learned-plane shears and recover the Hamiltonian to 1%. On generic non-separable systems, fiber layers improve on learned-plane shears by at most a factor of two, and widening the networks does not help any architecture.

The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.

More in Numerical Analysis

• arXiv preprint · 19 October 2026

  Non-planar contact structures with Calabi-Yau Fillings and topological quantum computation

  Atsuhide Mori
• arXiv preprint · 24 September 2026

  Planar Contact Structures with Calabi-Yau Fillings and Topological Quantum Computation

  Atsuhide Mori
• arXiv preprint · 22 October 2026

  SympFormer: Inertial Attention Blocks from Damped Hamiltonian Dynamics on Spaces of Probability Measures

  Viktor Stein, Levin Maier, Wuchen Li and 1 other
• arXiv preprint · 17 September 2026

  Special Lagrangian cones in Deep Learning

  Tejas Kotwal and Govind Menon
• arXiv preprint · 18 October 2026

  LowNet: Looped Wavelet Neural Networks with 24 Learnable Parameters for Solving Poisson Equations

  Yuanhao Gong

All new papers in Numerical Analysis