arXiv preprint ·

A Tutorial on Physics Constrained Machine Learning for Hybrid Modeling, Optimization, and Control

Rahul Golder, Bimol Nath Roy and MM Faruque Hasan

Published
Source
arXiv preprint, posted before peer review
Original
Read it at arXiv
Topics
Machine LearningEmerging Technologies

In brief

Neural Networks That Play by Physics’ Rules

The authors present a tutorial and modular framework called KKT-HardNet, which pairs neural networks with a projection step that enforces algebraic constraints. They describe its use for hybrid modeling, simulation, optimization, and model predictive control, and introduce a projection strategy designed to make training more efficient.

What they found: The work presents a diverse set of benchmarking problems for engineering applications and illustrates potential uses in hybrid modeling, process simulation, optimization, and model predictive control. The code and benchmark datasets are publicly available, making the framework and evaluation materials accessible for follow-up work.

AI-written summary. Check anything you rely on against the original paper.

Abstract

Physics-constrained machine learning (PCML) integrates domain knowledge, first-principles, and physical constraints into AI/ML models. In this work, we present a step-by-step tutorial of a modular PCML framework, KKT-HardNet, and illustrate how it could be used for hybrid modeling, process simulation, optimization and model predictive control in a single platform. KKT-HardNet combines fast inference capabilities of neural networks with guaranteed satisfaction of algebraic constraints through differential projection. It can handle heterogeneous data and enforce both linear and nonlinear equality and inequality constraints. The modular design supports custom neural-network backbones and user-defined projection mechanisms for PCML. To enable efficient end-to-end training, KKT-HardNet exploits implicit function theorem to backpropagate through the projection layer. This avoids computationally expensive automatic differentiation. This work also introduces an exact reduced-order Fischer-Burmeister reformulation and a primal-dual interior-point method as an alternative projection solve strategy. We also provide a diverse set of benchmarking problems for PCML in engineering applications. KKT-HardNet achieves orders of magnitude better performance in terms of both constraint satisfaction and inference time. The KKT-HardNet code and the benchmark datasets are available at https://github.com/souls-tamu/kkt-hardnet .

The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.

Read it on ReadSearch

Each opens after you create an account, and brings you back to this paper.

Already a reader? Sign in

All new papers in Machine Learning

Get the few papers worth your time in Machine Learning every morning.

ReadSearch reads the new papers in your field each day and brings you the few worth reading, each with its key finding in a sentence.

Papers belong to their authors and publishers; every page here links to the original. All research topics