Constraint-Aware Discrete Black-Box Optimization Using Tensor Decomposition

Abstract

Discrete black-box optimization is often addressed using approaches such as Sequential Model-Based Optimization (SMBO), which aims to improve sample efficiency by fitting surrogate models that approximate a costly objective function over a discrete search space. In many real-world problems, the set of feasible inputs is often given by logical constraints known in advance. However, existing surrogate modeling techniques generally fail to capture the symbolic rules governing feasibility in discrete input spaces. In this paper, we propose a surrogate modeling approach based on tensor decomposition that captures the structure of discrete search spaces while directly integrating feasibility information. To implement this approach, we formulate surrogate model training as a constrained polynomial optimization problem and solve a relaxed formulation using a differentiable penalty term derived from T-norms. Our experiments on both synthetic and real-world benchmarks, including a pressure vessel design task, demonstrate that the proposed method improves sample efficiency by effectively guiding the search away from infeasible regions.

The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.

More in Machine Learning

• arXiv preprint · 8 September 2026

  Risk-Conditioned Fine-Tuning of Large Language Models

  Zixuan Liu, Fangzheng Wu, Brian Summa and 1 other
• arXiv preprint · 9 September 2026

  A Statistical Approach to Estimating Sample Size of Machine Learning Models

  Dat Phan-Trong, Sunil Gupta and Svetha Venkatesh
• arXiv preprint · 8 September 2026

  A Gradient-based yet Spike-Timing-Dependent Solution to the Feedback Learning Problem in Neural Microcircuits

  Xiangnan Zhang, Jingxin Liu, Ranqi Lu and 6 others
• arXiv preprint · 9 September 2026

  TEFM: Token-Efficient Faithful Modeling for Structured Data

  Zhichao Hou, Lingdao Sha, Xueyu Mao and 3 others
• arXiv preprint · 8 September 2026

  A Machine Learning Framework for Predicting Restaurant Food Waste to Support Sustainable Food Management

  Md Mehedi Hasan Naeem, Md Ashraful Islam, Moumita Barua and 2 others

All new papers in Machine Learning