arXiv preprint ·
When the implementation matters more than the algorithm: NSGA-II and other multi-objective optimizers in engineering design tools
- Published
- Source
- arXiv preprint, posted before peer review
- Original
- Read it at arXiv
- Topics
Abstract
Engineering design tools increasingly embed optimizers as ready-made components that users select by algorithm name, while operator settings and bound, integer and duplicate handling stay fixed inside each tool. This study tests whether the name predicts the result. A tool-agnostic harness exposes one deterministic black box, an emulator of a published 22-variable mixed-integer building-performance problem, to the native optimizers of three Grasshopper plug-ins, to canonical NSGA-II, SMS-EMOA and GDE3 from Python libraries, and to the model-based RBFMOpt. Eighteen configurations were run at 5,000 evaluations under three population allocations, with statistics fixed in advance. Four NSGA-II implementations differed by up to 5% in hypervolume, more than three canonical algorithms of different families differed from one another, and their response to population size differed by up to 10 percentage points; for two MOEA/D implementations, by 28. On ZDT test functions the same NSGA-II implementations differed up to 470-fold in IGD. An ablation in one open-source NSGA-II reproduced the behaviour of one tool from its documented settings but not the gaps of the other two, so documented parameters do not identify an implementation. Counting the budget in wall-clock time reversed the ranking of the model-based optimizer, and reporting the final population instead of the archive understated some configurations by up to a third; most differences fell below the surrogate's error. For optimizers embedded in design-support systems, the implementation is part of the method; a reporting checklist is derived: implementation and version, effective settings, budget in time and evaluations, and archive-based indicators.
The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.
Read it on ReadSearch
Each opens after you create an account, and brings you back to this paper.
More in Neural & Evolutionary Computing
Recognition Is Not Grounding: Benchmarking Multilingual Financial Evidence Extraction
Graphlet-based Decentralized Finance Transaction Method Classification
MolLean: A Process-Verifiable Language for Chemical Reasoning
Evaluating Predictor-Corrector Dependence in Hard-Constrained Climate Emulators
Learning Topology-Aware Representations for Mechanics-Relevant TPMS Metamaterials
Get the few papers worth your time in Neural & Evolutionary Computing every morning.
ReadSearch reads the new papers in your field each day and brings you the few worth reading, each with its key finding in a sentence.