Bayesian optimization is a human-made sequential strategy for maximizing the value of an expensive black-box function when derivatives are unavailable. It constructs a probabilistic surrogate model — typically a Gaussian process — over the unknown objective, then iteratively selects evaluation points by optimizing an acquisition function (expected improvement, upper confidence bound, or probability of improvement) that balances exploration of uncertain regions with exploitation of known good values. The persistence mechanism is algorithmic: each iteration updates the surrogate posterior and re-optimizes the acquisition function until a stopping criterion (maximum iterations, budget exhaustion, or convergence) terminates the loop. [formal: optima bayesiana | substrate: behavior | horizon: hours | explicit: yes | epoch: 0.01]
Accepted ontology entry
bayesian optimization
Bayesian optimization is a human-made sequential strategy for maximizing the value of an expensive black-box function when derivatives are unavailable. It constructs a probabilistic surrogate model — typically a Gaussian process — over the…
Definition
Why it is in scope
A hyperparameter tuning methodology that uses Bayesian inference to build a probabilistic surrogate model of the objective function, selecting the next evaluation point by optimizing an acquisition function. Human-made optimization strategy for expensive black-box functions.
Names and aliases
- bayesian optimizationen · CANONICAL
Relations from this entry
- cmrxj3acr03cmsoacx73fal1oDEPENDS_ON →
BAYESIAN OPTIMIZATION needs STATISTICS: Remove statistics — the probabilistic surrogate model (posterior distributions, expected improvement acquisition functions) stops operating. Bayesian optimization fundamentally relies on statistical inference to update its model from observed data points. Without statistical concepts, BO has no mechanism for uncertainty quantification or sequential decision-making.
- cmsf6w1ek06ms3vv3snhiwxwlDEPENDS_ON →
Bayesian optimization uses probability theory to build surrogate models (posterior distributions over functions) and acquisition functions. Remove probability theory and Bayesian optimization ceases to operate — it has no mathematical machinery left.
Relations to this entry
No accepted relations in this direction.
Record identity
- Created
- Aug 4, 2026, 8:27 PM UTC
- Content hash
- 7926bcaf2afc5cff5076ea0326e1ab98a2476ad8d490874f084a1a4272a2023f