Hyperparameter tuning
15 methods in the atlas attack this one problem. They are rivals: each wins something the others do not.
Phrasings that mean this problem
Hyperparameter tuningBayesian optimizationHigh-dimensional BOCheap-expensive tradeoffConstrained BO
gaussian-processes
- GP-UCBConfidence-bound acquisitionstandardgaussian-processes
- Expected improvementstandalonecanongaussian-processes
- Probability of improvementstandalonestandardgaussian-processes
- Entropy searchInformation-gain acquisitionspecialistgaussian-processes
- Knowledge gradientstandalonespecialistgaussian-processes
- Thompson sampling BOPosterior-draw acquisitionspecialistgaussian-processes
- TuRBOTrust-region Bayesian optimizationspecialistgaussian-processes
- Multi-fidelity Bayesian optimizationstandalonespecialistgaussian-processes
- Bayesian optimization with constraintsConstrained EIspecialistgaussian-processes
model-selection
- Grid searchExhaustive hyperparameter sweepcanonmodel-selection
- Random searchUniform hyperparameter samplingcanonmodel-selection
- HyperbandSuccessive halving allocationstandardmodel-selection
- BOHBBayesian optimization plus Hyperbandspecialistmodel-selection
- Population-based trainingEvolutionary hyperparametersspecialistmodel-selection
- Tree-structured Parzen estimatorDensity-ratio acquisitionstandardmodel-selection