Search Spaces & Budgets
Search Spaces & Budgets groups the core ideas a learner needs at the 8 · hyperparameter optimisation & model selection stage. Work through the lessons in order when new to the area, or use them independently as a reference when implementing an analysis.
Learn the mechanism one decision at a time
Work through the lessons in order if the topic is new. If you already know the basics, open the specific leaf lesson that matches the operation, diagnostic or failure mode you need.
1Definition→
2Mechanism→
3Example→
4Diagnostic→
5Decision
Hyperparameter vs learned parameterHyperparameter vs learned parameter is a practical concept within Search Spaces & Budgets. It helps turn the broader workflow stage “8 · Hyperparameter Optimisation & Model Selection” into an explicit analytical decision that can be explained, implemented and checked. The concept should be understood in terms of purpose, mechanism, assumptions, evidence and downstream consequences.
02Linear vs logarithmic rangesLinear vs logarithmic ranges represents a family or practice in model building. The central idea is to define what structure can be learned, how model quality is measured during fitting, and how generalisation is tested on observations not used to choose the model.
03Conditional parametersConditional parameters is a practical concept within Search Spaces & Budgets. It helps turn the broader workflow stage “8 · Hyperparameter Optimisation & Model Selection” into an explicit analytical decision that can be explained, implemented and checked. The concept should be understood in terms of purpose, mechanism, assumptions, evidence and downstream consequences.
04Search budgetSearch budget is a practical concept within Search Spaces & Budgets. It helps turn the broader workflow stage “8 · Hyperparameter Optimisation & Model Selection” into an explicit analytical decision that can be explained, implemented and checked. The concept should be understood in terms of purpose, mechanism, assumptions, evidence and downstream consequences.
05Cross-validation costCross-validation cost is a practical concept within Search Spaces & Budgets. It helps turn the broader workflow stage “8 · Hyperparameter Optimisation & Model Selection” into an explicit analytical decision that can be explained, implemented and checked. The concept should be understood in terms of purpose, mechanism, assumptions, evidence and downstream consequences.
06ParallelismParallelism is a practical concept within Search Spaces & Budgets. It helps turn the broader workflow stage “8 · Hyperparameter Optimisation & Model Selection” into an explicit analytical decision that can be explained, implemented and checked. The concept should be understood in terms of purpose, mechanism, assumptions, evidence and downstream consequences.
07Reproducible tuningReproducible tuning is a practical concept within Search Spaces & Budgets. It helps turn the broader workflow stage “8 · Hyperparameter Optimisation & Model Selection” into an explicit analytical decision that can be explained, implemented and checked. The concept should be understood in terms of purpose, mechanism, assumptions, evidence and downstream consequences.