How-to | Distributed hyperparameter search #
Optimizing ML algorithm hyperparameters is a numbers game; the more options you explore, the higher likelihood of landing on the best model. Learn how to distribute hyperparameter computations across your Kubernetes cluster.
You will need a Dataiku instance set up to run with containerized execution and permission to run on that configuration.
-
When training the model, you need to select a containerized execution configuration on the Runtime environment panel of the Design tab.
-
On the Hyperparameters panel, choose to distribute the hyperparameter search and select the number of Kubernetes containers you wish to use.
-
When you train the model, the Results page during training displays the containers spinning up and shutting back down. It otherwise proceeds and produces output normally.