Optuna Examples

This page contains a list of example codes written with Optuna.

Simple Black-box Optimization

• quadratic function

Examples with ML Libraries

• scikit-learn
• Chainer
• ChainerMN
• Dask-ML
• LightGBM
• CatBoost
• MXNet
• PyTorch
• PyTorch Ignite
• PyTorch Lightning
• XGBoost
• Tensorflow
• Tensorflow(eager)
• Keras

An example where an objective function uses additional arguments

The following example demonstrates how to implement an objective function that uses additional arguments other than trial.

• scikit-learn (callable class version)

Examples of Pruning

The following example demonstrates how to implement pruning logic with Optuna.

• simple pruning (scikit-learn)

In addition, integration modules are available for the following libraries, providing simpler interfaces to utilize pruning.

• pruning with Chainer integration module
• pruning with XGBoost integration module
• pruning with LightGBM integration module
• pruning with ChainerMN integration module
• pruning with Tensorflow integration module
• pruning with Keras integration module
• pruning with MXNet integration module
• pruning with PyTorch Ignite integration module

Examples of User-Defined Sampler

• SimulatedAnnealingSampler

Examples of Visualization

• plotting learning curves
• plotting optimization history
• plotting relationship between a parameter and objective value (slice plot)
• plotting relationship between two parameters (contour plot)
• plotting parallel coordinate

Examples of Distributed Optimization

• optimizing on kubernetes