:orphan:

.. _examples:

Examples
========

This page consists of code examples on how to use DeepHyper.




.. raw:: html

    <div class="sphx-glr-thumbnails">

.. thumbnail-parent-div-open

.. thumbnail-parent-div-close

.. raw:: html

    </div>


Black-box optimization
----------------------


.. raw:: html

    <div class="sphx-glr-thumbnails">

.. thumbnail-parent-div-open

.. raw:: html

    <div class="sphx-glr-thumbcontainer" tooltip="Author(s): Romain Egele.">

.. only:: html

  .. image:: /examples/examples_bbo/images/thumb/sphx_glr_plot_experimental_design_thumb.png
    :alt:

  :doc:`/examples/examples_bbo/plot_experimental_design`

.. raw:: html

      <div class="sphx-glr-thumbnail-title">Generating Combinations of Parameters for Standard Experimental Designs</div>
    </div>


.. raw:: html

    <div class="sphx-glr-thumbcontainer" tooltip="In this tutorial, we will explore how to run black-box multi-objective optimization (MOO). In this setting, the goal is to resolve the following problem:">

.. only:: html

  .. image:: /examples/examples_bbo/images/thumb/sphx_glr_plot_multi_objective_optimization_thumb.png
    :alt:

  :doc:`/examples/examples_bbo/plot_multi_objective_optimization`

.. raw:: html

      <div class="sphx-glr-thumbnail-title">Mutli-Objective Black-Box Optimization</div>
    </div>


.. raw:: html

    <div class="sphx-glr-thumbcontainer" tooltip="Author(s): Romain Egele, Brett Eiffert.">

.. only:: html

  .. image:: /examples/examples_bbo/images/thumb/sphx_glr_plot_black_box_optimization_thumb.png
    :alt:

  :doc:`/examples/examples_bbo/plot_black_box_optimization`

.. raw:: html

      <div class="sphx-glr-thumbnail-title">Black-Box Optimization</div>
    </div>


.. raw:: html

    <div class="sphx-glr-thumbcontainer" tooltip="Author(s): Romain Egele.">

.. only:: html

  .. image:: /examples/examples_bbo/images/thumb/sphx_glr_plot_black_box_optimization_noisy_thumb.png
    :alt:

  :doc:`/examples/examples_bbo/plot_black_box_optimization_noisy`

.. raw:: html

      <div class="sphx-glr-thumbnail-title">Noisy Black-Box Optimization</div>
    </div>


.. raw:: html

    <div class="sphx-glr-thumbcontainer" tooltip="Author(s): Romain Egele.">

.. only:: html

  .. image:: /examples/examples_bbo/images/thumb/sphx_glr_plot_constrained_black_box_optimization_thumb.png
    :alt:

  :doc:`/examples/examples_bbo/plot_constrained_black_box_optimization`

.. raw:: html

      <div class="sphx-glr-thumbnail-title">Constrained Black-Box Optimization with Rejection Sampling</div>
    </div>


.. raw:: html

    <div class="sphx-glr-thumbcontainer" tooltip="Author(s): Romain Egele.">

.. only:: html

  .. image:: /examples/examples_bbo/images/thumb/sphx_glr_plot_notify_failures_hpo_thumb.png
    :alt:

  :doc:`/examples/examples_bbo/plot_notify_failures_hpo`

.. raw:: html

      <div class="sphx-glr-thumbnail-title">Learn to Avoid Failures with Bayesian Optimization</div>
    </div>


.. raw:: html

    <div class="sphx-glr-thumbcontainer" tooltip="Author(s): Romain Egele.">

.. only:: html

  .. image:: /examples/examples_bbo/images/thumb/sphx_glr_plot_transfer_learning_for_hpo_thumb.png
    :alt:

  :doc:`/examples/examples_bbo/plot_transfer_learning_for_hpo`

.. raw:: html

      <div class="sphx-glr-thumbnail-title">Using Transfer Learning to Speed-up Bayesian Optimization</div>
    </div>


.. raw:: html

    <div class="sphx-glr-thumbcontainer" tooltip="Author(s): Romain Egele.">

.. only:: html

  .. image:: /examples/examples_bbo/images/thumb/sphx_glr_plot_constrained_black_box_optimization_chained_sampler_thumb.png
    :alt:

  :doc:`/examples/examples_bbo/plot_constrained_black_box_optimization_chained_sampler`

.. raw:: html

      <div class="sphx-glr-thumbnail-title">Constrained Black-Box Optimization with Custom Chained Sampler</div>
    </div>


.. thumbnail-parent-div-close

.. raw:: html

    </div>


Hyperparameter optimization
---------------------------



.. raw:: html

    <div class="sphx-glr-thumbnails">

.. thumbnail-parent-div-open

.. raw:: html

    <div class="sphx-glr-thumbcontainer" tooltip="Author(s): Romain Egele, Brett Eiffert.">

.. only:: html

  .. image:: /examples/examples_hpo/images/thumb/sphx_glr_plot_hpo_text_classification_thumb.png
    :alt:

  :doc:`/examples/examples_hpo/plot_hpo_text_classification`

.. raw:: html

      <div class="sphx-glr-thumbnail-title">Hyperparameter search for text classification</div>
    </div>


.. raw:: html

    <div class="sphx-glr-thumbcontainer" tooltip="Author(s): Romain Egele, Brett Eiffert.">

.. only:: html

  .. image:: /examples/examples_hpo/images/thumb/sphx_glr_plot_hpo_text_classification_with_stopper_thumb.png
    :alt:

  :doc:`/examples/examples_hpo/plot_hpo_text_classification_with_stopper`

.. raw:: html

      <div class="sphx-glr-thumbnail-title">Hyperparameter Optimization for Text Classification with Early Discarding</div>
    </div>


.. raw:: html

    <div class="sphx-glr-thumbcontainer" tooltip="In this example, you will learn how to treat the choice of a learning method as just another hyperparameter. We consider the Random Forest (RF) and Gradient Boosting (GB) classifiers from Scikit-Learn on the Airlines dataset.">

.. only:: html

  .. image:: /examples/examples_hpo/images/thumb/sphx_glr_plot_hpo_for_rf_and_overfitting_thumb.png
    :alt:

  :doc:`/examples/examples_hpo/plot_hpo_for_rf_and_overfitting`

.. raw:: html

      <div class="sphx-glr-thumbnail-title">Hyperparameter optimization and overfitting</div>
    </div>


.. thumbnail-parent-div-close

.. raw:: html

    </div>


Parallelism
-----------



.. raw:: html

    <div class="sphx-glr-thumbnails">

.. thumbnail-parent-div-open

.. raw:: html

    <div class="sphx-glr-thumbcontainer" tooltip="Author(s): Romain Egele, Brett Eiffert.">

.. only:: html

  .. image:: /examples/examples_parallelism/images/thumb/sphx_glr_plot_queued_evaluator_mpi_thumb.png
    :alt:

  :doc:`/examples/examples_parallelism/plot_queued_evaluator_mpi`

.. raw:: html

      <div class="sphx-glr-thumbnail-title">Managing Queued Compute Resources Using Evaluator and MPI Executables</div>
    </div>


.. raw:: html

    <div class="sphx-glr-thumbcontainer" tooltip="Author(s): Romain Egele.">

.. only:: html

  .. image:: /examples/examples_parallelism/images/thumb/sphx_glr_plot_profile_worker_utilization_thumb.png
    :alt:

  :doc:`/examples/examples_parallelism/plot_profile_worker_utilization`

.. raw:: html

      <div class="sphx-glr-thumbnail-title">Profile the Worker Utilization</div>
    </div>


.. raw:: html

    <div class="sphx-glr-thumbcontainer" tooltip="Author(s): Romain Egele.">

.. only:: html

  .. image:: /examples/examples_parallelism/images/thumb/sphx_glr_plot_from_serial_to_parallel_hpo_thumb.png
    :alt:

  :doc:`/examples/examples_parallelism/plot_from_serial_to_parallel_hpo`

.. raw:: html

      <div class="sphx-glr-thumbnail-title">From Sequential to Massively-Parallel Bayesian Optimization</div>
    </div>


.. raw:: html

    <div class="sphx-glr-thumbcontainer" tooltip="Author(s): Romain Egele.">

.. only:: html

  .. image:: /examples/examples_parallelism/images/thumb/sphx_glr_plot_scaling_bo_thumb.png
    :alt:

  :doc:`/examples/examples_parallelism/plot_scaling_bo`

.. raw:: html

      <div class="sphx-glr-thumbnail-title">Scaling Bayesian Optimization with Heterogeneous Parallelism</div>
    </div>


.. thumbnail-parent-div-close

.. raw:: html

    </div>


Uncertainty quantification
--------------------------



.. raw:: html

    <div class="sphx-glr-thumbnails">

.. thumbnail-parent-div-open

.. raw:: html

    <div class="sphx-glr-thumbcontainer" tooltip="Author(s): Romain Egele.">

.. only:: html

  .. image:: /examples/examples_uq/images/thumb/sphx_glr_plot_hpo_tree_ensemble_uq_classification_sklearn_thumb.png
    :alt:

  :doc:`/examples/examples_uq/plot_hpo_tree_ensemble_uq_classification_sklearn`

.. raw:: html

      <div class="sphx-glr-thumbnail-title">Hyperparameter Optimized Ensemble of Random Decision Trees with Uncertainty for Classification</div>
    </div>


.. raw:: html

    <div class="sphx-glr-thumbcontainer" tooltip="Author(s): Romain Egele, Brett Eiffert.">

.. only:: html

  .. image:: /examples/examples_uq/images/thumb/sphx_glr_plot_nas_deep_ensemble_uq_regression_pytorch_thumb.png
    :alt:

  :doc:`/examples/examples_uq/plot_nas_deep_ensemble_uq_regression_pytorch`

.. raw:: html

      <div class="sphx-glr-thumbnail-title">Neural Architecture Search and Deep Ensemble with Uncertainty Quantification for Regression (Pytorch)</div>
    </div>


.. thumbnail-parent-div-close

.. raw:: html

    </div>


.. toctree::
   :hidden:
   :includehidden:


   /examples/examples_bbo/index.rst
   /examples/examples_hpo/index.rst
   /examples/examples_parallelism/index.rst
   /examples/examples_uq/index.rst


.. only:: html

  .. container:: sphx-glr-footer sphx-glr-footer-gallery

    .. container:: sphx-glr-download sphx-glr-download-python

      :download:`Download all examples in Python source code: examples_python.zip </examples/examples_python.zip>`

    .. container:: sphx-glr-download sphx-glr-download-jupyter

      :download:`Download all examples in Jupyter notebooks: examples_jupyter.zip </examples/examples_jupyter.zip>`


.. only:: html

 .. rst-class:: sphx-glr-signature

    `Gallery generated by Sphinx-Gallery <https://sphinx-gallery.github.io>`_