Applying Transfer Learning to Black-Box Optimization

Author(s): Romain Egele.

In this example, we demonstrate how to leverage transfer learning for hyperparameter optimization. Imagine you are working on multiple related tasks, such as optimizing the hyperparameters of neural networks for various datasets. It’s reasonable to expect that similar hyperparameter configurations might perform well across these datasets, even if some minor adjustments are needed to fine-tune performance.

By conducting a thorough (and potentially expensive) search on one task, you can reuse the resulting hyperparameter set to guide and accelerate optimization for subsequent tasks. This approach reduces computational costs while maintaining high performance.

To illustrate, we will use a simple and computationally inexpensive example: minimizing the function \(f(x) = \sum_{i=0}^ {n-1}\). Here, the difficulty of the problem is defined by the number of variables \(n\). We will start by optimizing the small problem where \(n=5\). Then, we will apply transfer learning to optimize a larger problem where \(n=10\), comparing the results with and without transfer learning to highlight the benefits.

Let’s begin by defining the run-functions for both the small-scale and large-scale problems:

Code (Import statements)

import functools

import matplotlib.pyplot as plt

from deephyper.analysis import figure_size
from deephyper.analysis.hpo import plot_search_trajectory_single_objective_hpo
from deephyper.evaluator import Evaluator
from deephyper.evaluator.callback import TqdmCallback
from deephyper.hpo import CBO, HpProblem

WIDTH_PLOTS = 8
HEIGHT_PLOTS = WIDTH_PLOTS / 1.618

def run(job, N: int) -> float:
    # Definition of the function to minimize
    y = sum([job.parameters[f"x{i}"] ** 2 for i in range(N)])
    return -y  # Use the `-` sign to perform minimization


n_small = 5
n_large = 10
run_small = functools.partial(run, N=n_small)
run_large = functools.partial(run, N=n_large)

Then, we can define the hyperparameter problem space based on \(n\)

def create_problem(n):
    problem = HpProblem()
    for i in range(n):
        problem.add_hyperparameter((-10.0, 10.0), f"x{i}")
    return problem

problem_small = create_problem(n_small)

problem_large = create_problem(n_large)

We define the parameters of the search:

search_kwargs = {
    "acq_optimizer": "ga", # Optimizing the acquisition function with countinuous genetic algorithm
    "random_state": 42,
}

We create a dictionnary that will store the results of each experiment and also fix the number of evaluation of the search to 200.

results = {}
max_evals = 200

Then, we run the search for each problem. We start with the small problem:

evaluator_small = Evaluator.create(
    run_small,
    method="thread",
    method_kwargs={"callbacks": [TqdmCallback("HPO - Small Problem")]},
)

search_small = CBO(
    problem_small,
    evaluator_small,
    **search_kwargs,
)
results_small = search_small.search(max_evals)

WARNING:root:Results file already exists, it will be renamed to /Users/romainegele/Documents/DeepHyper/deephyper/examples/examples_bbo/results_20250326-115048.csv

  0%|          | 0/200 [00:00<?, ?it/s]
HPO - Small Problem:   0%|          | 0/200 [00:00<?, ?it/s]
HPO - Small Problem:   0%|          | 1/200 [00:00<00:00, 2723.57it/s, failures=0, objective=-125]
HPO - Small Problem:   1%|          | 2/200 [00:00<00:02, 87.49it/s, failures=0, objective=-125]
HPO - Small Problem:   2%|▏         | 3/200 [00:00<00:02, 70.46it/s, failures=0, objective=-125]
HPO - Small Problem:   2%|▏         | 4/200 [00:00<00:02, 65.34it/s, failures=0, objective=-102]
HPO - Small Problem:   2%|▎         | 5/200 [00:00<00:03, 61.94it/s, failures=0, objective=-102]
HPO - Small Problem:   3%|▎         | 6/200 [00:00<00:03, 59.96it/s, failures=0, objective=-102]
HPO - Small Problem:   3%|▎         | 6/200 [00:00<00:03, 59.96it/s, failures=0, objective=-74]
HPO - Small Problem:   4%|▎         | 7/200 [00:00<00:03, 59.96it/s, failures=0, objective=-68.1]
HPO - Small Problem:   4%|▍         | 8/200 [00:00<00:03, 59.96it/s, failures=0, objective=-68.1]
HPO - Small Problem:   4%|▍         | 9/200 [00:00<00:03, 59.96it/s, failures=0, objective=-68.1]
HPO - Small Problem:   5%|▌         | 10/200 [00:00<00:03, 59.96it/s, failures=0, objective=-68.1]
HPO - Small Problem:   6%|▌         | 11/200 [00:00<00:03, 59.96it/s, failures=0, objective=-68.1]
HPO - Small Problem:   6%|▌         | 12/200 [00:00<00:08, 22.55it/s, failures=0, objective=-68.1]
HPO - Small Problem:   6%|▌         | 12/200 [00:00<00:08, 22.55it/s, failures=0, objective=-68.1]
HPO - Small Problem:   6%|▋         | 13/200 [00:00<00:08, 22.55it/s, failures=0, objective=-68.1]
HPO - Small Problem:   7%|▋         | 14/200 [00:00<00:08, 22.55it/s, failures=0, objective=-68.1]
HPO - Small Problem:   8%|▊         | 15/200 [00:01<00:08, 22.55it/s, failures=0, objective=-68.1]
HPO - Small Problem:   8%|▊         | 16/200 [00:01<00:16, 11.12it/s, failures=0, objective=-68.1]
HPO - Small Problem:   8%|▊         | 16/200 [00:01<00:16, 11.12it/s, failures=0, objective=-68.1]
HPO - Small Problem:   8%|▊         | 17/200 [00:01<00:16, 11.12it/s, failures=0, objective=-68.1]
HPO - Small Problem:   9%|▉         | 18/200 [00:01<00:16, 11.12it/s, failures=0, objective=-68.1]
HPO - Small Problem:  10%|▉         | 19/200 [00:01<00:19,  9.06it/s, failures=0, objective=-68.1]
HPO - Small Problem:  10%|▉         | 19/200 [00:01<00:19,  9.06it/s, failures=0, objective=-68.1]
HPO - Small Problem:  10%|█         | 20/200 [00:01<00:19,  9.06it/s, failures=0, objective=-68.1]
HPO - Small Problem:  10%|█         | 21/200 [00:01<00:21,  8.23it/s, failures=0, objective=-68.1]
HPO - Small Problem:  10%|█         | 21/200 [00:01<00:21,  8.23it/s, failures=0, objective=-68.1]
HPO - Small Problem:  11%|█         | 22/200 [00:02<00:21,  8.23it/s, failures=0, objective=-68.1]
HPO - Small Problem:  12%|█▏        | 23/200 [00:02<00:23,  7.66it/s, failures=0, objective=-68.1]
HPO - Small Problem:  12%|█▏        | 23/200 [00:02<00:23,  7.66it/s, failures=0, objective=-68.1]
HPO - Small Problem:  12%|█▏        | 24/200 [00:02<00:26,  6.70it/s, failures=0, objective=-68.1]
HPO - Small Problem:  12%|█▏        | 24/200 [00:02<00:26,  6.70it/s, failures=0, objective=-65.5]
HPO - Small Problem:  12%|█▎        | 25/200 [00:02<00:26,  6.62it/s, failures=0, objective=-65.5]
HPO - Small Problem:  12%|█▎        | 25/200 [00:02<00:26,  6.62it/s, failures=0, objective=-65.5]
HPO - Small Problem:  13%|█▎        | 26/200 [00:02<00:26,  6.52it/s, failures=0, objective=-65.5]
HPO - Small Problem:  13%|█▎        | 26/200 [00:02<00:26,  6.52it/s, failures=0, objective=-65.5]
HPO - Small Problem:  14%|█▎        | 27/200 [00:03<00:26,  6.42it/s, failures=0, objective=-65.5]
HPO - Small Problem:  14%|█▎        | 27/200 [00:03<00:26,  6.42it/s, failures=0, objective=-65.5]
HPO - Small Problem:  14%|█▍        | 28/200 [00:03<00:27,  6.35it/s, failures=0, objective=-65.5]
HPO - Small Problem:  14%|█▍        | 28/200 [00:03<00:27,  6.35it/s, failures=0, objective=-65.5]
HPO - Small Problem:  14%|█▍        | 29/200 [00:03<00:27,  6.29it/s, failures=0, objective=-65.5]
HPO - Small Problem:  14%|█▍        | 29/200 [00:03<00:27,  6.29it/s, failures=0, objective=-65.5]
HPO - Small Problem:  15%|█▌        | 30/200 [00:03<00:27,  6.24it/s, failures=0, objective=-65.5]
HPO - Small Problem:  15%|█▌        | 30/200 [00:03<00:27,  6.24it/s, failures=0, objective=-65.5]
HPO - Small Problem:  16%|█▌        | 31/200 [00:03<00:27,  6.21it/s, failures=0, objective=-65.5]
HPO - Small Problem:  16%|█▌        | 31/200 [00:03<00:27,  6.21it/s, failures=0, objective=-65.5]
HPO - Small Problem:  16%|█▌        | 32/200 [00:03<00:26,  6.23it/s, failures=0, objective=-65.5]
HPO - Small Problem:  16%|█▌        | 32/200 [00:03<00:26,  6.23it/s, failures=0, objective=-65.5]
HPO - Small Problem:  16%|█▋        | 33/200 [00:04<00:27,  6.01it/s, failures=0, objective=-65.5]
HPO - Small Problem:  16%|█▋        | 33/200 [00:04<00:27,  6.01it/s, failures=0, objective=-65.5]
HPO - Small Problem:  17%|█▋        | 34/200 [00:04<00:27,  6.07it/s, failures=0, objective=-65.5]
HPO - Small Problem:  17%|█▋        | 34/200 [00:04<00:27,  6.07it/s, failures=0, objective=-65.5]
HPO - Small Problem:  18%|█▊        | 35/200 [00:04<00:28,  5.74it/s, failures=0, objective=-65.5]
HPO - Small Problem:  18%|█▊        | 35/200 [00:04<00:28,  5.74it/s, failures=0, objective=-38.8]
HPO - Small Problem:  18%|█▊        | 36/200 [00:04<00:28,  5.74it/s, failures=0, objective=-38.8]
HPO - Small Problem:  18%|█▊        | 36/200 [00:04<00:28,  5.74it/s, failures=0, objective=-38.8]
HPO - Small Problem:  18%|█▊        | 37/200 [00:04<00:33,  4.87it/s, failures=0, objective=-38.8]
HPO - Small Problem:  18%|█▊        | 37/200 [00:04<00:33,  4.87it/s, failures=0, objective=-38.8]
HPO - Small Problem:  19%|█▉        | 38/200 [00:05<00:32,  5.05it/s, failures=0, objective=-38.8]
HPO - Small Problem:  19%|█▉        | 38/200 [00:05<00:32,  5.05it/s, failures=0, objective=-37]
HPO - Small Problem:  20%|█▉        | 39/200 [00:05<00:30,  5.26it/s, failures=0, objective=-37]
HPO - Small Problem:  20%|█▉        | 39/200 [00:05<00:30,  5.26it/s, failures=0, objective=-37]
HPO - Small Problem:  20%|██        | 40/200 [00:05<00:29,  5.36it/s, failures=0, objective=-37]
HPO - Small Problem:  20%|██        | 40/200 [00:05<00:29,  5.36it/s, failures=0, objective=-37]
HPO - Small Problem:  20%|██        | 41/200 [00:05<00:29,  5.44it/s, failures=0, objective=-37]
HPO - Small Problem:  20%|██        | 41/200 [00:05<00:29,  5.44it/s, failures=0, objective=-37]
HPO - Small Problem:  21%|██        | 42/200 [00:05<00:28,  5.62it/s, failures=0, objective=-37]
HPO - Small Problem:  21%|██        | 42/200 [00:05<00:28,  5.62it/s, failures=0, objective=-37]
HPO - Small Problem:  22%|██▏       | 43/200 [00:05<00:27,  5.75it/s, failures=0, objective=-37]
HPO - Small Problem:  22%|██▏       | 43/200 [00:05<00:27,  5.75it/s, failures=0, objective=-37]
HPO - Small Problem:  22%|██▏       | 44/200 [00:06<00:26,  5.85it/s, failures=0, objective=-37]
HPO - Small Problem:  22%|██▏       | 44/200 [00:06<00:26,  5.85it/s, failures=0, objective=-37]
HPO - Small Problem:  22%|██▎       | 45/200 [00:06<00:26,  5.75it/s, failures=0, objective=-37]
HPO - Small Problem:  22%|██▎       | 45/200 [00:06<00:26,  5.75it/s, failures=0, objective=-37]
HPO - Small Problem:  23%|██▎       | 46/200 [00:06<00:26,  5.71it/s, failures=0, objective=-37]
HPO - Small Problem:  23%|██▎       | 46/200 [00:06<00:26,  5.71it/s, failures=0, objective=-37]
HPO - Small Problem:  24%|██▎       | 47/200 [00:06<00:26,  5.81it/s, failures=0, objective=-37]
HPO - Small Problem:  24%|██▎       | 47/200 [00:06<00:26,  5.81it/s, failures=0, objective=-28.4]
HPO - Small Problem:  24%|██▍       | 48/200 [00:06<00:25,  5.89it/s, failures=0, objective=-28.4]
HPO - Small Problem:  24%|██▍       | 48/200 [00:06<00:25,  5.89it/s, failures=0, objective=-28.4]
HPO - Small Problem:  24%|██▍       | 49/200 [00:07<00:29,  5.07it/s, failures=0, objective=-28.4]
HPO - Small Problem:  24%|██▍       | 49/200 [00:07<00:29,  5.07it/s, failures=0, objective=-28.4]
HPO - Small Problem:  25%|██▌       | 50/200 [00:07<00:28,  5.32it/s, failures=0, objective=-28.4]
HPO - Small Problem:  25%|██▌       | 50/200 [00:07<00:28,  5.32it/s, failures=0, objective=-28.4]
HPO - Small Problem:  26%|██▌       | 51/200 [00:07<00:27,  5.43it/s, failures=0, objective=-28.4]
HPO - Small Problem:  26%|██▌       | 51/200 [00:07<00:27,  5.43it/s, failures=0, objective=-28.4]
HPO - Small Problem:  26%|██▌       | 52/200 [00:07<00:27,  5.47it/s, failures=0, objective=-28.4]
HPO - Small Problem:  26%|██▌       | 52/200 [00:07<00:27,  5.47it/s, failures=0, objective=-28.4]
HPO - Small Problem:  26%|██▋       | 53/200 [00:07<00:26,  5.56it/s, failures=0, objective=-28.4]
HPO - Small Problem:  26%|██▋       | 53/200 [00:07<00:26,  5.56it/s, failures=0, objective=-28.4]
HPO - Small Problem:  27%|██▋       | 54/200 [00:07<00:26,  5.44it/s, failures=0, objective=-28.4]
HPO - Small Problem:  27%|██▋       | 54/200 [00:07<00:26,  5.44it/s, failures=0, objective=-28.4]
HPO - Small Problem:  28%|██▊       | 55/200 [00:08<00:26,  5.56it/s, failures=0, objective=-28.4]
HPO - Small Problem:  28%|██▊       | 55/200 [00:08<00:26,  5.56it/s, failures=0, objective=-28.4]
HPO - Small Problem:  28%|██▊       | 56/200 [00:08<00:25,  5.68it/s, failures=0, objective=-28.4]
HPO - Small Problem:  28%|██▊       | 56/200 [00:08<00:25,  5.68it/s, failures=0, objective=-28.4]
HPO - Small Problem:  28%|██▊       | 57/200 [00:08<00:24,  5.77it/s, failures=0, objective=-28.4]
HPO - Small Problem:  28%|██▊       | 57/200 [00:08<00:24,  5.77it/s, failures=0, objective=-28.4]
HPO - Small Problem:  29%|██▉       | 58/200 [00:08<00:25,  5.55it/s, failures=0, objective=-28.4]
HPO - Small Problem:  29%|██▉       | 58/200 [00:08<00:25,  5.55it/s, failures=0, objective=-24.5]
HPO - Small Problem:  30%|██▉       | 59/200 [00:08<00:24,  5.65it/s, failures=0, objective=-24.5]
HPO - Small Problem:  30%|██▉       | 59/200 [00:08<00:24,  5.65it/s, failures=0, objective=-24.5]
HPO - Small Problem:  30%|███       | 60/200 [00:09<00:28,  4.98it/s, failures=0, objective=-24.5]
HPO - Small Problem:  30%|███       | 60/200 [00:09<00:28,  4.98it/s, failures=0, objective=-24.5]
HPO - Small Problem:  30%|███       | 61/200 [00:09<00:27,  5.11it/s, failures=0, objective=-24.5]
HPO - Small Problem:  30%|███       | 61/200 [00:09<00:27,  5.11it/s, failures=0, objective=-24.5]
HPO - Small Problem:  31%|███       | 62/200 [00:09<00:26,  5.27it/s, failures=0, objective=-24.5]
HPO - Small Problem:  31%|███       | 62/200 [00:09<00:26,  5.27it/s, failures=0, objective=-24.5]
HPO - Small Problem:  32%|███▏      | 63/200 [00:09<00:28,  4.81it/s, failures=0, objective=-24.5]
HPO - Small Problem:  32%|███▏      | 63/200 [00:09<00:28,  4.81it/s, failures=0, objective=-24.5]
HPO - Small Problem:  32%|███▏      | 64/200 [00:09<00:26,  5.08it/s, failures=0, objective=-24.5]
HPO - Small Problem:  32%|███▏      | 64/200 [00:09<00:26,  5.08it/s, failures=0, objective=-24.5]
HPO - Small Problem:  32%|███▎      | 65/200 [00:10<00:28,  4.76it/s, failures=0, objective=-24.5]
HPO - Small Problem:  32%|███▎      | 65/200 [00:10<00:28,  4.76it/s, failures=0, objective=-24.5]
HPO - Small Problem:  33%|███▎      | 66/200 [00:10<00:27,  4.96it/s, failures=0, objective=-24.5]
HPO - Small Problem:  33%|███▎      | 66/200 [00:10<00:27,  4.96it/s, failures=0, objective=-24.5]
HPO - Small Problem:  34%|███▎      | 67/200 [00:10<00:25,  5.20it/s, failures=0, objective=-24.5]
HPO - Small Problem:  34%|███▎      | 67/200 [00:10<00:25,  5.20it/s, failures=0, objective=-24.5]
HPO - Small Problem:  34%|███▍      | 68/200 [00:10<00:24,  5.28it/s, failures=0, objective=-24.5]
HPO - Small Problem:  34%|███▍      | 68/200 [00:10<00:24,  5.28it/s, failures=0, objective=-24.5]
HPO - Small Problem:  34%|███▍      | 69/200 [00:10<00:24,  5.40it/s, failures=0, objective=-24.5]
HPO - Small Problem:  34%|███▍      | 69/200 [00:10<00:24,  5.40it/s, failures=0, objective=-24.5]
HPO - Small Problem:  35%|███▌      | 70/200 [00:10<00:24,  5.23it/s, failures=0, objective=-24.5]
HPO - Small Problem:  35%|███▌      | 70/200 [00:10<00:24,  5.23it/s, failures=0, objective=-24.5]
HPO - Small Problem:  36%|███▌      | 71/200 [00:11<00:27,  4.63it/s, failures=0, objective=-24.5]
HPO - Small Problem:  36%|███▌      | 71/200 [00:11<00:27,  4.63it/s, failures=0, objective=-24.5]
HPO - Small Problem:  36%|███▌      | 72/200 [00:11<00:26,  4.79it/s, failures=0, objective=-24.5]
HPO - Small Problem:  36%|███▌      | 72/200 [00:11<00:26,  4.79it/s, failures=0, objective=-24.1]
HPO - Small Problem:  36%|███▋      | 73/200 [00:11<00:25,  5.03it/s, failures=0, objective=-24.1]
HPO - Small Problem:  36%|███▋      | 73/200 [00:11<00:25,  5.03it/s, failures=0, objective=-24.1]
HPO - Small Problem:  37%|███▋      | 74/200 [00:11<00:26,  4.73it/s, failures=0, objective=-24.1]
HPO - Small Problem:  37%|███▋      | 74/200 [00:11<00:26,  4.73it/s, failures=0, objective=-24.1]
HPO - Small Problem:  38%|███▊      | 75/200 [00:12<00:25,  4.93it/s, failures=0, objective=-24.1]
HPO - Small Problem:  38%|███▊      | 75/200 [00:12<00:25,  4.93it/s, failures=0, objective=-24.1]
HPO - Small Problem:  38%|███▊      | 76/200 [00:12<00:24,  4.97it/s, failures=0, objective=-24.1]
HPO - Small Problem:  38%|███▊      | 76/200 [00:12<00:24,  4.97it/s, failures=0, objective=-24.1]
HPO - Small Problem:  38%|███▊      | 77/200 [00:12<00:24,  5.02it/s, failures=0, objective=-24.1]
HPO - Small Problem:  38%|███▊      | 77/200 [00:12<00:24,  5.02it/s, failures=0, objective=-24.1]
HPO - Small Problem:  39%|███▉      | 78/200 [00:12<00:24,  4.99it/s, failures=0, objective=-24.1]
HPO - Small Problem:  39%|███▉      | 78/200 [00:12<00:24,  4.99it/s, failures=0, objective=-24.1]
HPO - Small Problem:  40%|███▉      | 79/200 [00:12<00:24,  5.02it/s, failures=0, objective=-24.1]
HPO - Small Problem:  40%|███▉      | 79/200 [00:12<00:24,  5.02it/s, failures=0, objective=-24.1]
HPO - Small Problem:  40%|████      | 80/200 [00:13<00:23,  5.07it/s, failures=0, objective=-24.1]
HPO - Small Problem:  40%|████      | 80/200 [00:13<00:23,  5.07it/s, failures=0, objective=-24.1]
HPO - Small Problem:  40%|████      | 81/200 [00:13<00:23,  5.03it/s, failures=0, objective=-24.1]
HPO - Small Problem:  40%|████      | 81/200 [00:13<00:23,  5.03it/s, failures=0, objective=-24.1]
HPO - Small Problem:  41%|████      | 82/200 [00:13<00:26,  4.42it/s, failures=0, objective=-24.1]
HPO - Small Problem:  41%|████      | 82/200 [00:13<00:26,  4.42it/s, failures=0, objective=-21.5]
HPO - Small Problem:  42%|████▏     | 83/200 [00:13<00:25,  4.54it/s, failures=0, objective=-21.5]
HPO - Small Problem:  42%|████▏     | 83/200 [00:13<00:25,  4.54it/s, failures=0, objective=-21.5]
HPO - Small Problem:  42%|████▏     | 84/200 [00:13<00:25,  4.52it/s, failures=0, objective=-21.5]
HPO - Small Problem:  42%|████▏     | 84/200 [00:13<00:25,  4.52it/s, failures=0, objective=-21.5]
HPO - Small Problem:  42%|████▎     | 85/200 [00:14<00:24,  4.62it/s, failures=0, objective=-21.5]
HPO - Small Problem:  42%|████▎     | 85/200 [00:14<00:24,  4.62it/s, failures=0, objective=-21.5]
HPO - Small Problem:  43%|████▎     | 86/200 [00:14<00:24,  4.72it/s, failures=0, objective=-21.5]
HPO - Small Problem:  43%|████▎     | 86/200 [00:14<00:24,  4.72it/s, failures=0, objective=-21.5]
HPO - Small Problem:  44%|████▎     | 87/200 [00:14<00:23,  4.88it/s, failures=0, objective=-21.5]
HPO - Small Problem:  44%|████▎     | 87/200 [00:14<00:23,  4.88it/s, failures=0, objective=-21.5]
HPO - Small Problem:  44%|████▍     | 88/200 [00:14<00:22,  4.98it/s, failures=0, objective=-21.5]
HPO - Small Problem:  44%|████▍     | 88/200 [00:14<00:22,  4.98it/s, failures=0, objective=-21.5]
HPO - Small Problem:  44%|████▍     | 89/200 [00:14<00:22,  4.98it/s, failures=0, objective=-21.5]
HPO - Small Problem:  44%|████▍     | 89/200 [00:14<00:22,  4.98it/s, failures=0, objective=-21.5]
HPO - Small Problem:  45%|████▌     | 90/200 [00:15<00:22,  4.94it/s, failures=0, objective=-21.5]
HPO - Small Problem:  45%|████▌     | 90/200 [00:15<00:22,  4.94it/s, failures=0, objective=-21.5]
HPO - Small Problem:  46%|████▌     | 91/200 [00:15<00:21,  5.15it/s, failures=0, objective=-21.5]
HPO - Small Problem:  46%|████▌     | 91/200 [00:15<00:21,  5.15it/s, failures=0, objective=-21.5]
HPO - Small Problem:  46%|████▌     | 92/200 [00:15<00:20,  5.16it/s, failures=0, objective=-21.5]
HPO - Small Problem:  46%|████▌     | 92/200 [00:15<00:20,  5.16it/s, failures=0, objective=-21.5]
HPO - Small Problem:  46%|████▋     | 93/200 [00:15<00:23,  4.54it/s, failures=0, objective=-21.5]
HPO - Small Problem:  46%|████▋     | 93/200 [00:15<00:23,  4.54it/s, failures=0, objective=-21.5]
HPO - Small Problem:  47%|████▋     | 94/200 [00:16<00:25,  4.17it/s, failures=0, objective=-21.5]
HPO - Small Problem:  47%|████▋     | 94/200 [00:16<00:25,  4.17it/s, failures=0, objective=-21.5]
HPO - Small Problem:  48%|████▊     | 95/200 [00:16<00:26,  4.00it/s, failures=0, objective=-21.5]
HPO - Small Problem:  48%|████▊     | 95/200 [00:16<00:26,  4.00it/s, failures=0, objective=-21.5]
HPO - Small Problem:  48%|████▊     | 96/200 [00:16<00:23,  4.43it/s, failures=0, objective=-21.5]
HPO - Small Problem:  48%|████▊     | 96/200 [00:16<00:23,  4.43it/s, failures=0, objective=-21.5]
HPO - Small Problem:  48%|████▊     | 97/200 [00:16<00:22,  4.61it/s, failures=0, objective=-21.5]
HPO - Small Problem:  48%|████▊     | 97/200 [00:16<00:22,  4.61it/s, failures=0, objective=-16.1]
HPO - Small Problem:  49%|████▉     | 98/200 [00:16<00:21,  4.78it/s, failures=0, objective=-16.1]
HPO - Small Problem:  49%|████▉     | 98/200 [00:16<00:21,  4.78it/s, failures=0, objective=-11.5]
HPO - Small Problem:  50%|████▉     | 99/200 [00:17<00:20,  4.89it/s, failures=0, objective=-11.5]
HPO - Small Problem:  50%|████▉     | 99/200 [00:17<00:20,  4.89it/s, failures=0, objective=-10.5]
HPO - Small Problem:  50%|█████     | 100/200 [00:17<00:20,  4.99it/s, failures=0, objective=-10.5]
HPO - Small Problem:  50%|█████     | 100/200 [00:17<00:20,  4.99it/s, failures=0, objective=-10.5]
HPO - Small Problem:  50%|█████     | 101/200 [00:17<00:19,  5.15it/s, failures=0, objective=-10.5]
HPO - Small Problem:  50%|█████     | 101/200 [00:17<00:19,  5.15it/s, failures=0, objective=-10.5]
HPO - Small Problem:  51%|█████     | 102/200 [00:17<00:18,  5.17it/s, failures=0, objective=-10.5]
HPO - Small Problem:  51%|█████     | 102/200 [00:17<00:18,  5.17it/s, failures=0, objective=-7.31]
HPO - Small Problem:  52%|█████▏    | 103/200 [00:17<00:18,  5.12it/s, failures=0, objective=-7.31]
HPO - Small Problem:  52%|█████▏    | 103/200 [00:17<00:18,  5.12it/s, failures=0, objective=-7.31]
HPO - Small Problem:  52%|█████▏    | 104/200 [00:18<00:18,  5.17it/s, failures=0, objective=-7.31]
HPO - Small Problem:  52%|█████▏    | 104/200 [00:18<00:18,  5.17it/s, failures=0, objective=-7.31]
HPO - Small Problem:  52%|█████▎    | 105/200 [00:18<00:21,  4.47it/s, failures=0, objective=-7.31]
HPO - Small Problem:  52%|█████▎    | 105/200 [00:18<00:21,  4.47it/s, failures=0, objective=-7.31]
HPO - Small Problem:  53%|█████▎    | 106/200 [00:18<00:20,  4.51it/s, failures=0, objective=-7.31]
HPO - Small Problem:  53%|█████▎    | 106/200 [00:18<00:20,  4.51it/s, failures=0, objective=-7.31]
HPO - Small Problem:  54%|█████▎    | 107/200 [00:18<00:20,  4.60it/s, failures=0, objective=-7.31]
HPO - Small Problem:  54%|█████▎    | 107/200 [00:18<00:20,  4.60it/s, failures=0, objective=-6.85]
HPO - Small Problem:  54%|█████▍    | 108/200 [00:18<00:19,  4.74it/s, failures=0, objective=-6.85]
HPO - Small Problem:  54%|█████▍    | 108/200 [00:18<00:19,  4.74it/s, failures=0, objective=-6.85]
HPO - Small Problem:  55%|█████▍    | 109/200 [00:19<00:19,  4.70it/s, failures=0, objective=-6.85]
HPO - Small Problem:  55%|█████▍    | 109/200 [00:19<00:19,  4.70it/s, failures=0, objective=-6.75]
HPO - Small Problem:  55%|█████▌    | 110/200 [00:19<00:18,  4.78it/s, failures=0, objective=-6.75]
HPO - Small Problem:  55%|█████▌    | 110/200 [00:19<00:18,  4.78it/s, failures=0, objective=-6.75]
HPO - Small Problem:  56%|█████▌    | 111/200 [00:19<00:18,  4.69it/s, failures=0, objective=-6.75]
HPO - Small Problem:  56%|█████▌    | 111/200 [00:19<00:18,  4.69it/s, failures=0, objective=-6.75]
HPO - Small Problem:  56%|█████▌    | 112/200 [00:19<00:18,  4.69it/s, failures=0, objective=-6.75]
HPO - Small Problem:  56%|█████▌    | 112/200 [00:19<00:18,  4.69it/s, failures=0, objective=-6.75]
HPO - Small Problem:  56%|█████▋    | 113/200 [00:20<00:19,  4.54it/s, failures=0, objective=-6.75]
HPO - Small Problem:  56%|█████▋    | 113/200 [00:20<00:19,  4.54it/s, failures=0, objective=-6.75]
HPO - Small Problem:  57%|█████▋    | 114/200 [00:20<00:21,  4.08it/s, failures=0, objective=-6.75]
HPO - Small Problem:  57%|█████▋    | 114/200 [00:20<00:21,  4.08it/s, failures=0, objective=-6.75]
HPO - Small Problem:  57%|█████▊    | 115/200 [00:20<00:20,  4.08it/s, failures=0, objective=-6.75]
HPO - Small Problem:  57%|█████▊    | 115/200 [00:20<00:20,  4.08it/s, failures=0, objective=-6.75]
HPO - Small Problem:  58%|█████▊    | 116/200 [00:21<00:25,  3.27it/s, failures=0, objective=-6.75]
HPO - Small Problem:  58%|█████▊    | 116/200 [00:21<00:25,  3.27it/s, failures=0, objective=-6.75]
HPO - Small Problem:  58%|█████▊    | 117/200 [00:21<00:25,  3.25it/s, failures=0, objective=-6.75]
HPO - Small Problem:  58%|█████▊    | 117/200 [00:21<00:25,  3.25it/s, failures=0, objective=-6.75]
HPO - Small Problem:  59%|█████▉    | 118/200 [00:21<00:22,  3.65it/s, failures=0, objective=-6.75]
HPO - Small Problem:  59%|█████▉    | 118/200 [00:21<00:22,  3.65it/s, failures=0, objective=-6.75]
HPO - Small Problem:  60%|█████▉    | 119/200 [00:21<00:20,  4.04it/s, failures=0, objective=-6.75]
HPO - Small Problem:  60%|█████▉    | 119/200 [00:21<00:20,  4.04it/s, failures=0, objective=-6.75]
HPO - Small Problem:  60%|██████    | 120/200 [00:21<00:18,  4.29it/s, failures=0, objective=-6.75]
HPO - Small Problem:  60%|██████    | 120/200 [00:21<00:18,  4.29it/s, failures=0, objective=-6.75]
HPO - Small Problem:  60%|██████    | 121/200 [00:22<00:17,  4.46it/s, failures=0, objective=-6.75]
HPO - Small Problem:  60%|██████    | 121/200 [00:22<00:17,  4.46it/s, failures=0, objective=-6.75]
HPO - Small Problem:  61%|██████    | 122/200 [00:22<00:17,  4.50it/s, failures=0, objective=-6.75]
HPO - Small Problem:  61%|██████    | 122/200 [00:22<00:17,  4.50it/s, failures=0, objective=-6.75]
HPO - Small Problem:  62%|██████▏   | 123/200 [00:22<00:17,  4.51it/s, failures=0, objective=-6.75]
HPO - Small Problem:  62%|██████▏   | 123/200 [00:22<00:17,  4.51it/s, failures=0, objective=-6.75]
HPO - Small Problem:  62%|██████▏   | 124/200 [00:22<00:17,  4.32it/s, failures=0, objective=-6.75]
HPO - Small Problem:  62%|██████▏   | 124/200 [00:22<00:17,  4.32it/s, failures=0, objective=-6.75]
HPO - Small Problem:  62%|██████▎   | 125/200 [00:23<00:16,  4.50it/s, failures=0, objective=-6.75]
HPO - Small Problem:  62%|██████▎   | 125/200 [00:23<00:16,  4.50it/s, failures=0, objective=-6.75]
HPO - Small Problem:  63%|██████▎   | 126/200 [00:23<00:16,  4.43it/s, failures=0, objective=-6.75]
HPO - Small Problem:  63%|██████▎   | 126/200 [00:23<00:16,  4.43it/s, failures=0, objective=-6.75]
HPO - Small Problem:  64%|██████▎   | 127/200 [00:23<00:16,  4.40it/s, failures=0, objective=-6.75]
HPO - Small Problem:  64%|██████▎   | 127/200 [00:23<00:16,  4.40it/s, failures=0, objective=-6.75]
HPO - Small Problem:  64%|██████▍   | 128/200 [00:23<00:17,  4.01it/s, failures=0, objective=-6.75]
HPO - Small Problem:  64%|██████▍   | 128/200 [00:23<00:17,  4.01it/s, failures=0, objective=-6.75]
HPO - Small Problem:  64%|██████▍   | 129/200 [00:23<00:16,  4.25it/s, failures=0, objective=-6.75]
HPO - Small Problem:  64%|██████▍   | 129/200 [00:23<00:16,  4.25it/s, failures=0, objective=-6.75]
HPO - Small Problem:  65%|██████▌   | 130/200 [00:24<00:16,  4.35it/s, failures=0, objective=-6.75]
HPO - Small Problem:  65%|██████▌   | 130/200 [00:24<00:16,  4.35it/s, failures=0, objective=-6.75]
HPO - Small Problem:  66%|██████▌   | 131/200 [00:24<00:16,  4.16it/s, failures=0, objective=-6.75]
HPO - Small Problem:  66%|██████▌   | 131/200 [00:24<00:16,  4.16it/s, failures=0, objective=-6.75]
HPO - Small Problem:  66%|██████▌   | 132/200 [00:24<00:16,  4.19it/s, failures=0, objective=-6.75]
HPO - Small Problem:  66%|██████▌   | 132/200 [00:24<00:16,  4.19it/s, failures=0, objective=-6.64]
HPO - Small Problem:  66%|██████▋   | 133/200 [00:24<00:15,  4.35it/s, failures=0, objective=-6.64]
HPO - Small Problem:  66%|██████▋   | 133/200 [00:24<00:15,  4.35it/s, failures=0, objective=-6.64]
HPO - Small Problem:  67%|██████▋   | 134/200 [00:25<00:15,  4.15it/s, failures=0, objective=-6.64]
HPO - Small Problem:  67%|██████▋   | 134/200 [00:25<00:15,  4.15it/s, failures=0, objective=-6.64]
HPO - Small Problem:  68%|██████▊   | 135/200 [00:25<00:16,  3.88it/s, failures=0, objective=-6.64]
HPO - Small Problem:  68%|██████▊   | 135/200 [00:25<00:16,  3.88it/s, failures=0, objective=-6.64]
HPO - Small Problem:  68%|██████▊   | 136/200 [00:25<00:16,  3.81it/s, failures=0, objective=-6.64]
HPO - Small Problem:  68%|██████▊   | 136/200 [00:25<00:16,  3.81it/s, failures=0, objective=-6.64]
HPO - Small Problem:  68%|██████▊   | 137/200 [00:25<00:15,  4.11it/s, failures=0, objective=-6.64]
HPO - Small Problem:  68%|██████▊   | 137/200 [00:25<00:15,  4.11it/s, failures=0, objective=-6.64]
HPO - Small Problem:  69%|██████▉   | 138/200 [00:26<00:14,  4.26it/s, failures=0, objective=-6.64]
HPO - Small Problem:  69%|██████▉   | 138/200 [00:26<00:14,  4.26it/s, failures=0, objective=-6.64]
HPO - Small Problem:  70%|██████▉   | 139/200 [00:26<00:15,  3.87it/s, failures=0, objective=-6.64]
HPO - Small Problem:  70%|██████▉   | 139/200 [00:26<00:15,  3.87it/s, failures=0, objective=-6.64]
HPO - Small Problem:  70%|███████   | 140/200 [00:26<00:14,  4.00it/s, failures=0, objective=-6.64]
HPO - Small Problem:  70%|███████   | 140/200 [00:26<00:14,  4.00it/s, failures=0, objective=-6.58]
HPO - Small Problem:  70%|███████   | 141/200 [00:26<00:14,  4.10it/s, failures=0, objective=-6.58]
HPO - Small Problem:  70%|███████   | 141/200 [00:26<00:14,  4.10it/s, failures=0, objective=-6.58]
HPO - Small Problem:  71%|███████   | 142/200 [00:27<00:13,  4.27it/s, failures=0, objective=-6.58]
HPO - Small Problem:  71%|███████   | 142/200 [00:27<00:13,  4.27it/s, failures=0, objective=-6.58]
HPO - Small Problem:  72%|███████▏  | 143/200 [00:27<00:13,  4.28it/s, failures=0, objective=-6.58]
HPO - Small Problem:  72%|███████▏  | 143/200 [00:27<00:13,  4.28it/s, failures=0, objective=-6.58]
HPO - Small Problem:  72%|███████▏  | 144/200 [00:27<00:12,  4.39it/s, failures=0, objective=-6.58]
HPO - Small Problem:  72%|███████▏  | 144/200 [00:27<00:12,  4.39it/s, failures=0, objective=-6.58]
HPO - Small Problem:  72%|███████▎  | 145/200 [00:27<00:12,  4.34it/s, failures=0, objective=-6.58]
HPO - Small Problem:  72%|███████▎  | 145/200 [00:27<00:12,  4.34it/s, failures=0, objective=-6.58]
HPO - Small Problem:  73%|███████▎  | 146/200 [00:28<00:13,  3.86it/s, failures=0, objective=-6.58]
HPO - Small Problem:  73%|███████▎  | 146/200 [00:28<00:13,  3.86it/s, failures=0, objective=-6.58]
HPO - Small Problem:  74%|███████▎  | 147/200 [00:28<00:13,  4.02it/s, failures=0, objective=-6.58]
HPO - Small Problem:  74%|███████▎  | 147/200 [00:28<00:13,  4.02it/s, failures=0, objective=-6.37]
HPO - Small Problem:  74%|███████▍  | 148/200 [00:28<00:12,  4.12it/s, failures=0, objective=-6.37]
HPO - Small Problem:  74%|███████▍  | 148/200 [00:28<00:12,  4.12it/s, failures=0, objective=-6.37]
HPO - Small Problem:  74%|███████▍  | 149/200 [00:28<00:13,  3.88it/s, failures=0, objective=-6.37]
HPO - Small Problem:  74%|███████▍  | 149/200 [00:28<00:13,  3.88it/s, failures=0, objective=-6.37]
HPO - Small Problem:  75%|███████▌  | 150/200 [00:29<00:12,  4.10it/s, failures=0, objective=-6.37]
HPO - Small Problem:  75%|███████▌  | 150/200 [00:29<00:12,  4.10it/s, failures=0, objective=-6.37]
HPO - Small Problem:  76%|███████▌  | 151/200 [00:29<00:11,  4.21it/s, failures=0, objective=-6.37]
HPO - Small Problem:  76%|███████▌  | 151/200 [00:29<00:11,  4.21it/s, failures=0, objective=-6.37]
HPO - Small Problem:  76%|███████▌  | 152/200 [00:29<00:11,  4.14it/s, failures=0, objective=-6.37]
HPO - Small Problem:  76%|███████▌  | 152/200 [00:29<00:11,  4.14it/s, failures=0, objective=-6.37]
HPO - Small Problem:  76%|███████▋  | 153/200 [00:29<00:11,  4.20it/s, failures=0, objective=-6.37]
HPO - Small Problem:  76%|███████▋  | 153/200 [00:29<00:11,  4.20it/s, failures=0, objective=-6.37]
HPO - Small Problem:  77%|███████▋  | 154/200 [00:30<00:10,  4.39it/s, failures=0, objective=-6.37]
HPO - Small Problem:  77%|███████▋  | 154/200 [00:30<00:10,  4.39it/s, failures=0, objective=-6.37]
HPO - Small Problem:  78%|███████▊  | 155/200 [00:30<00:11,  4.07it/s, failures=0, objective=-6.37]
HPO - Small Problem:  78%|███████▊  | 155/200 [00:30<00:11,  4.07it/s, failures=0, objective=-6.37]
HPO - Small Problem:  78%|███████▊  | 156/200 [00:30<00:10,  4.22it/s, failures=0, objective=-6.37]
HPO - Small Problem:  78%|███████▊  | 156/200 [00:30<00:10,  4.22it/s, failures=0, objective=-2.72]
HPO - Small Problem:  78%|███████▊  | 157/200 [00:30<00:09,  4.40it/s, failures=0, objective=-2.72]
HPO - Small Problem:  78%|███████▊  | 157/200 [00:30<00:09,  4.40it/s, failures=0, objective=-2.72]
HPO - Small Problem:  79%|███████▉  | 158/200 [00:30<00:09,  4.39it/s, failures=0, objective=-2.72]
HPO - Small Problem:  79%|███████▉  | 158/200 [00:30<00:09,  4.39it/s, failures=0, objective=-2.72]
HPO - Small Problem:  80%|███████▉  | 159/200 [00:31<00:09,  4.44it/s, failures=0, objective=-2.72]
HPO - Small Problem:  80%|███████▉  | 159/200 [00:31<00:09,  4.44it/s, failures=0, objective=-1.87]
HPO - Small Problem:  80%|████████  | 160/200 [00:31<00:08,  4.46it/s, failures=0, objective=-1.87]
HPO - Small Problem:  80%|████████  | 160/200 [00:31<00:08,  4.46it/s, failures=0, objective=-1.87]
HPO - Small Problem:  80%|████████  | 161/200 [00:31<00:09,  4.10it/s, failures=0, objective=-1.87]
HPO - Small Problem:  80%|████████  | 161/200 [00:31<00:09,  4.10it/s, failures=0, objective=-1.87]
HPO - Small Problem:  81%|████████  | 162/200 [00:31<00:09,  4.00it/s, failures=0, objective=-1.87]
HPO - Small Problem:  81%|████████  | 162/200 [00:31<00:09,  4.00it/s, failures=0, objective=-1.87]
HPO - Small Problem:  82%|████████▏ | 163/200 [00:32<00:08,  4.20it/s, failures=0, objective=-1.87]
HPO - Small Problem:  82%|████████▏ | 163/200 [00:32<00:08,  4.20it/s, failures=0, objective=-1.87]
HPO - Small Problem:  82%|████████▏ | 164/200 [00:32<00:08,  4.22it/s, failures=0, objective=-1.87]
HPO - Small Problem:  82%|████████▏ | 164/200 [00:32<00:08,  4.22it/s, failures=0, objective=-1.87]
HPO - Small Problem:  82%|████████▎ | 165/200 [00:32<00:08,  3.94it/s, failures=0, objective=-1.87]
HPO - Small Problem:  82%|████████▎ | 165/200 [00:32<00:08,  3.94it/s, failures=0, objective=-1.64]
HPO - Small Problem:  83%|████████▎ | 166/200 [00:32<00:07,  4.27it/s, failures=0, objective=-1.64]
HPO - Small Problem:  83%|████████▎ | 166/200 [00:32<00:07,  4.27it/s, failures=0, objective=-0.925]
HPO - Small Problem:  84%|████████▎ | 167/200 [00:33<00:07,  4.44it/s, failures=0, objective=-0.925]
HPO - Small Problem:  84%|████████▎ | 167/200 [00:33<00:07,  4.44it/s, failures=0, objective=-0.925]
HPO - Small Problem:  84%|████████▍ | 168/200 [00:33<00:07,  4.53it/s, failures=0, objective=-0.925]
HPO - Small Problem:  84%|████████▍ | 168/200 [00:33<00:07,  4.53it/s, failures=0, objective=-0.448]
HPO - Small Problem:  84%|████████▍ | 169/200 [00:33<00:06,  4.69it/s, failures=0, objective=-0.448]
HPO - Small Problem:  84%|████████▍ | 169/200 [00:33<00:06,  4.69it/s, failures=0, objective=-0.357]
HPO - Small Problem:  85%|████████▌ | 170/200 [00:33<00:06,  4.74it/s, failures=0, objective=-0.357]
HPO - Small Problem:  85%|████████▌ | 170/200 [00:33<00:06,  4.74it/s, failures=0, objective=-0.357]
HPO - Small Problem:  86%|████████▌ | 171/200 [00:33<00:06,  4.27it/s, failures=0, objective=-0.357]
HPO - Small Problem:  86%|████████▌ | 171/200 [00:33<00:06,  4.27it/s, failures=0, objective=-0.267]
HPO - Small Problem:  86%|████████▌ | 172/200 [00:34<00:06,  4.48it/s, failures=0, objective=-0.267]
HPO - Small Problem:  86%|████████▌ | 172/200 [00:34<00:06,  4.48it/s, failures=0, objective=-0.267]
HPO - Small Problem:  86%|████████▋ | 173/200 [00:34<00:06,  4.07it/s, failures=0, objective=-0.267]
HPO - Small Problem:  86%|████████▋ | 173/200 [00:34<00:06,  4.07it/s, failures=0, objective=-0.267]
HPO - Small Problem:  87%|████████▋ | 174/200 [00:34<00:06,  4.03it/s, failures=0, objective=-0.267]
HPO - Small Problem:  87%|████████▋ | 174/200 [00:34<00:06,  4.03it/s, failures=0, objective=-0.267]
HPO - Small Problem:  88%|████████▊ | 175/200 [00:34<00:05,  4.26it/s, failures=0, objective=-0.267]
HPO - Small Problem:  88%|████████▊ | 175/200 [00:34<00:05,  4.26it/s, failures=0, objective=-0.267]
HPO - Small Problem:  88%|████████▊ | 176/200 [00:35<00:05,  4.45it/s, failures=0, objective=-0.267]
HPO - Small Problem:  88%|████████▊ | 176/200 [00:35<00:05,  4.45it/s, failures=0, objective=-0.267]
HPO - Small Problem:  88%|████████▊ | 177/200 [00:35<00:04,  4.62it/s, failures=0, objective=-0.267]
HPO - Small Problem:  88%|████████▊ | 177/200 [00:35<00:04,  4.62it/s, failures=0, objective=-0.267]
HPO - Small Problem:  89%|████████▉ | 178/200 [00:35<00:04,  4.44it/s, failures=0, objective=-0.267]
HPO - Small Problem:  89%|████████▉ | 178/200 [00:35<00:04,  4.44it/s, failures=0, objective=-0.267]
HPO - Small Problem:  90%|████████▉ | 179/200 [00:35<00:04,  4.48it/s, failures=0, objective=-0.267]
HPO - Small Problem:  90%|████████▉ | 179/200 [00:35<00:04,  4.48it/s, failures=0, objective=-0.028]
HPO - Small Problem:  90%|█████████ | 180/200 [00:36<00:04,  4.36it/s, failures=0, objective=-0.028]
HPO - Small Problem:  90%|█████████ | 180/200 [00:36<00:04,  4.36it/s, failures=0, objective=-0.028]
HPO - Small Problem:  90%|█████████ | 181/200 [00:36<00:04,  4.53it/s, failures=0, objective=-0.028]
HPO - Small Problem:  90%|█████████ | 181/200 [00:36<00:04,  4.53it/s, failures=0, objective=-0.028]
HPO - Small Problem:  91%|█████████ | 182/200 [00:36<00:04,  4.34it/s, failures=0, objective=-0.028]
HPO - Small Problem:  91%|█████████ | 182/200 [00:36<00:04,  4.34it/s, failures=0, objective=-0.028]
HPO - Small Problem:  92%|█████████▏| 183/200 [00:36<00:04,  3.98it/s, failures=0, objective=-0.028]
HPO - Small Problem:  92%|█████████▏| 183/200 [00:36<00:04,  3.98it/s, failures=0, objective=-0.028]
HPO - Small Problem:  92%|█████████▏| 184/200 [00:37<00:03,  4.12it/s, failures=0, objective=-0.028]
HPO - Small Problem:  92%|█████████▏| 184/200 [00:37<00:03,  4.12it/s, failures=0, objective=-0.028]
HPO - Small Problem:  92%|█████████▎| 185/200 [00:37<00:03,  3.93it/s, failures=0, objective=-0.028]
HPO - Small Problem:  92%|█████████▎| 185/200 [00:37<00:03,  3.93it/s, failures=0, objective=-0.028]
HPO - Small Problem:  93%|█████████▎| 186/200 [00:37<00:03,  4.14it/s, failures=0, objective=-0.028]
HPO - Small Problem:  93%|█████████▎| 186/200 [00:37<00:03,  4.14it/s, failures=0, objective=-0.028]
HPO - Small Problem:  94%|█████████▎| 187/200 [00:37<00:02,  4.37it/s, failures=0, objective=-0.028]
HPO - Small Problem:  94%|█████████▎| 187/200 [00:37<00:02,  4.37it/s, failures=0, objective=-0.028]
HPO - Small Problem:  94%|█████████▍| 188/200 [00:37<00:02,  4.59it/s, failures=0, objective=-0.028]
HPO - Small Problem:  94%|█████████▍| 188/200 [00:37<00:02,  4.59it/s, failures=0, objective=-0.028]
HPO - Small Problem:  94%|█████████▍| 189/200 [00:38<00:02,  4.73it/s, failures=0, objective=-0.028]
HPO - Small Problem:  94%|█████████▍| 189/200 [00:38<00:02,  4.73it/s, failures=0, objective=-0.028]
HPO - Small Problem:  95%|█████████▌| 190/200 [00:38<00:02,  4.64it/s, failures=0, objective=-0.028]
HPO - Small Problem:  95%|█████████▌| 190/200 [00:38<00:02,  4.64it/s, failures=0, objective=-0.028]
HPO - Small Problem:  96%|█████████▌| 191/200 [00:38<00:02,  4.47it/s, failures=0, objective=-0.028]
HPO - Small Problem:  96%|█████████▌| 191/200 [00:38<00:02,  4.47it/s, failures=0, objective=-0.028]
HPO - Small Problem:  96%|█████████▌| 192/200 [00:38<00:01,  4.08it/s, failures=0, objective=-0.028]
HPO - Small Problem:  96%|█████████▌| 192/200 [00:38<00:01,  4.08it/s, failures=0, objective=-0.028]
HPO - Small Problem:  96%|█████████▋| 193/200 [00:39<00:01,  3.64it/s, failures=0, objective=-0.028]
HPO - Small Problem:  96%|█████████▋| 193/200 [00:39<00:01,  3.64it/s, failures=0, objective=-0.028]
HPO - Small Problem:  97%|█████████▋| 194/200 [00:39<00:01,  3.39it/s, failures=0, objective=-0.028]
HPO - Small Problem:  97%|█████████▋| 194/200 [00:39<00:01,  3.39it/s, failures=0, objective=-0.028]
HPO - Small Problem:  98%|█████████▊| 195/200 [00:39<00:01,  3.53it/s, failures=0, objective=-0.028]
HPO - Small Problem:  98%|█████████▊| 195/200 [00:39<00:01,  3.53it/s, failures=0, objective=-0.028]
HPO - Small Problem:  98%|█████████▊| 196/200 [00:40<00:01,  3.58it/s, failures=0, objective=-0.028]
HPO - Small Problem:  98%|█████████▊| 196/200 [00:40<00:01,  3.58it/s, failures=0, objective=-0.028]
HPO - Small Problem:  98%|█████████▊| 197/200 [00:40<00:00,  3.73it/s, failures=0, objective=-0.028]
HPO - Small Problem:  98%|█████████▊| 197/200 [00:40<00:00,  3.73it/s, failures=0, objective=-0.028]
HPO - Small Problem:  99%|█████████▉| 198/200 [00:40<00:00,  3.65it/s, failures=0, objective=-0.028]
HPO - Small Problem:  99%|█████████▉| 198/200 [00:40<00:00,  3.65it/s, failures=0, objective=-0.028]
HPO - Small Problem: 100%|█████████▉| 199/200 [00:40<00:00,  3.82it/s, failures=0, objective=-0.028]
HPO - Small Problem: 100%|█████████▉| 199/200 [00:40<00:00,  3.82it/s, failures=0, objective=-0.028]
HPO - Small Problem: 100%|██████████| 200/200 [00:41<00:00,  3.90it/s, failures=0, objective=-0.028]
HPO - Small Problem: 100%|██████████| 200/200 [00:41<00:00,  3.90it/s, failures=0, objective=-0.028]
HPO - Small Problem: 100%|██████████| 200/200 [00:41<00:00,  4.87it/s, failures=0, objective=-0.028]

We run the search on the large problem without transfer learning:

evaluator_large = Evaluator.create(
    run_large,
    method="thread",
    method_kwargs={"callbacks": [TqdmCallback("HPO - Large Problem")]},
)
search_large = CBO(
    problem_large,
    evaluator_large,
    **search_kwargs,
)
results["Large"] = search_large.search(max_evals)

WARNING:root:Results file already exists, it will be renamed to /Users/romainegele/Documents/DeepHyper/deephyper/examples/examples_bbo/results_20250326-115129.csv

  0%|          | 0/200 [00:00<?, ?it/s]
HPO - Large Problem:   0%|          | 0/200 [00:00<?, ?it/s]
HPO - Large Problem:   0%|          | 1/200 [00:00<00:00, 16710.37it/s, failures=0, objective=-335]
HPO - Large Problem:   1%|          | 2/200 [00:00<00:04, 49.22it/s, failures=0, objective=-228]
HPO - Large Problem:   2%|▏         | 3/200 [00:00<00:05, 37.29it/s, failures=0, objective=-205]
HPO - Large Problem:   2%|▏         | 4/200 [00:00<00:05, 33.18it/s, failures=0, objective=-205]
HPO - Large Problem:   2%|▏         | 4/200 [00:00<00:05, 33.18it/s, failures=0, objective=-205]
HPO - Large Problem:   2%|▎         | 5/200 [00:00<00:05, 33.18it/s, failures=0, objective=-205]
HPO - Large Problem:   3%|▎         | 6/200 [00:00<00:05, 33.18it/s, failures=0, objective=-205]
HPO - Large Problem:   4%|▎         | 7/200 [00:00<00:05, 33.18it/s, failures=0, objective=-205]
HPO - Large Problem:   4%|▍         | 8/200 [00:00<00:06, 28.09it/s, failures=0, objective=-205]
HPO - Large Problem:   4%|▍         | 8/200 [00:00<00:06, 28.09it/s, failures=0, objective=-205]
HPO - Large Problem:   4%|▍         | 9/200 [00:00<00:06, 28.09it/s, failures=0, objective=-205]
HPO - Large Problem:   5%|▌         | 10/200 [00:00<00:06, 28.09it/s, failures=0, objective=-205]
HPO - Large Problem:   6%|▌         | 11/200 [00:00<00:06, 27.43it/s, failures=0, objective=-205]
HPO - Large Problem:   6%|▌         | 11/200 [00:00<00:06, 27.43it/s, failures=0, objective=-177]
HPO - Large Problem:   6%|▌         | 12/200 [00:00<00:06, 27.43it/s, failures=0, objective=-177]
HPO - Large Problem:   6%|▋         | 13/200 [00:00<00:06, 27.43it/s, failures=0, objective=-177]
HPO - Large Problem:   7%|▋         | 14/200 [00:00<00:06, 26.64it/s, failures=0, objective=-177]
HPO - Large Problem:   7%|▋         | 14/200 [00:00<00:06, 26.64it/s, failures=0, objective=-177]
HPO - Large Problem:   8%|▊         | 15/200 [00:00<00:06, 26.64it/s, failures=0, objective=-177]
HPO - Large Problem:   8%|▊         | 16/200 [00:00<00:06, 26.64it/s, failures=0, objective=-177]
HPO - Large Problem:   8%|▊         | 17/200 [00:00<00:08, 20.68it/s, failures=0, objective=-177]
HPO - Large Problem:   8%|▊         | 17/200 [00:00<00:08, 20.68it/s, failures=0, objective=-177]
HPO - Large Problem:   9%|▉         | 18/200 [00:00<00:08, 20.68it/s, failures=0, objective=-177]
HPO - Large Problem:  10%|▉         | 19/200 [00:00<00:08, 20.68it/s, failures=0, objective=-177]
HPO - Large Problem:  10%|█         | 20/200 [00:00<00:08, 22.02it/s, failures=0, objective=-177]
HPO - Large Problem:  10%|█         | 20/200 [00:00<00:08, 22.02it/s, failures=0, objective=-177]
HPO - Large Problem:  10%|█         | 21/200 [00:00<00:08, 22.02it/s, failures=0, objective=-177]
HPO - Large Problem:  11%|█         | 22/200 [00:01<00:08, 22.02it/s, failures=0, objective=-177]
HPO - Large Problem:  12%|█▏        | 23/200 [00:01<00:13, 13.00it/s, failures=0, objective=-177]
HPO - Large Problem:  12%|█▏        | 23/200 [00:01<00:13, 13.00it/s, failures=0, objective=-177]
HPO - Large Problem:  12%|█▏        | 24/200 [00:01<00:13, 13.00it/s, failures=0, objective=-177]
HPO - Large Problem:  12%|█▎        | 25/200 [00:01<00:18,  9.64it/s, failures=0, objective=-177]
HPO - Large Problem:  12%|█▎        | 25/200 [00:01<00:18,  9.64it/s, failures=0, objective=-177]
HPO - Large Problem:  13%|█▎        | 26/200 [00:01<00:18,  9.64it/s, failures=0, objective=-177]
HPO - Large Problem:  14%|█▎        | 27/200 [00:02<00:21,  8.00it/s, failures=0, objective=-177]
HPO - Large Problem:  14%|█▎        | 27/200 [00:02<00:21,  8.00it/s, failures=0, objective=-177]
HPO - Large Problem:  14%|█▍        | 28/200 [00:02<00:21,  8.00it/s, failures=0, objective=-130]
HPO - Large Problem:  14%|█▍        | 29/200 [00:02<00:24,  7.03it/s, failures=0, objective=-130]
HPO - Large Problem:  14%|█▍        | 29/200 [00:02<00:24,  7.03it/s, failures=0, objective=-130]
HPO - Large Problem:  15%|█▌        | 30/200 [00:02<00:25,  6.71it/s, failures=0, objective=-130]
HPO - Large Problem:  15%|█▌        | 30/200 [00:02<00:25,  6.71it/s, failures=0, objective=-130]
HPO - Large Problem:  16%|█▌        | 31/200 [00:02<00:26,  6.39it/s, failures=0, objective=-130]
HPO - Large Problem:  16%|█▌        | 31/200 [00:02<00:26,  6.39it/s, failures=0, objective=-130]
HPO - Large Problem:  16%|█▌        | 32/200 [00:02<00:27,  6.15it/s, failures=0, objective=-130]
HPO - Large Problem:  16%|█▌        | 32/200 [00:02<00:27,  6.15it/s, failures=0, objective=-130]
HPO - Large Problem:  16%|█▋        | 33/200 [00:03<00:31,  5.28it/s, failures=0, objective=-130]
HPO - Large Problem:  16%|█▋        | 33/200 [00:03<00:31,  5.28it/s, failures=0, objective=-130]
HPO - Large Problem:  17%|█▋        | 34/200 [00:03<00:31,  5.30it/s, failures=0, objective=-130]
HPO - Large Problem:  17%|█▋        | 34/200 [00:03<00:31,  5.30it/s, failures=0, objective=-130]
HPO - Large Problem:  18%|█▊        | 35/200 [00:03<00:30,  5.33it/s, failures=0, objective=-130]
HPO - Large Problem:  18%|█▊        | 35/200 [00:03<00:30,  5.33it/s, failures=0, objective=-130]
HPO - Large Problem:  18%|█▊        | 36/200 [00:03<00:30,  5.30it/s, failures=0, objective=-130]
HPO - Large Problem:  18%|█▊        | 36/200 [00:03<00:30,  5.30it/s, failures=0, objective=-130]
HPO - Large Problem:  18%|█▊        | 37/200 [00:04<00:30,  5.30it/s, failures=0, objective=-130]
HPO - Large Problem:  18%|█▊        | 37/200 [00:04<00:30,  5.30it/s, failures=0, objective=-130]
HPO - Large Problem:  19%|█▉        | 38/200 [00:04<00:30,  5.29it/s, failures=0, objective=-130]
HPO - Large Problem:  19%|█▉        | 38/200 [00:04<00:30,  5.29it/s, failures=0, objective=-130]
HPO - Large Problem:  20%|█▉        | 39/200 [00:04<00:35,  4.52it/s, failures=0, objective=-130]
HPO - Large Problem:  20%|█▉        | 39/200 [00:04<00:35,  4.52it/s, failures=0, objective=-130]
HPO - Large Problem:  20%|██        | 40/200 [00:04<00:34,  4.58it/s, failures=0, objective=-130]
HPO - Large Problem:  20%|██        | 40/200 [00:04<00:34,  4.58it/s, failures=0, objective=-130]
HPO - Large Problem:  20%|██        | 41/200 [00:04<00:33,  4.74it/s, failures=0, objective=-130]
HPO - Large Problem:  20%|██        | 41/200 [00:04<00:33,  4.74it/s, failures=0, objective=-130]
HPO - Large Problem:  21%|██        | 42/200 [00:05<00:33,  4.75it/s, failures=0, objective=-130]
HPO - Large Problem:  21%|██        | 42/200 [00:05<00:33,  4.75it/s, failures=0, objective=-130]
HPO - Large Problem:  22%|██▏       | 43/200 [00:05<00:33,  4.68it/s, failures=0, objective=-130]
HPO - Large Problem:  22%|██▏       | 43/200 [00:05<00:33,  4.68it/s, failures=0, objective=-130]
HPO - Large Problem:  22%|██▏       | 44/200 [00:05<00:33,  4.70it/s, failures=0, objective=-130]
HPO - Large Problem:  22%|██▏       | 44/200 [00:05<00:33,  4.70it/s, failures=0, objective=-130]
HPO - Large Problem:  22%|██▎       | 45/200 [00:05<00:33,  4.63it/s, failures=0, objective=-130]
HPO - Large Problem:  22%|██▎       | 45/200 [00:05<00:33,  4.63it/s, failures=0, objective=-130]
HPO - Large Problem:  23%|██▎       | 46/200 [00:06<00:38,  4.01it/s, failures=0, objective=-130]
HPO - Large Problem:  23%|██▎       | 46/200 [00:06<00:38,  4.01it/s, failures=0, objective=-130]
HPO - Large Problem:  24%|██▎       | 47/200 [00:06<00:35,  4.34it/s, failures=0, objective=-130]
HPO - Large Problem:  24%|██▎       | 47/200 [00:06<00:35,  4.34it/s, failures=0, objective=-130]
HPO - Large Problem:  24%|██▍       | 48/200 [00:06<00:33,  4.55it/s, failures=0, objective=-130]
HPO - Large Problem:  24%|██▍       | 48/200 [00:06<00:33,  4.55it/s, failures=0, objective=-130]
HPO - Large Problem:  24%|██▍       | 49/200 [00:06<00:31,  4.72it/s, failures=0, objective=-130]
HPO - Large Problem:  24%|██▍       | 49/200 [00:06<00:31,  4.72it/s, failures=0, objective=-130]
HPO - Large Problem:  25%|██▌       | 50/200 [00:06<00:32,  4.63it/s, failures=0, objective=-130]
HPO - Large Problem:  25%|██▌       | 50/200 [00:06<00:32,  4.63it/s, failures=0, objective=-130]
HPO - Large Problem:  26%|██▌       | 51/200 [00:07<00:32,  4.54it/s, failures=0, objective=-130]
HPO - Large Problem:  26%|██▌       | 51/200 [00:07<00:32,  4.54it/s, failures=0, objective=-125]
HPO - Large Problem:  26%|██▌       | 52/200 [00:07<00:32,  4.55it/s, failures=0, objective=-125]
HPO - Large Problem:  26%|██▌       | 52/200 [00:07<00:32,  4.55it/s, failures=0, objective=-125]
HPO - Large Problem:  26%|██▋       | 53/200 [00:07<00:32,  4.56it/s, failures=0, objective=-125]
HPO - Large Problem:  26%|██▋       | 53/200 [00:07<00:32,  4.56it/s, failures=0, objective=-125]
HPO - Large Problem:  27%|██▋       | 54/200 [00:07<00:32,  4.47it/s, failures=0, objective=-125]
HPO - Large Problem:  27%|██▋       | 54/200 [00:07<00:32,  4.47it/s, failures=0, objective=-124]
HPO - Large Problem:  28%|██▊       | 55/200 [00:08<00:32,  4.52it/s, failures=0, objective=-124]
HPO - Large Problem:  28%|██▊       | 55/200 [00:08<00:32,  4.52it/s, failures=0, objective=-124]
HPO - Large Problem:  28%|██▊       | 56/200 [00:08<00:31,  4.55it/s, failures=0, objective=-124]
HPO - Large Problem:  28%|██▊       | 56/200 [00:08<00:31,  4.55it/s, failures=0, objective=-124]
HPO - Large Problem:  28%|██▊       | 57/200 [00:08<00:34,  4.10it/s, failures=0, objective=-124]
HPO - Large Problem:  28%|██▊       | 57/200 [00:08<00:34,  4.10it/s, failures=0, objective=-124]
HPO - Large Problem:  29%|██▉       | 58/200 [00:08<00:32,  4.34it/s, failures=0, objective=-124]
HPO - Large Problem:  29%|██▉       | 58/200 [00:08<00:32,  4.34it/s, failures=0, objective=-124]
HPO - Large Problem:  30%|██▉       | 59/200 [00:08<00:31,  4.45it/s, failures=0, objective=-124]
HPO - Large Problem:  30%|██▉       | 59/200 [00:08<00:31,  4.45it/s, failures=0, objective=-87.7]
HPO - Large Problem:  30%|███       | 60/200 [00:09<00:31,  4.39it/s, failures=0, objective=-87.7]
HPO - Large Problem:  30%|███       | 60/200 [00:09<00:31,  4.39it/s, failures=0, objective=-87.7]
HPO - Large Problem:  30%|███       | 61/200 [00:09<00:30,  4.49it/s, failures=0, objective=-87.7]
HPO - Large Problem:  30%|███       | 61/200 [00:09<00:30,  4.49it/s, failures=0, objective=-87.7]
HPO - Large Problem:  31%|███       | 62/200 [00:09<00:29,  4.64it/s, failures=0, objective=-87.7]
HPO - Large Problem:  31%|███       | 62/200 [00:09<00:29,  4.64it/s, failures=0, objective=-87.7]
HPO - Large Problem:  32%|███▏      | 63/200 [00:09<00:31,  4.38it/s, failures=0, objective=-87.7]
HPO - Large Problem:  32%|███▏      | 63/200 [00:09<00:31,  4.38it/s, failures=0, objective=-87.7]
HPO - Large Problem:  32%|███▏      | 64/200 [00:10<00:36,  3.70it/s, failures=0, objective=-87.7]
HPO - Large Problem:  32%|███▏      | 64/200 [00:10<00:36,  3.70it/s, failures=0, objective=-87.7]
HPO - Large Problem:  32%|███▎      | 65/200 [00:10<00:35,  3.77it/s, failures=0, objective=-87.7]
HPO - Large Problem:  32%|███▎      | 65/200 [00:10<00:35,  3.77it/s, failures=0, objective=-87.7]
HPO - Large Problem:  33%|███▎      | 66/200 [00:10<00:33,  3.99it/s, failures=0, objective=-87.7]
HPO - Large Problem:  33%|███▎      | 66/200 [00:10<00:33,  3.99it/s, failures=0, objective=-87.7]
HPO - Large Problem:  34%|███▎      | 67/200 [00:10<00:31,  4.18it/s, failures=0, objective=-87.7]
HPO - Large Problem:  34%|███▎      | 67/200 [00:10<00:31,  4.18it/s, failures=0, objective=-87.7]
HPO - Large Problem:  34%|███▍      | 68/200 [00:11<00:30,  4.34it/s, failures=0, objective=-87.7]
HPO - Large Problem:  34%|███▍      | 68/200 [00:11<00:30,  4.34it/s, failures=0, objective=-87.7]
HPO - Large Problem:  34%|███▍      | 69/200 [00:11<00:33,  3.87it/s, failures=0, objective=-87.7]
HPO - Large Problem:  34%|███▍      | 69/200 [00:11<00:33,  3.87it/s, failures=0, objective=-87.7]
HPO - Large Problem:  35%|███▌      | 70/200 [00:11<00:33,  3.86it/s, failures=0, objective=-87.7]
HPO - Large Problem:  35%|███▌      | 70/200 [00:11<00:33,  3.86it/s, failures=0, objective=-87.7]
HPO - Large Problem:  36%|███▌      | 71/200 [00:11<00:32,  3.96it/s, failures=0, objective=-87.7]
HPO - Large Problem:  36%|███▌      | 71/200 [00:11<00:32,  3.96it/s, failures=0, objective=-33]
HPO - Large Problem:  36%|███▌      | 72/200 [00:12<00:36,  3.53it/s, failures=0, objective=-33]
HPO - Large Problem:  36%|███▌      | 72/200 [00:12<00:36,  3.53it/s, failures=0, objective=-33]
HPO - Large Problem:  36%|███▋      | 73/200 [00:12<00:36,  3.53it/s, failures=0, objective=-33]
HPO - Large Problem:  36%|███▋      | 73/200 [00:12<00:36,  3.53it/s, failures=0, objective=-33]
HPO - Large Problem:  37%|███▋      | 74/200 [00:12<00:34,  3.68it/s, failures=0, objective=-33]
HPO - Large Problem:  37%|███▋      | 74/200 [00:12<00:34,  3.68it/s, failures=0, objective=-33]
HPO - Large Problem:  38%|███▊      | 75/200 [00:13<00:33,  3.79it/s, failures=0, objective=-33]
HPO - Large Problem:  38%|███▊      | 75/200 [00:13<00:33,  3.79it/s, failures=0, objective=-33]
HPO - Large Problem:  38%|███▊      | 76/200 [00:13<00:32,  3.87it/s, failures=0, objective=-33]
HPO - Large Problem:  38%|███▊      | 76/200 [00:13<00:32,  3.87it/s, failures=0, objective=-33]
HPO - Large Problem:  38%|███▊      | 77/200 [00:13<00:31,  3.89it/s, failures=0, objective=-33]
HPO - Large Problem:  38%|███▊      | 77/200 [00:13<00:31,  3.89it/s, failures=0, objective=-33]
HPO - Large Problem:  39%|███▉      | 78/200 [00:13<00:30,  3.94it/s, failures=0, objective=-33]
HPO - Large Problem:  39%|███▉      | 78/200 [00:13<00:30,  3.94it/s, failures=0, objective=-33]
HPO - Large Problem:  40%|███▉      | 79/200 [00:14<00:29,  4.05it/s, failures=0, objective=-33]
HPO - Large Problem:  40%|███▉      | 79/200 [00:14<00:29,  4.05it/s, failures=0, objective=-33]
HPO - Large Problem:  40%|████      | 80/200 [00:14<00:33,  3.63it/s, failures=0, objective=-33]
HPO - Large Problem:  40%|████      | 80/200 [00:14<00:33,  3.63it/s, failures=0, objective=-33]
HPO - Large Problem:  40%|████      | 81/200 [00:14<00:31,  3.76it/s, failures=0, objective=-33]
HPO - Large Problem:  40%|████      | 81/200 [00:14<00:31,  3.76it/s, failures=0, objective=-33]
HPO - Large Problem:  41%|████      | 82/200 [00:14<00:31,  3.79it/s, failures=0, objective=-33]
HPO - Large Problem:  41%|████      | 82/200 [00:14<00:31,  3.79it/s, failures=0, objective=-33]
HPO - Large Problem:  42%|████▏     | 83/200 [00:15<00:32,  3.60it/s, failures=0, objective=-33]
HPO - Large Problem:  42%|████▏     | 83/200 [00:15<00:32,  3.60it/s, failures=0, objective=-33]
HPO - Large Problem:  42%|████▏     | 84/200 [00:15<00:33,  3.46it/s, failures=0, objective=-33]
HPO - Large Problem:  42%|████▏     | 84/200 [00:15<00:33,  3.46it/s, failures=0, objective=-33]
HPO - Large Problem:  42%|████▎     | 85/200 [00:15<00:33,  3.42it/s, failures=0, objective=-33]
HPO - Large Problem:  42%|████▎     | 85/200 [00:15<00:33,  3.42it/s, failures=0, objective=-33]
HPO - Large Problem:  43%|████▎     | 86/200 [00:16<00:32,  3.50it/s, failures=0, objective=-33]
HPO - Large Problem:  43%|████▎     | 86/200 [00:16<00:32,  3.50it/s, failures=0, objective=-33]
HPO - Large Problem:  44%|████▎     | 87/200 [00:16<00:31,  3.63it/s, failures=0, objective=-33]
HPO - Large Problem:  44%|████▎     | 87/200 [00:16<00:31,  3.63it/s, failures=0, objective=-29.6]
HPO - Large Problem:  44%|████▍     | 88/200 [00:16<00:30,  3.62it/s, failures=0, objective=-29.6]
HPO - Large Problem:  44%|████▍     | 88/200 [00:16<00:30,  3.62it/s, failures=0, objective=-29.6]
HPO - Large Problem:  44%|████▍     | 89/200 [00:16<00:31,  3.57it/s, failures=0, objective=-29.6]
HPO - Large Problem:  44%|████▍     | 89/200 [00:16<00:31,  3.57it/s, failures=0, objective=-29.6]
HPO - Large Problem:  45%|████▌     | 90/200 [00:17<00:32,  3.38it/s, failures=0, objective=-29.6]
HPO - Large Problem:  45%|████▌     | 90/200 [00:17<00:32,  3.38it/s, failures=0, objective=-29.3]
HPO - Large Problem:  46%|████▌     | 91/200 [00:17<00:31,  3.50it/s, failures=0, objective=-29.3]
HPO - Large Problem:  46%|████▌     | 91/200 [00:17<00:31,  3.50it/s, failures=0, objective=-29.3]
HPO - Large Problem:  46%|████▌     | 92/200 [00:17<00:31,  3.48it/s, failures=0, objective=-29.3]
HPO - Large Problem:  46%|████▌     | 92/200 [00:17<00:31,  3.48it/s, failures=0, objective=-22.5]
HPO - Large Problem:  46%|████▋     | 93/200 [00:18<00:30,  3.47it/s, failures=0, objective=-22.5]
HPO - Large Problem:  46%|████▋     | 93/200 [00:18<00:30,  3.47it/s, failures=0, objective=-22.5]
HPO - Large Problem:  47%|████▋     | 94/200 [00:18<00:29,  3.61it/s, failures=0, objective=-22.5]
HPO - Large Problem:  47%|████▋     | 94/200 [00:18<00:29,  3.61it/s, failures=0, objective=-22.5]
HPO - Large Problem:  48%|████▊     | 95/200 [00:18<00:28,  3.74it/s, failures=0, objective=-22.5]
HPO - Large Problem:  48%|████▊     | 95/200 [00:18<00:28,  3.74it/s, failures=0, objective=-22.5]
HPO - Large Problem:  48%|████▊     | 96/200 [00:18<00:30,  3.46it/s, failures=0, objective=-22.5]
HPO - Large Problem:  48%|████▊     | 96/200 [00:18<00:30,  3.46it/s, failures=0, objective=-22.5]
HPO - Large Problem:  48%|████▊     | 97/200 [00:19<00:29,  3.46it/s, failures=0, objective=-22.5]
HPO - Large Problem:  48%|████▊     | 97/200 [00:19<00:29,  3.46it/s, failures=0, objective=-22.5]
HPO - Large Problem:  49%|████▉     | 98/200 [00:19<00:28,  3.57it/s, failures=0, objective=-22.5]
HPO - Large Problem:  49%|████▉     | 98/200 [00:19<00:28,  3.57it/s, failures=0, objective=-22.5]
HPO - Large Problem:  50%|████▉     | 99/200 [00:19<00:28,  3.59it/s, failures=0, objective=-22.5]
HPO - Large Problem:  50%|████▉     | 99/200 [00:19<00:28,  3.59it/s, failures=0, objective=-22.5]
HPO - Large Problem:  50%|█████     | 100/200 [00:20<00:28,  3.46it/s, failures=0, objective=-22.5]
HPO - Large Problem:  50%|█████     | 100/200 [00:20<00:28,  3.46it/s, failures=0, objective=-22.5]
HPO - Large Problem:  50%|█████     | 101/200 [00:20<00:28,  3.43it/s, failures=0, objective=-22.5]
HPO - Large Problem:  50%|█████     | 101/200 [00:20<00:28,  3.43it/s, failures=0, objective=-22.5]
HPO - Large Problem:  51%|█████     | 102/200 [00:20<00:30,  3.18it/s, failures=0, objective=-22.5]
HPO - Large Problem:  51%|█████     | 102/200 [00:20<00:30,  3.18it/s, failures=0, objective=-22.5]
HPO - Large Problem:  52%|█████▏    | 103/200 [00:20<00:28,  3.35it/s, failures=0, objective=-22.5]
HPO - Large Problem:  52%|█████▏    | 103/200 [00:20<00:28,  3.35it/s, failures=0, objective=-22.5]
HPO - Large Problem:  52%|█████▏    | 104/200 [00:21<00:29,  3.30it/s, failures=0, objective=-22.5]
HPO - Large Problem:  52%|█████▏    | 104/200 [00:21<00:29,  3.30it/s, failures=0, objective=-22.5]
HPO - Large Problem:  52%|█████▎    | 105/200 [00:21<00:28,  3.35it/s, failures=0, objective=-22.5]
HPO - Large Problem:  52%|█████▎    | 105/200 [00:21<00:28,  3.35it/s, failures=0, objective=-16.4]
HPO - Large Problem:  53%|█████▎    | 106/200 [00:21<00:28,  3.35it/s, failures=0, objective=-16.4]
HPO - Large Problem:  53%|█████▎    | 106/200 [00:21<00:28,  3.35it/s, failures=0, objective=-16.4]
HPO - Large Problem:  54%|█████▎    | 107/200 [00:22<00:28,  3.29it/s, failures=0, objective=-16.4]
HPO - Large Problem:  54%|█████▎    | 107/200 [00:22<00:28,  3.29it/s, failures=0, objective=-16.4]
HPO - Large Problem:  54%|█████▍    | 108/200 [00:22<00:28,  3.28it/s, failures=0, objective=-16.4]
HPO - Large Problem:  54%|█████▍    | 108/200 [00:22<00:28,  3.28it/s, failures=0, objective=-16.4]
HPO - Large Problem:  55%|█████▍    | 109/200 [00:22<00:27,  3.33it/s, failures=0, objective=-16.4]
HPO - Large Problem:  55%|█████▍    | 109/200 [00:22<00:27,  3.33it/s, failures=0, objective=-16.4]
HPO - Large Problem:  55%|█████▌    | 110/200 [00:23<00:26,  3.37it/s, failures=0, objective=-16.4]
HPO - Large Problem:  55%|█████▌    | 110/200 [00:23<00:26,  3.37it/s, failures=0, objective=-16.4]
HPO - Large Problem:  56%|█████▌    | 111/200 [00:23<00:28,  3.12it/s, failures=0, objective=-16.4]
HPO - Large Problem:  56%|█████▌    | 111/200 [00:23<00:28,  3.12it/s, failures=0, objective=-16.4]
HPO - Large Problem:  56%|█████▌    | 112/200 [00:23<00:28,  3.09it/s, failures=0, objective=-16.4]
HPO - Large Problem:  56%|█████▌    | 112/200 [00:23<00:28,  3.09it/s, failures=0, objective=-16.4]
HPO - Large Problem:  56%|█████▋    | 113/200 [00:24<00:26,  3.28it/s, failures=0, objective=-16.4]
HPO - Large Problem:  56%|█████▋    | 113/200 [00:24<00:26,  3.28it/s, failures=0, objective=-16.4]
HPO - Large Problem:  57%|█████▋    | 114/200 [00:24<00:28,  2.97it/s, failures=0, objective=-16.4]
HPO - Large Problem:  57%|█████▋    | 114/200 [00:24<00:28,  2.97it/s, failures=0, objective=-16.4]
HPO - Large Problem:  57%|█████▊    | 115/200 [00:24<00:29,  2.89it/s, failures=0, objective=-16.4]
HPO - Large Problem:  57%|█████▊    | 115/200 [00:24<00:29,  2.89it/s, failures=0, objective=-16.4]
HPO - Large Problem:  58%|█████▊    | 116/200 [00:25<00:30,  2.71it/s, failures=0, objective=-16.4]
HPO - Large Problem:  58%|█████▊    | 116/200 [00:25<00:30,  2.71it/s, failures=0, objective=-16.4]
HPO - Large Problem:  58%|█████▊    | 117/200 [00:25<00:29,  2.78it/s, failures=0, objective=-16.4]
HPO - Large Problem:  58%|█████▊    | 117/200 [00:25<00:29,  2.78it/s, failures=0, objective=-16.4]
HPO - Large Problem:  59%|█████▉    | 118/200 [00:25<00:30,  2.66it/s, failures=0, objective=-16.4]
HPO - Large Problem:  59%|█████▉    | 118/200 [00:25<00:30,  2.66it/s, failures=0, objective=-14.7]
HPO - Large Problem:  60%|█████▉    | 119/200 [00:26<00:31,  2.54it/s, failures=0, objective=-14.7]
HPO - Large Problem:  60%|█████▉    | 119/200 [00:26<00:31,  2.54it/s, failures=0, objective=-14.7]
HPO - Large Problem:  60%|██████    | 120/200 [00:26<00:30,  2.61it/s, failures=0, objective=-14.7]
HPO - Large Problem:  60%|██████    | 120/200 [00:26<00:30,  2.61it/s, failures=0, objective=-14.7]
HPO - Large Problem:  60%|██████    | 121/200 [00:27<00:34,  2.26it/s, failures=0, objective=-14.7]
HPO - Large Problem:  60%|██████    | 121/200 [00:27<00:34,  2.26it/s, failures=0, objective=-14.7]
HPO - Large Problem:  61%|██████    | 122/200 [00:27<00:33,  2.33it/s, failures=0, objective=-14.7]
HPO - Large Problem:  61%|██████    | 122/200 [00:27<00:33,  2.33it/s, failures=0, objective=-14.7]
HPO - Large Problem:  62%|██████▏   | 123/200 [00:28<00:39,  1.95it/s, failures=0, objective=-14.7]
HPO - Large Problem:  62%|██████▏   | 123/200 [00:28<00:39,  1.95it/s, failures=0, objective=-14.7]
HPO - Large Problem:  62%|██████▏   | 124/200 [00:28<00:35,  2.12it/s, failures=0, objective=-14.7]
HPO - Large Problem:  62%|██████▏   | 124/200 [00:28<00:35,  2.12it/s, failures=0, objective=-14.7]
HPO - Large Problem:  62%|██████▎   | 125/200 [00:29<00:33,  2.26it/s, failures=0, objective=-14.7]
HPO - Large Problem:  62%|██████▎   | 125/200 [00:29<00:33,  2.26it/s, failures=0, objective=-14.7]
HPO - Large Problem:  63%|██████▎   | 126/200 [00:29<00:32,  2.26it/s, failures=0, objective=-14.7]
HPO - Large Problem:  63%|██████▎   | 126/200 [00:29<00:32,  2.26it/s, failures=0, objective=-14.7]
HPO - Large Problem:  64%|██████▎   | 127/200 [00:29<00:29,  2.47it/s, failures=0, objective=-14.7]
HPO - Large Problem:  64%|██████▎   | 127/200 [00:29<00:29,  2.47it/s, failures=0, objective=-14.7]
HPO - Large Problem:  64%|██████▍   | 128/200 [00:30<00:28,  2.57it/s, failures=0, objective=-14.7]
HPO - Large Problem:  64%|██████▍   | 128/200 [00:30<00:28,  2.57it/s, failures=0, objective=-14.7]
HPO - Large Problem:  64%|██████▍   | 129/200 [00:30<00:28,  2.47it/s, failures=0, objective=-14.7]
HPO - Large Problem:  64%|██████▍   | 129/200 [00:30<00:28,  2.47it/s, failures=0, objective=-12.5]
HPO - Large Problem:  65%|██████▌   | 130/200 [00:31<00:27,  2.52it/s, failures=0, objective=-12.5]
HPO - Large Problem:  65%|██████▌   | 130/200 [00:31<00:27,  2.52it/s, failures=0, objective=-12.5]
HPO - Large Problem:  66%|██████▌   | 131/200 [00:31<00:25,  2.68it/s, failures=0, objective=-12.5]
HPO - Large Problem:  66%|██████▌   | 131/200 [00:31<00:25,  2.68it/s, failures=0, objective=-12.2]
HPO - Large Problem:  66%|██████▌   | 132/200 [00:31<00:23,  2.87it/s, failures=0, objective=-12.2]
HPO - Large Problem:  66%|██████▌   | 132/200 [00:31<00:23,  2.87it/s, failures=0, objective=-12.2]
HPO - Large Problem:  66%|██████▋   | 133/200 [00:32<00:24,  2.77it/s, failures=0, objective=-12.2]
HPO - Large Problem:  66%|██████▋   | 133/200 [00:32<00:24,  2.77it/s, failures=0, objective=-12.2]
HPO - Large Problem:  67%|██████▋   | 134/200 [00:32<00:25,  2.57it/s, failures=0, objective=-12.2]
HPO - Large Problem:  67%|██████▋   | 134/200 [00:32<00:25,  2.57it/s, failures=0, objective=-12.2]
HPO - Large Problem:  68%|██████▊   | 135/200 [00:33<00:25,  2.55it/s, failures=0, objective=-12.2]
HPO - Large Problem:  68%|██████▊   | 135/200 [00:33<00:25,  2.55it/s, failures=0, objective=-12.2]
HPO - Large Problem:  68%|██████▊   | 136/200 [00:33<00:25,  2.51it/s, failures=0, objective=-12.2]
HPO - Large Problem:  68%|██████▊   | 136/200 [00:33<00:25,  2.51it/s, failures=0, objective=-11.5]
HPO - Large Problem:  68%|██████▊   | 137/200 [00:33<00:25,  2.49it/s, failures=0, objective=-11.5]
HPO - Large Problem:  68%|██████▊   | 137/200 [00:33<00:25,  2.49it/s, failures=0, objective=-11.5]
HPO - Large Problem:  69%|██████▉   | 138/200 [00:34<00:24,  2.52it/s, failures=0, objective=-11.5]
HPO - Large Problem:  69%|██████▉   | 138/200 [00:34<00:24,  2.52it/s, failures=0, objective=-9.2]
HPO - Large Problem:  70%|██████▉   | 139/200 [00:34<00:23,  2.57it/s, failures=0, objective=-9.2]
HPO - Large Problem:  70%|██████▉   | 139/200 [00:34<00:23,  2.57it/s, failures=0, objective=-9.2]
HPO - Large Problem:  70%|███████   | 140/200 [00:34<00:23,  2.57it/s, failures=0, objective=-9.2]
HPO - Large Problem:  70%|███████   | 140/200 [00:34<00:23,  2.57it/s, failures=0, objective=-9.2]
HPO - Large Problem:  70%|███████   | 141/200 [00:35<00:22,  2.62it/s, failures=0, objective=-9.2]
HPO - Large Problem:  70%|███████   | 141/200 [00:35<00:22,  2.62it/s, failures=0, objective=-9.2]
HPO - Large Problem:  71%|███████   | 142/200 [00:35<00:22,  2.63it/s, failures=0, objective=-9.2]
HPO - Large Problem:  71%|███████   | 142/200 [00:35<00:22,  2.63it/s, failures=0, objective=-9.2]
HPO - Large Problem:  72%|███████▏  | 143/200 [00:36<00:21,  2.64it/s, failures=0, objective=-9.2]
HPO - Large Problem:  72%|███████▏  | 143/200 [00:36<00:21,  2.64it/s, failures=0, objective=-9.2]
HPO - Large Problem:  72%|███████▏  | 144/200 [00:36<00:22,  2.46it/s, failures=0, objective=-9.2]
HPO - Large Problem:  72%|███████▏  | 144/200 [00:36<00:22,  2.46it/s, failures=0, objective=-9.2]
HPO - Large Problem:  72%|███████▎  | 145/200 [00:36<00:20,  2.64it/s, failures=0, objective=-9.2]
HPO - Large Problem:  72%|███████▎  | 145/200 [00:36<00:20,  2.64it/s, failures=0, objective=-9.2]
HPO - Large Problem:  73%|███████▎  | 146/200 [00:37<00:20,  2.68it/s, failures=0, objective=-9.2]
HPO - Large Problem:  73%|███████▎  | 146/200 [00:37<00:20,  2.68it/s, failures=0, objective=-9.2]
HPO - Large Problem:  74%|███████▎  | 147/200 [00:37<00:19,  2.74it/s, failures=0, objective=-9.2]
HPO - Large Problem:  74%|███████▎  | 147/200 [00:37<00:19,  2.74it/s, failures=0, objective=-9.2]
HPO - Large Problem:  74%|███████▍  | 148/200 [00:38<00:21,  2.39it/s, failures=0, objective=-9.2]
HPO - Large Problem:  74%|███████▍  | 148/200 [00:38<00:21,  2.39it/s, failures=0, objective=-9.2]
HPO - Large Problem:  74%|███████▍  | 149/200 [00:38<00:22,  2.26it/s, failures=0, objective=-9.2]
HPO - Large Problem:  74%|███████▍  | 149/200 [00:38<00:22,  2.26it/s, failures=0, objective=-9.2]
HPO - Large Problem:  75%|███████▌  | 150/200 [00:39<00:21,  2.30it/s, failures=0, objective=-9.2]
HPO - Large Problem:  75%|███████▌  | 150/200 [00:39<00:21,  2.30it/s, failures=0, objective=-8.61]
HPO - Large Problem:  76%|███████▌  | 151/200 [00:39<00:21,  2.32it/s, failures=0, objective=-8.61]
HPO - Large Problem:  76%|███████▌  | 151/200 [00:39<00:21,  2.32it/s, failures=0, objective=-8.61]
HPO - Large Problem:  76%|███████▌  | 152/200 [00:40<00:23,  2.06it/s, failures=0, objective=-8.61]
HPO - Large Problem:  76%|███████▌  | 152/200 [00:40<00:23,  2.06it/s, failures=0, objective=-8.61]
HPO - Large Problem:  76%|███████▋  | 153/200 [00:40<00:20,  2.30it/s, failures=0, objective=-8.61]
HPO - Large Problem:  76%|███████▋  | 153/200 [00:40<00:20,  2.30it/s, failures=0, objective=-8.61]
HPO - Large Problem:  77%|███████▋  | 154/200 [00:40<00:20,  2.25it/s, failures=0, objective=-8.61]
HPO - Large Problem:  77%|███████▋  | 154/200 [00:40<00:20,  2.25it/s, failures=0, objective=-8.61]
HPO - Large Problem:  78%|███████▊  | 155/200 [00:41<00:18,  2.50it/s, failures=0, objective=-8.61]
HPO - Large Problem:  78%|███████▊  | 155/200 [00:41<00:18,  2.50it/s, failures=0, objective=-8.61]
HPO - Large Problem:  78%|███████▊  | 156/200 [00:41<00:17,  2.54it/s, failures=0, objective=-8.61]
HPO - Large Problem:  78%|███████▊  | 156/200 [00:41<00:17,  2.54it/s, failures=0, objective=-7.14]
HPO - Large Problem:  78%|███████▊  | 157/200 [00:41<00:16,  2.64it/s, failures=0, objective=-7.14]
HPO - Large Problem:  78%|███████▊  | 157/200 [00:41<00:16,  2.64it/s, failures=0, objective=-7.14]
HPO - Large Problem:  79%|███████▉  | 158/200 [00:42<00:15,  2.75it/s, failures=0, objective=-7.14]
HPO - Large Problem:  79%|███████▉  | 158/200 [00:42<00:15,  2.75it/s, failures=0, objective=-7.13]
HPO - Large Problem:  80%|███████▉  | 159/200 [00:42<00:15,  2.67it/s, failures=0, objective=-7.13]
HPO - Large Problem:  80%|███████▉  | 159/200 [00:42<00:15,  2.67it/s, failures=0, objective=-7.13]
HPO - Large Problem:  80%|████████  | 160/200 [00:42<00:15,  2.65it/s, failures=0, objective=-7.13]
HPO - Large Problem:  80%|████████  | 160/200 [00:42<00:15,  2.65it/s, failures=0, objective=-7.13]
HPO - Large Problem:  80%|████████  | 161/200 [00:43<00:14,  2.72it/s, failures=0, objective=-7.13]
HPO - Large Problem:  80%|████████  | 161/200 [00:43<00:14,  2.72it/s, failures=0, objective=-7.13]
HPO - Large Problem:  81%|████████  | 162/200 [00:43<00:14,  2.64it/s, failures=0, objective=-7.13]
HPO - Large Problem:  81%|████████  | 162/200 [00:43<00:14,  2.64it/s, failures=0, objective=-7.13]
HPO - Large Problem:  82%|████████▏ | 163/200 [00:44<00:16,  2.25it/s, failures=0, objective=-7.13]
HPO - Large Problem:  82%|████████▏ | 163/200 [00:44<00:16,  2.25it/s, failures=0, objective=-7.13]
HPO - Large Problem:  82%|████████▏ | 164/200 [00:44<00:14,  2.44it/s, failures=0, objective=-7.13]
HPO - Large Problem:  82%|████████▏ | 164/200 [00:44<00:14,  2.44it/s, failures=0, objective=-7.13]
HPO - Large Problem:  82%|████████▎ | 165/200 [00:44<00:13,  2.63it/s, failures=0, objective=-7.13]
HPO - Large Problem:  82%|████████▎ | 165/200 [00:44<00:13,  2.63it/s, failures=0, objective=-7.13]
HPO - Large Problem:  83%|████████▎ | 166/200 [00:45<00:13,  2.46it/s, failures=0, objective=-7.13]
HPO - Large Problem:  83%|████████▎ | 166/200 [00:45<00:13,  2.46it/s, failures=0, objective=-7.13]
HPO - Large Problem:  84%|████████▎ | 167/200 [00:45<00:13,  2.52it/s, failures=0, objective=-7.13]
HPO - Large Problem:  84%|████████▎ | 167/200 [00:45<00:13,  2.52it/s, failures=0, objective=-7.13]
HPO - Large Problem:  84%|████████▍ | 168/200 [00:46<00:11,  2.70it/s, failures=0, objective=-7.13]
HPO - Large Problem:  84%|████████▍ | 168/200 [00:46<00:11,  2.70it/s, failures=0, objective=-7.13]
HPO - Large Problem:  84%|████████▍ | 169/200 [00:46<00:11,  2.78it/s, failures=0, objective=-7.13]
HPO - Large Problem:  84%|████████▍ | 169/200 [00:46<00:11,  2.78it/s, failures=0, objective=-7.13]
HPO - Large Problem:  85%|████████▌ | 170/200 [00:46<00:10,  2.74it/s, failures=0, objective=-7.13]
HPO - Large Problem:  85%|████████▌ | 170/200 [00:46<00:10,  2.74it/s, failures=0, objective=-7.13]
HPO - Large Problem:  86%|████████▌ | 171/200 [00:47<00:10,  2.77it/s, failures=0, objective=-7.13]
HPO - Large Problem:  86%|████████▌ | 171/200 [00:47<00:10,  2.77it/s, failures=0, objective=-5.43]
HPO - Large Problem:  86%|████████▌ | 172/200 [00:47<00:09,  2.91it/s, failures=0, objective=-5.43]
HPO - Large Problem:  86%|████████▌ | 172/200 [00:47<00:09,  2.91it/s, failures=0, objective=-5.43]
HPO - Large Problem:  86%|████████▋ | 173/200 [00:47<00:09,  2.81it/s, failures=0, objective=-5.43]
HPO - Large Problem:  86%|████████▋ | 173/200 [00:47<00:09,  2.81it/s, failures=0, objective=-5.43]
HPO - Large Problem:  87%|████████▋ | 174/200 [00:48<00:10,  2.47it/s, failures=0, objective=-5.43]
HPO - Large Problem:  87%|████████▋ | 174/200 [00:48<00:10,  2.47it/s, failures=0, objective=-5.43]
HPO - Large Problem:  88%|████████▊ | 175/200 [00:48<00:09,  2.59it/s, failures=0, objective=-5.43]
HPO - Large Problem:  88%|████████▊ | 175/200 [00:48<00:09,  2.59it/s, failures=0, objective=-5.43]
HPO - Large Problem:  88%|████████▊ | 176/200 [00:49<00:08,  2.78it/s, failures=0, objective=-5.43]
HPO - Large Problem:  88%|████████▊ | 176/200 [00:49<00:08,  2.78it/s, failures=0, objective=-5.43]
HPO - Large Problem:  88%|████████▊ | 177/200 [00:49<00:07,  2.95it/s, failures=0, objective=-5.43]
HPO - Large Problem:  88%|████████▊ | 177/200 [00:49<00:07,  2.95it/s, failures=0, objective=-5.43]
HPO - Large Problem:  89%|████████▉ | 178/200 [00:49<00:07,  2.93it/s, failures=0, objective=-5.43]
HPO - Large Problem:  89%|████████▉ | 178/200 [00:49<00:07,  2.93it/s, failures=0, objective=-5.27]
HPO - Large Problem:  90%|████████▉ | 179/200 [00:50<00:07,  2.78it/s, failures=0, objective=-5.27]
HPO - Large Problem:  90%|████████▉ | 179/200 [00:50<00:07,  2.78it/s, failures=0, objective=-5.27]
HPO - Large Problem:  90%|█████████ | 180/200 [00:50<00:07,  2.79it/s, failures=0, objective=-5.27]
HPO - Large Problem:  90%|█████████ | 180/200 [00:50<00:07,  2.79it/s, failures=0, objective=-5.27]
HPO - Large Problem:  90%|█████████ | 181/200 [00:50<00:07,  2.59it/s, failures=0, objective=-5.27]
HPO - Large Problem:  90%|█████████ | 181/200 [00:50<00:07,  2.59it/s, failures=0, objective=-5.27]
HPO - Large Problem:  91%|█████████ | 182/200 [00:51<00:06,  2.72it/s, failures=0, objective=-5.27]
HPO - Large Problem:  91%|█████████ | 182/200 [00:51<00:06,  2.72it/s, failures=0, objective=-5.27]
HPO - Large Problem:  92%|█████████▏| 183/200 [00:51<00:06,  2.83it/s, failures=0, objective=-5.27]
HPO - Large Problem:  92%|█████████▏| 183/200 [00:51<00:06,  2.83it/s, failures=0, objective=-5.27]
HPO - Large Problem:  92%|█████████▏| 184/200 [00:51<00:06,  2.64it/s, failures=0, objective=-5.27]
HPO - Large Problem:  92%|█████████▏| 184/200 [00:51<00:06,  2.64it/s, failures=0, objective=-5.27]
HPO - Large Problem:  92%|█████████▎| 185/200 [00:52<00:06,  2.34it/s, failures=0, objective=-5.27]
HPO - Large Problem:  92%|█████████▎| 185/200 [00:52<00:06,  2.34it/s, failures=0, objective=-5.27]
HPO - Large Problem:  93%|█████████▎| 186/200 [00:52<00:05,  2.51it/s, failures=0, objective=-5.27]
HPO - Large Problem:  93%|█████████▎| 186/200 [00:52<00:05,  2.51it/s, failures=0, objective=-5.27]
HPO - Large Problem:  94%|█████████▎| 187/200 [00:53<00:05,  2.42it/s, failures=0, objective=-5.27]
HPO - Large Problem:  94%|█████████▎| 187/200 [00:53<00:05,  2.42it/s, failures=0, objective=-4.34]
HPO - Large Problem:  94%|█████████▍| 188/200 [00:53<00:04,  2.58it/s, failures=0, objective=-4.34]
HPO - Large Problem:  94%|█████████▍| 188/200 [00:53<00:04,  2.58it/s, failures=0, objective=-4.34]
HPO - Large Problem:  94%|█████████▍| 189/200 [00:53<00:04,  2.66it/s, failures=0, objective=-4.34]
HPO - Large Problem:  94%|█████████▍| 189/200 [00:53<00:04,  2.66it/s, failures=0, objective=-4.34]
HPO - Large Problem:  95%|█████████▌| 190/200 [00:54<00:04,  2.42it/s, failures=0, objective=-4.34]
HPO - Large Problem:  95%|█████████▌| 190/200 [00:54<00:04,  2.42it/s, failures=0, objective=-4.34]
HPO - Large Problem:  96%|█████████▌| 191/200 [00:54<00:03,  2.32it/s, failures=0, objective=-4.34]
HPO - Large Problem:  96%|█████████▌| 191/200 [00:54<00:03,  2.32it/s, failures=0, objective=-3.72]
HPO - Large Problem:  96%|█████████▌| 192/200 [00:55<00:03,  2.46it/s, failures=0, objective=-3.72]
HPO - Large Problem:  96%|█████████▌| 192/200 [00:55<00:03,  2.46it/s, failures=0, objective=-3.72]
HPO - Large Problem:  96%|█████████▋| 193/200 [00:55<00:02,  2.55it/s, failures=0, objective=-3.72]
HPO - Large Problem:  96%|█████████▋| 193/200 [00:55<00:02,  2.55it/s, failures=0, objective=-3.72]
HPO - Large Problem:  97%|█████████▋| 194/200 [00:56<00:02,  2.39it/s, failures=0, objective=-3.72]
HPO - Large Problem:  97%|█████████▋| 194/200 [00:56<00:02,  2.39it/s, failures=0, objective=-3.72]
HPO - Large Problem:  98%|█████████▊| 195/200 [00:56<00:01,  2.55it/s, failures=0, objective=-3.72]
HPO - Large Problem:  98%|█████████▊| 195/200 [00:56<00:01,  2.55it/s, failures=0, objective=-3.72]
HPO - Large Problem:  98%|█████████▊| 196/200 [00:56<00:01,  2.41it/s, failures=0, objective=-3.72]
HPO - Large Problem:  98%|█████████▊| 196/200 [00:56<00:01,  2.41it/s, failures=0, objective=-3.32]
HPO - Large Problem:  98%|█████████▊| 197/200 [00:57<00:01,  2.53it/s, failures=0, objective=-3.32]
HPO - Large Problem:  98%|█████████▊| 197/200 [00:57<00:01,  2.53it/s, failures=0, objective=-3.32]
HPO - Large Problem:  99%|█████████▉| 198/200 [00:57<00:00,  2.69it/s, failures=0, objective=-3.32]
HPO - Large Problem:  99%|█████████▉| 198/200 [00:57<00:00,  2.69it/s, failures=0, objective=-3.32]
HPO - Large Problem: 100%|█████████▉| 199/200 [00:58<00:00,  2.45it/s, failures=0, objective=-3.32]
HPO - Large Problem: 100%|█████████▉| 199/200 [00:58<00:00,  2.45it/s, failures=0, objective=-3.32]
HPO - Large Problem: 100%|██████████| 200/200 [00:58<00:00,  2.58it/s, failures=0, objective=-3.32]
HPO - Large Problem: 100%|██████████| 200/200 [00:58<00:00,  2.58it/s, failures=0, objective=-2.72]
HPO - Large Problem: 100%|██████████| 200/200 [00:58<00:00,  3.42it/s, failures=0, objective=-2.72]

Finally, we run the search on the large problem with transfer learning from the results of the small problem that we computed first:

evaluator_large_tl = Evaluator.create(
    run_large,
    method="thread",
    method_kwargs={"callbacks": [TqdmCallback("HPO - Large Problem with TL")]},
)
search_large_tl = CBO(
    problem_large,
    evaluator_large_tl,
    n_initial_points=2 * n_large + 1,
    **search_kwargs,
)

# This is where transfer learning happens
search_large_tl.fit_generative_model(results_small)

results["Large+TL"] = search_large_tl.search(max_evals)

WARNING:root:Results file already exists, it will be renamed to /Users/romainegele/Documents/DeepHyper/deephyper/examples/examples_bbo/results_20250326-115228.csv

  0%|          | 0/200 [00:00<?, ?it/s]
HPO - Large Problem with TL:   0%|          | 0/200 [00:00<?, ?it/s]
HPO - Large Problem with TL:   0%|          | 1/200 [00:00<00:00, 4481.09it/s, failures=0, objective=-71.2]
HPO - Large Problem with TL:   1%|          | 2/200 [00:00<00:06, 28.53it/s, failures=0, objective=-71.2]
HPO - Large Problem with TL:   2%|▏         | 3/200 [00:00<00:08, 22.06it/s, failures=0, objective=-71.2]
HPO - Large Problem with TL:   2%|▏         | 3/200 [00:00<00:08, 22.06it/s, failures=0, objective=-71.2]
HPO - Large Problem with TL:   2%|▏         | 4/200 [00:00<00:08, 22.06it/s, failures=0, objective=-71.2]
HPO - Large Problem with TL:   2%|▎         | 5/200 [00:00<00:08, 22.06it/s, failures=0, objective=-71.2]
HPO - Large Problem with TL:   3%|▎         | 6/200 [00:00<00:12, 15.43it/s, failures=0, objective=-71.2]
HPO - Large Problem with TL:   3%|▎         | 6/200 [00:00<00:12, 15.43it/s, failures=0, objective=-71.2]
HPO - Large Problem with TL:   4%|▎         | 7/200 [00:00<00:12, 15.43it/s, failures=0, objective=-71.2]
HPO - Large Problem with TL:   4%|▍         | 8/200 [00:00<00:12, 15.43it/s, failures=0, objective=-56.9]
HPO - Large Problem with TL:   4%|▍         | 9/200 [00:00<00:10, 18.02it/s, failures=0, objective=-56.9]
HPO - Large Problem with TL:   4%|▍         | 9/200 [00:00<00:10, 18.02it/s, failures=0, objective=-56.9]
HPO - Large Problem with TL:   5%|▌         | 10/200 [00:00<00:10, 18.02it/s, failures=0, objective=-56.9]
HPO - Large Problem with TL:   6%|▌         | 11/200 [00:00<00:10, 18.02it/s, failures=0, objective=-56.9]
HPO - Large Problem with TL:   6%|▌         | 12/200 [00:00<00:09, 19.32it/s, failures=0, objective=-56.9]
HPO - Large Problem with TL:   6%|▌         | 12/200 [00:00<00:09, 19.32it/s, failures=0, objective=-56.9]
HPO - Large Problem with TL:   6%|▋         | 13/200 [00:00<00:09, 19.32it/s, failures=0, objective=-56.9]
HPO - Large Problem with TL:   7%|▋         | 14/200 [00:00<00:09, 19.32it/s, failures=0, objective=-56.9]
HPO - Large Problem with TL:   8%|▊         | 15/200 [00:00<00:08, 20.63it/s, failures=0, objective=-56.9]
HPO - Large Problem with TL:   8%|▊         | 15/200 [00:00<00:08, 20.63it/s, failures=0, objective=-56.9]
HPO - Large Problem with TL:   8%|▊         | 16/200 [00:00<00:08, 20.63it/s, failures=0, objective=-56.9]
HPO - Large Problem with TL:   8%|▊         | 17/200 [00:00<00:08, 20.63it/s, failures=0, objective=-32.4]
HPO - Large Problem with TL:   9%|▉         | 18/200 [00:00<00:08, 21.49it/s, failures=0, objective=-32.4]
HPO - Large Problem with TL:   9%|▉         | 18/200 [00:00<00:08, 21.49it/s, failures=0, objective=-32.4]
HPO - Large Problem with TL:  10%|▉         | 19/200 [00:00<00:08, 21.49it/s, failures=0, objective=-32.4]
HPO - Large Problem with TL:  10%|█         | 20/200 [00:00<00:08, 21.49it/s, failures=0, objective=-32.4]
HPO - Large Problem with TL:  10%|█         | 21/200 [00:01<00:08, 21.21it/s, failures=0, objective=-32.4]
HPO - Large Problem with TL:  10%|█         | 21/200 [00:01<00:08, 21.21it/s, failures=0, objective=-32.4]
HPO - Large Problem with TL:  11%|█         | 22/200 [00:01<00:08, 21.21it/s, failures=0, objective=-32.4]
HPO - Large Problem with TL:  12%|█▏        | 23/200 [00:01<00:08, 21.21it/s, failures=0, objective=-32.4]
HPO - Large Problem with TL:  12%|█▏        | 24/200 [00:01<00:17, 10.10it/s, failures=0, objective=-32.4]
HPO - Large Problem with TL:  12%|█▏        | 24/200 [00:01<00:17, 10.10it/s, failures=0, objective=-32.4]
HPO - Large Problem with TL:  12%|█▎        | 25/200 [00:01<00:17, 10.10it/s, failures=0, objective=-32.4]
HPO - Large Problem with TL:  13%|█▎        | 26/200 [00:02<00:22,  7.61it/s, failures=0, objective=-32.4]
HPO - Large Problem with TL:  13%|█▎        | 26/200 [00:02<00:22,  7.61it/s, failures=0, objective=-32.4]
HPO - Large Problem with TL:  14%|█▎        | 27/200 [00:02<00:22,  7.61it/s, failures=0, objective=-32.4]
HPO - Large Problem with TL:  14%|█▍        | 28/200 [00:02<00:25,  6.77it/s, failures=0, objective=-32.4]
HPO - Large Problem with TL:  14%|█▍        | 28/200 [00:02<00:25,  6.77it/s, failures=0, objective=-32.4]
HPO - Large Problem with TL:  14%|█▍        | 29/200 [00:02<00:25,  6.77it/s, failures=0, objective=-32.4]
HPO - Large Problem with TL:  15%|█▌        | 30/200 [00:02<00:26,  6.32it/s, failures=0, objective=-32.4]
HPO - Large Problem with TL:  15%|█▌        | 30/200 [00:02<00:26,  6.32it/s, failures=0, objective=-32.4]
HPO - Large Problem with TL:  16%|█▌        | 31/200 [00:03<00:27,  6.13it/s, failures=0, objective=-32.4]
HPO - Large Problem with TL:  16%|█▌        | 31/200 [00:03<00:27,  6.13it/s, failures=0, objective=-32.4]
HPO - Large Problem with TL:  16%|█▌        | 32/200 [00:03<00:28,  5.96it/s, failures=0, objective=-32.4]
HPO - Large Problem with TL:  16%|█▌        | 32/200 [00:03<00:28,  5.96it/s, failures=0, objective=-32.4]
HPO - Large Problem with TL:  16%|█▋        | 33/200 [00:03<00:31,  5.26it/s, failures=0, objective=-32.4]
HPO - Large Problem with TL:  16%|█▋        | 33/200 [00:03<00:31,  5.26it/s, failures=0, objective=-32.4]
HPO - Large Problem with TL:  17%|█▋        | 34/200 [00:03<00:35,  4.71it/s, failures=0, objective=-32.4]
HPO - Large Problem with TL:  17%|█▋        | 34/200 [00:03<00:35,  4.71it/s, failures=0, objective=-32.4]
HPO - Large Problem with TL:  18%|█▊        | 35/200 [00:04<00:33,  4.86it/s, failures=0, objective=-32.4]
HPO - Large Problem with TL:  18%|█▊        | 35/200 [00:04<00:33,  4.86it/s, failures=0, objective=-32.4]
HPO - Large Problem with TL:  18%|█▊        | 36/200 [00:04<00:32,  4.98it/s, failures=0, objective=-32.4]
HPO - Large Problem with TL:  18%|█▊        | 36/200 [00:04<00:32,  4.98it/s, failures=0, objective=-32.4]
HPO - Large Problem with TL:  18%|█▊        | 37/200 [00:04<00:32,  5.05it/s, failures=0, objective=-32.4]
HPO - Large Problem with TL:  18%|█▊        | 37/200 [00:04<00:32,  5.05it/s, failures=0, objective=-32.4]
HPO - Large Problem with TL:  19%|█▉        | 38/200 [00:04<00:32,  5.03it/s, failures=0, objective=-32.4]
HPO - Large Problem with TL:  19%|█▉        | 38/200 [00:04<00:32,  5.03it/s, failures=0, objective=-32.4]
HPO - Large Problem with TL:  20%|█▉        | 39/200 [00:04<00:32,  5.03it/s, failures=0, objective=-32.4]
HPO - Large Problem with TL:  20%|█▉        | 39/200 [00:04<00:32,  5.03it/s, failures=0, objective=-32.4]
HPO - Large Problem with TL:  20%|██        | 40/200 [00:05<00:31,  5.06it/s, failures=0, objective=-32.4]
HPO - Large Problem with TL:  20%|██        | 40/200 [00:05<00:31,  5.06it/s, failures=0, objective=-32.4]
HPO - Large Problem with TL:  20%|██        | 41/200 [00:05<00:31,  5.10it/s, failures=0, objective=-32.4]
HPO - Large Problem with TL:  20%|██        | 41/200 [00:05<00:31,  5.10it/s, failures=0, objective=-32.4]
HPO - Large Problem with TL:  21%|██        | 42/200 [00:05<00:31,  4.94it/s, failures=0, objective=-32.4]
HPO - Large Problem with TL:  21%|██        | 42/200 [00:05<00:31,  4.94it/s, failures=0, objective=-32.4]
HPO - Large Problem with TL:  22%|██▏       | 43/200 [00:05<00:38,  4.06it/s, failures=0, objective=-32.4]
HPO - Large Problem with TL:  22%|██▏       | 43/200 [00:05<00:38,  4.06it/s, failures=0, objective=-32.4]
HPO - Large Problem with TL:  22%|██▏       | 44/200 [00:05<00:35,  4.34it/s, failures=0, objective=-32.4]
HPO - Large Problem with TL:  22%|██▏       | 44/200 [00:05<00:35,  4.34it/s, failures=0, objective=-32.4]
HPO - Large Problem with TL:  22%|██▎       | 45/200 [00:06<00:34,  4.46it/s, failures=0, objective=-32.4]
HPO - Large Problem with TL:  22%|██▎       | 45/200 [00:06<00:34,  4.46it/s, failures=0, objective=-32.4]
HPO - Large Problem with TL:  23%|██▎       | 46/200 [00:06<00:32,  4.67it/s, failures=0, objective=-32.4]
HPO - Large Problem with TL:  23%|██▎       | 46/200 [00:06<00:32,  4.67it/s, failures=0, objective=-32.4]
HPO - Large Problem with TL:  24%|██▎       | 47/200 [00:06<00:33,  4.63it/s, failures=0, objective=-32.4]
HPO - Large Problem with TL:  24%|██▎       | 47/200 [00:06<00:33,  4.63it/s, failures=0, objective=-32.4]
HPO - Large Problem with TL:  24%|██▍       | 48/200 [00:06<00:31,  4.77it/s, failures=0, objective=-32.4]
HPO - Large Problem with TL:  24%|██▍       | 48/200 [00:06<00:31,  4.77it/s, failures=0, objective=-32.4]
HPO - Large Problem with TL:  24%|██▍       | 49/200 [00:06<00:30,  4.90it/s, failures=0, objective=-32.4]
HPO - Large Problem with TL:  24%|██▍       | 49/200 [00:06<00:30,  4.90it/s, failures=0, objective=-32.4]
HPO - Large Problem with TL:  25%|██▌       | 50/200 [00:07<00:30,  4.97it/s, failures=0, objective=-32.4]
HPO - Large Problem with TL:  25%|██▌       | 50/200 [00:07<00:30,  4.97it/s, failures=0, objective=-32.4]
HPO - Large Problem with TL:  26%|██▌       | 51/200 [00:07<00:30,  4.88it/s, failures=0, objective=-32.4]
HPO - Large Problem with TL:  26%|██▌       | 51/200 [00:07<00:30,  4.88it/s, failures=0, objective=-32.4]
HPO - Large Problem with TL:  26%|██▌       | 52/200 [00:07<00:34,  4.32it/s, failures=0, objective=-32.4]
HPO - Large Problem with TL:  26%|██▌       | 52/200 [00:07<00:34,  4.32it/s, failures=0, objective=-32.4]
HPO - Large Problem with TL:  26%|██▋       | 53/200 [00:07<00:33,  4.39it/s, failures=0, objective=-32.4]
HPO - Large Problem with TL:  26%|██▋       | 53/200 [00:07<00:33,  4.39it/s, failures=0, objective=-30.6]
HPO - Large Problem with TL:  27%|██▋       | 54/200 [00:08<00:32,  4.43it/s, failures=0, objective=-30.6]
HPO - Large Problem with TL:  27%|██▋       | 54/200 [00:08<00:32,  4.43it/s, failures=0, objective=-30.6]
HPO - Large Problem with TL:  28%|██▊       | 55/200 [00:08<00:31,  4.60it/s, failures=0, objective=-30.6]
HPO - Large Problem with TL:  28%|██▊       | 55/200 [00:08<00:31,  4.60it/s, failures=0, objective=-30.6]
HPO - Large Problem with TL:  28%|██▊       | 56/200 [00:08<00:34,  4.14it/s, failures=0, objective=-30.6]
HPO - Large Problem with TL:  28%|██▊       | 56/200 [00:08<00:34,  4.14it/s, failures=0, objective=-30.6]
HPO - Large Problem with TL:  28%|██▊       | 57/200 [00:08<00:36,  3.87it/s, failures=0, objective=-30.6]
HPO - Large Problem with TL:  28%|██▊       | 57/200 [00:08<00:36,  3.87it/s, failures=0, objective=-30.6]
HPO - Large Problem with TL:  29%|██▉       | 58/200 [00:09<00:34,  4.12it/s, failures=0, objective=-30.6]
HPO - Large Problem with TL:  29%|██▉       | 58/200 [00:09<00:34,  4.12it/s, failures=0, objective=-30.6]
HPO - Large Problem with TL:  30%|██▉       | 59/200 [00:09<00:32,  4.30it/s, failures=0, objective=-30.6]
HPO - Large Problem with TL:  30%|██▉       | 59/200 [00:09<00:32,  4.30it/s, failures=0, objective=-30.6]
HPO - Large Problem with TL:  30%|███       | 60/200 [00:09<00:35,  3.90it/s, failures=0, objective=-30.6]
HPO - Large Problem with TL:  30%|███       | 60/200 [00:09<00:35,  3.90it/s, failures=0, objective=-29.7]
HPO - Large Problem with TL:  30%|███       | 61/200 [00:09<00:33,  4.15it/s, failures=0, objective=-29.7]
HPO - Large Problem with TL:  30%|███       | 61/200 [00:09<00:33,  4.15it/s, failures=0, objective=-29.7]
HPO - Large Problem with TL:  31%|███       | 62/200 [00:10<00:31,  4.38it/s, failures=0, objective=-29.7]
HPO - Large Problem with TL:  31%|███       | 62/200 [00:10<00:31,  4.38it/s, failures=0, objective=-29.7]
HPO - Large Problem with TL:  32%|███▏      | 63/200 [00:10<00:30,  4.49it/s, failures=0, objective=-29.7]
HPO - Large Problem with TL:  32%|███▏      | 63/200 [00:10<00:30,  4.49it/s, failures=0, objective=-24.1]
HPO - Large Problem with TL:  32%|███▏      | 64/200 [00:10<00:32,  4.17it/s, failures=0, objective=-24.1]
HPO - Large Problem with TL:  32%|███▏      | 64/200 [00:10<00:32,  4.17it/s, failures=0, objective=-24.1]
HPO - Large Problem with TL:  32%|███▎      | 65/200 [00:10<00:31,  4.27it/s, failures=0, objective=-24.1]
HPO - Large Problem with TL:  32%|███▎      | 65/200 [00:10<00:31,  4.27it/s, failures=0, objective=-24.1]
HPO - Large Problem with TL:  33%|███▎      | 66/200 [00:10<00:30,  4.35it/s, failures=0, objective=-24.1]
HPO - Large Problem with TL:  33%|███▎      | 66/200 [00:10<00:30,  4.35it/s, failures=0, objective=-24.1]
HPO - Large Problem with TL:  34%|███▎      | 67/200 [00:11<00:29,  4.45it/s, failures=0, objective=-24.1]
HPO - Large Problem with TL:  34%|███▎      | 67/200 [00:11<00:29,  4.45it/s, failures=0, objective=-24.1]
HPO - Large Problem with TL:  34%|███▍      | 68/200 [00:11<00:33,  3.99it/s, failures=0, objective=-24.1]
HPO - Large Problem with TL:  34%|███▍      | 68/200 [00:11<00:33,  3.99it/s, failures=0, objective=-24.1]
HPO - Large Problem with TL:  34%|███▍      | 69/200 [00:11<00:31,  4.22it/s, failures=0, objective=-24.1]
HPO - Large Problem with TL:  34%|███▍      | 69/200 [00:11<00:31,  4.22it/s, failures=0, objective=-24.1]
HPO - Large Problem with TL:  35%|███▌      | 70/200 [00:11<00:30,  4.33it/s, failures=0, objective=-24.1]
HPO - Large Problem with TL:  35%|███▌      | 70/200 [00:11<00:30,  4.33it/s, failures=0, objective=-24.1]
HPO - Large Problem with TL:  36%|███▌      | 71/200 [00:12<00:28,  4.50it/s, failures=0, objective=-24.1]
HPO - Large Problem with TL:  36%|███▌      | 71/200 [00:12<00:28,  4.50it/s, failures=0, objective=-24.1]
HPO - Large Problem with TL:  36%|███▌      | 72/200 [00:12<00:27,  4.64it/s, failures=0, objective=-24.1]
HPO - Large Problem with TL:  36%|███▌      | 72/200 [00:12<00:27,  4.64it/s, failures=0, objective=-24.1]
HPO - Large Problem with TL:  36%|███▋      | 73/200 [00:12<00:28,  4.46it/s, failures=0, objective=-24.1]
HPO - Large Problem with TL:  36%|███▋      | 73/200 [00:12<00:28,  4.46it/s, failures=0, objective=-24.1]
HPO - Large Problem with TL:  37%|███▋      | 74/200 [00:12<00:30,  4.17it/s, failures=0, objective=-24.1]
HPO - Large Problem with TL:  37%|███▋      | 74/200 [00:12<00:30,  4.17it/s, failures=0, objective=-24.1]
HPO - Large Problem with TL:  38%|███▊      | 75/200 [00:13<00:31,  3.93it/s, failures=0, objective=-24.1]
HPO - Large Problem with TL:  38%|███▊      | 75/200 [00:13<00:31,  3.93it/s, failures=0, objective=-24.1]
HPO - Large Problem with TL:  38%|███▊      | 76/200 [00:13<00:33,  3.69it/s, failures=0, objective=-24.1]
HPO - Large Problem with TL:  38%|███▊      | 76/200 [00:13<00:33,  3.69it/s, failures=0, objective=-22.4]
HPO - Large Problem with TL:  38%|███▊      | 77/200 [00:13<00:31,  3.91it/s, failures=0, objective=-22.4]
HPO - Large Problem with TL:  38%|███▊      | 77/200 [00:13<00:31,  3.91it/s, failures=0, objective=-16.6]
HPO - Large Problem with TL:  39%|███▉      | 78/200 [00:13<00:29,  4.11it/s, failures=0, objective=-16.6]
HPO - Large Problem with TL:  39%|███▉      | 78/200 [00:13<00:29,  4.11it/s, failures=0, objective=-16.6]
HPO - Large Problem with TL:  40%|███▉      | 79/200 [00:14<00:28,  4.22it/s, failures=0, objective=-16.6]
HPO - Large Problem with TL:  40%|███▉      | 79/200 [00:14<00:28,  4.22it/s, failures=0, objective=-16.6]
HPO - Large Problem with TL:  40%|████      | 80/200 [00:14<00:27,  4.39it/s, failures=0, objective=-16.6]
HPO - Large Problem with TL:  40%|████      | 80/200 [00:14<00:27,  4.39it/s, failures=0, objective=-16.6]
HPO - Large Problem with TL:  40%|████      | 81/200 [00:14<00:26,  4.54it/s, failures=0, objective=-16.6]
HPO - Large Problem with TL:  40%|████      | 81/200 [00:14<00:26,  4.54it/s, failures=0, objective=-16.6]
HPO - Large Problem with TL:  41%|████      | 82/200 [00:14<00:25,  4.66it/s, failures=0, objective=-16.6]
HPO - Large Problem with TL:  41%|████      | 82/200 [00:14<00:25,  4.66it/s, failures=0, objective=-16.6]
HPO - Large Problem with TL:  42%|████▏     | 83/200 [00:14<00:25,  4.62it/s, failures=0, objective=-16.6]
HPO - Large Problem with TL:  42%|████▏     | 83/200 [00:14<00:25,  4.62it/s, failures=0, objective=-16.6]
HPO - Large Problem with TL:  42%|████▏     | 84/200 [00:15<00:24,  4.72it/s, failures=0, objective=-16.6]
HPO - Large Problem with TL:  42%|████▏     | 84/200 [00:15<00:24,  4.72it/s, failures=0, objective=-16.6]
HPO - Large Problem with TL:  42%|████▎     | 85/200 [00:15<00:27,  4.13it/s, failures=0, objective=-16.6]
HPO - Large Problem with TL:  42%|████▎     | 85/200 [00:15<00:27,  4.13it/s, failures=0, objective=-16.6]
HPO - Large Problem with TL:  43%|████▎     | 86/200 [00:15<00:26,  4.33it/s, failures=0, objective=-16.6]
HPO - Large Problem with TL:  43%|████▎     | 86/200 [00:15<00:26,  4.33it/s, failures=0, objective=-16.6]
HPO - Large Problem with TL:  44%|████▎     | 87/200 [00:15<00:25,  4.46it/s, failures=0, objective=-16.6]
HPO - Large Problem with TL:  44%|████▎     | 87/200 [00:15<00:25,  4.46it/s, failures=0, objective=-16.6]
HPO - Large Problem with TL:  44%|████▍     | 88/200 [00:16<00:24,  4.60it/s, failures=0, objective=-16.6]
HPO - Large Problem with TL:  44%|████▍     | 88/200 [00:16<00:24,  4.60it/s, failures=0, objective=-16.6]
HPO - Large Problem with TL:  44%|████▍     | 89/200 [00:16<00:23,  4.69it/s, failures=0, objective=-16.6]
HPO - Large Problem with TL:  44%|████▍     | 89/200 [00:16<00:23,  4.69it/s, failures=0, objective=-16.6]
HPO - Large Problem with TL:  45%|████▌     | 90/200 [00:16<00:23,  4.71it/s, failures=0, objective=-16.6]
HPO - Large Problem with TL:  45%|████▌     | 90/200 [00:16<00:23,  4.71it/s, failures=0, objective=-16.6]
HPO - Large Problem with TL:  46%|████▌     | 91/200 [00:16<00:22,  4.76it/s, failures=0, objective=-16.6]
HPO - Large Problem with TL:  46%|████▌     | 91/200 [00:16<00:22,  4.76it/s, failures=0, objective=-16.6]
HPO - Large Problem with TL:  46%|████▌     | 92/200 [00:16<00:23,  4.58it/s, failures=0, objective=-16.6]
HPO - Large Problem with TL:  46%|████▌     | 92/200 [00:16<00:23,  4.58it/s, failures=0, objective=-16.6]
HPO - Large Problem with TL:  46%|████▋     | 93/200 [00:17<00:23,  4.47it/s, failures=0, objective=-16.6]
HPO - Large Problem with TL:  46%|████▋     | 93/200 [00:17<00:23,  4.47it/s, failures=0, objective=-16.6]
HPO - Large Problem with TL:  47%|████▋     | 94/200 [00:17<00:26,  3.94it/s, failures=0, objective=-16.6]
HPO - Large Problem with TL:  47%|████▋     | 94/200 [00:17<00:26,  3.94it/s, failures=0, objective=-16.6]
HPO - Large Problem with TL:  48%|████▊     | 95/200 [00:17<00:25,  4.11it/s, failures=0, objective=-16.6]
HPO - Large Problem with TL:  48%|████▊     | 95/200 [00:17<00:25,  4.11it/s, failures=0, objective=-16.6]
HPO - Large Problem with TL:  48%|████▊     | 96/200 [00:17<00:26,  3.91it/s, failures=0, objective=-16.6]
HPO - Large Problem with TL:  48%|████▊     | 96/200 [00:17<00:26,  3.91it/s, failures=0, objective=-16.6]
HPO - Large Problem with TL:  48%|████▊     | 97/200 [00:18<00:25,  4.05it/s, failures=0, objective=-16.6]
HPO - Large Problem with TL:  48%|████▊     | 97/200 [00:18<00:25,  4.05it/s, failures=0, objective=-16.6]
HPO - Large Problem with TL:  49%|████▉     | 98/200 [00:18<00:25,  3.94it/s, failures=0, objective=-16.6]
HPO - Large Problem with TL:  49%|████▉     | 98/200 [00:18<00:25,  3.94it/s, failures=0, objective=-7.63]
HPO - Large Problem with TL:  50%|████▉     | 99/200 [00:18<00:25,  3.95it/s, failures=0, objective=-7.63]
HPO - Large Problem with TL:  50%|████▉     | 99/200 [00:18<00:25,  3.95it/s, failures=0, objective=-7.63]
HPO - Large Problem with TL:  50%|█████     | 100/200 [00:19<00:26,  3.72it/s, failures=0, objective=-7.63]
HPO - Large Problem with TL:  50%|█████     | 100/200 [00:19<00:26,  3.72it/s, failures=0, objective=-7.63]
HPO - Large Problem with TL:  50%|█████     | 101/200 [00:19<00:29,  3.39it/s, failures=0, objective=-7.63]
HPO - Large Problem with TL:  50%|█████     | 101/200 [00:19<00:29,  3.39it/s, failures=0, objective=-7.63]
HPO - Large Problem with TL:  51%|█████     | 102/200 [00:19<00:29,  3.32it/s, failures=0, objective=-7.63]
HPO - Large Problem with TL:  51%|█████     | 102/200 [00:19<00:29,  3.32it/s, failures=0, objective=-7.63]
HPO - Large Problem with TL:  52%|█████▏    | 103/200 [00:19<00:29,  3.34it/s, failures=0, objective=-7.63]
HPO - Large Problem with TL:  52%|█████▏    | 103/200 [00:19<00:29,  3.34it/s, failures=0, objective=-7.63]
HPO - Large Problem with TL:  52%|█████▏    | 104/200 [00:20<00:28,  3.40it/s, failures=0, objective=-7.63]
HPO - Large Problem with TL:  52%|█████▏    | 104/200 [00:20<00:28,  3.40it/s, failures=0, objective=-7.63]
HPO - Large Problem with TL:  52%|█████▎    | 105/200 [00:20<00:27,  3.40it/s, failures=0, objective=-7.63]
HPO - Large Problem with TL:  52%|█████▎    | 105/200 [00:20<00:27,  3.40it/s, failures=0, objective=-7.63]
HPO - Large Problem with TL:  53%|█████▎    | 106/200 [00:20<00:26,  3.55it/s, failures=0, objective=-7.63]
HPO - Large Problem with TL:  53%|█████▎    | 106/200 [00:20<00:26,  3.55it/s, failures=0, objective=-7.63]
HPO - Large Problem with TL:  54%|█████▎    | 107/200 [00:21<00:26,  3.55it/s, failures=0, objective=-7.63]
HPO - Large Problem with TL:  54%|█████▎    | 107/200 [00:21<00:26,  3.55it/s, failures=0, objective=-7.63]
HPO - Large Problem with TL:  54%|█████▍    | 108/200 [00:21<00:24,  3.69it/s, failures=0, objective=-7.63]
HPO - Large Problem with TL:  54%|█████▍    | 108/200 [00:21<00:24,  3.69it/s, failures=0, objective=-6.75]
HPO - Large Problem with TL:  55%|█████▍    | 109/200 [00:21<00:26,  3.47it/s, failures=0, objective=-6.75]
HPO - Large Problem with TL:  55%|█████▍    | 109/200 [00:21<00:26,  3.47it/s, failures=0, objective=-6.75]
HPO - Large Problem with TL:  55%|█████▌    | 110/200 [00:21<00:24,  3.73it/s, failures=0, objective=-6.75]
HPO - Large Problem with TL:  55%|█████▌    | 110/200 [00:21<00:24,  3.73it/s, failures=0, objective=-6.75]
HPO - Large Problem with TL:  56%|█████▌    | 111/200 [00:22<00:23,  3.80it/s, failures=0, objective=-6.75]
HPO - Large Problem with TL:  56%|█████▌    | 111/200 [00:22<00:23,  3.80it/s, failures=0, objective=-6.75]
HPO - Large Problem with TL:  56%|█████▌    | 112/200 [00:22<00:22,  3.93it/s, failures=0, objective=-6.75]
HPO - Large Problem with TL:  56%|█████▌    | 112/200 [00:22<00:22,  3.93it/s, failures=0, objective=-6.75]
HPO - Large Problem with TL:  56%|█████▋    | 113/200 [00:22<00:22,  3.92it/s, failures=0, objective=-6.75]
HPO - Large Problem with TL:  56%|█████▋    | 113/200 [00:22<00:22,  3.92it/s, failures=0, objective=-6.75]
HPO - Large Problem with TL:  57%|█████▋    | 114/200 [00:22<00:21,  3.94it/s, failures=0, objective=-6.75]
HPO - Large Problem with TL:  57%|█████▋    | 114/200 [00:22<00:21,  3.94it/s, failures=0, objective=-6.75]
HPO - Large Problem with TL:  57%|█████▊    | 115/200 [00:23<00:21,  3.89it/s, failures=0, objective=-6.75]
HPO - Large Problem with TL:  57%|█████▊    | 115/200 [00:23<00:21,  3.89it/s, failures=0, objective=-6.75]
HPO - Large Problem with TL:  58%|█████▊    | 116/200 [00:23<00:21,  3.90it/s, failures=0, objective=-6.75]
HPO - Large Problem with TL:  58%|█████▊    | 116/200 [00:23<00:21,  3.90it/s, failures=0, objective=-6.75]
HPO - Large Problem with TL:  58%|█████▊    | 117/200 [00:23<00:23,  3.48it/s, failures=0, objective=-6.75]
HPO - Large Problem with TL:  58%|█████▊    | 117/200 [00:23<00:23,  3.48it/s, failures=0, objective=-4.51]
HPO - Large Problem with TL:  59%|█████▉    | 118/200 [00:24<00:22,  3.64it/s, failures=0, objective=-4.51]
HPO - Large Problem with TL:  59%|█████▉    | 118/200 [00:24<00:22,  3.64it/s, failures=0, objective=-4.51]
HPO - Large Problem with TL:  60%|█████▉    | 119/200 [00:24<00:21,  3.72it/s, failures=0, objective=-4.51]
HPO - Large Problem with TL:  60%|█████▉    | 119/200 [00:24<00:21,  3.72it/s, failures=0, objective=-4.51]
HPO - Large Problem with TL:  60%|██████    | 120/200 [00:24<00:21,  3.79it/s, failures=0, objective=-4.51]
HPO - Large Problem with TL:  60%|██████    | 120/200 [00:24<00:21,  3.79it/s, failures=0, objective=-4.51]
HPO - Large Problem with TL:  60%|██████    | 121/200 [00:24<00:21,  3.69it/s, failures=0, objective=-4.51]
HPO - Large Problem with TL:  60%|██████    | 121/200 [00:24<00:21,  3.69it/s, failures=0, objective=-4.51]
HPO - Large Problem with TL:  61%|██████    | 122/200 [00:25<00:20,  3.84it/s, failures=0, objective=-4.51]
HPO - Large Problem with TL:  61%|██████    | 122/200 [00:25<00:20,  3.84it/s, failures=0, objective=-4.51]
HPO - Large Problem with TL:  62%|██████▏   | 123/200 [00:25<00:20,  3.82it/s, failures=0, objective=-4.51]
HPO - Large Problem with TL:  62%|██████▏   | 123/200 [00:25<00:20,  3.82it/s, failures=0, objective=-4.51]
HPO - Large Problem with TL:  62%|██████▏   | 124/200 [00:25<00:20,  3.65it/s, failures=0, objective=-4.51]
HPO - Large Problem with TL:  62%|██████▏   | 124/200 [00:25<00:20,  3.65it/s, failures=0, objective=-4.51]
HPO - Large Problem with TL:  62%|██████▎   | 125/200 [00:26<00:25,  2.94it/s, failures=0, objective=-4.51]
HPO - Large Problem with TL:  62%|██████▎   | 125/200 [00:26<00:25,  2.94it/s, failures=0, objective=-4.51]
HPO - Large Problem with TL:  63%|██████▎   | 126/200 [00:26<00:23,  3.21it/s, failures=0, objective=-4.51]
HPO - Large Problem with TL:  63%|██████▎   | 126/200 [00:26<00:23,  3.21it/s, failures=0, objective=-4.51]
HPO - Large Problem with TL:  64%|██████▎   | 127/200 [00:26<00:21,  3.42it/s, failures=0, objective=-4.51]
HPO - Large Problem with TL:  64%|██████▎   | 127/200 [00:26<00:21,  3.42it/s, failures=0, objective=-4.51]
HPO - Large Problem with TL:  64%|██████▍   | 128/200 [00:26<00:20,  3.54it/s, failures=0, objective=-4.51]
HPO - Large Problem with TL:  64%|██████▍   | 128/200 [00:26<00:20,  3.54it/s, failures=0, objective=-4.51]
HPO - Large Problem with TL:  64%|██████▍   | 129/200 [00:27<00:19,  3.71it/s, failures=0, objective=-4.51]
HPO - Large Problem with TL:  64%|██████▍   | 129/200 [00:27<00:19,  3.71it/s, failures=0, objective=-4.51]
HPO - Large Problem with TL:  65%|██████▌   | 130/200 [00:27<00:18,  3.81it/s, failures=0, objective=-4.51]
HPO - Large Problem with TL:  65%|██████▌   | 130/200 [00:27<00:18,  3.81it/s, failures=0, objective=-4.51]
HPO - Large Problem with TL:  66%|██████▌   | 131/200 [00:27<00:18,  3.73it/s, failures=0, objective=-4.51]
HPO - Large Problem with TL:  66%|██████▌   | 131/200 [00:27<00:18,  3.73it/s, failures=0, objective=-4.51]
HPO - Large Problem with TL:  66%|██████▌   | 132/200 [00:27<00:19,  3.50it/s, failures=0, objective=-4.51]
HPO - Large Problem with TL:  66%|██████▌   | 132/200 [00:27<00:19,  3.50it/s, failures=0, objective=-4.51]
HPO - Large Problem with TL:  66%|██████▋   | 133/200 [00:28<00:21,  3.19it/s, failures=0, objective=-4.51]
HPO - Large Problem with TL:  66%|██████▋   | 133/200 [00:28<00:21,  3.19it/s, failures=0, objective=-4.51]
HPO - Large Problem with TL:  67%|██████▋   | 134/200 [00:28<00:19,  3.32it/s, failures=0, objective=-4.51]
HPO - Large Problem with TL:  67%|██████▋   | 134/200 [00:28<00:19,  3.32it/s, failures=0, objective=-4.51]
HPO - Large Problem with TL:  68%|██████▊   | 135/200 [00:28<00:20,  3.17it/s, failures=0, objective=-4.51]
HPO - Large Problem with TL:  68%|██████▊   | 135/200 [00:28<00:20,  3.17it/s, failures=0, objective=-4.51]
HPO - Large Problem with TL:  68%|██████▊   | 136/200 [00:29<00:19,  3.33it/s, failures=0, objective=-4.51]
HPO - Large Problem with TL:  68%|██████▊   | 136/200 [00:29<00:19,  3.33it/s, failures=0, objective=-4.51]
HPO - Large Problem with TL:  68%|██████▊   | 137/200 [00:29<00:20,  3.08it/s, failures=0, objective=-4.51]
HPO - Large Problem with TL:  68%|██████▊   | 137/200 [00:29<00:20,  3.08it/s, failures=0, objective=-4.51]
HPO - Large Problem with TL:  69%|██████▉   | 138/200 [00:29<00:19,  3.18it/s, failures=0, objective=-4.51]
HPO - Large Problem with TL:  69%|██████▉   | 138/200 [00:29<00:19,  3.18it/s, failures=0, objective=-4.51]
HPO - Large Problem with TL:  70%|██████▉   | 139/200 [00:30<00:17,  3.42it/s, failures=0, objective=-4.51]
HPO - Large Problem with TL:  70%|██████▉   | 139/200 [00:30<00:17,  3.42it/s, failures=0, objective=-3.61]
HPO - Large Problem with TL:  70%|███████   | 140/200 [00:30<00:17,  3.48it/s, failures=0, objective=-3.61]
HPO - Large Problem with TL:  70%|███████   | 140/200 [00:30<00:17,  3.48it/s, failures=0, objective=-3.61]
HPO - Large Problem with TL:  70%|███████   | 141/200 [00:30<00:18,  3.19it/s, failures=0, objective=-3.61]
HPO - Large Problem with TL:  70%|███████   | 141/200 [00:30<00:18,  3.19it/s, failures=0, objective=-3.61]
HPO - Large Problem with TL:  71%|███████   | 142/200 [00:31<00:16,  3.42it/s, failures=0, objective=-3.61]
HPO - Large Problem with TL:  71%|███████   | 142/200 [00:31<00:16,  3.42it/s, failures=0, objective=-3.61]
HPO - Large Problem with TL:  72%|███████▏  | 143/200 [00:31<00:16,  3.53it/s, failures=0, objective=-3.61]
HPO - Large Problem with TL:  72%|███████▏  | 143/200 [00:31<00:16,  3.53it/s, failures=0, objective=-3.61]
HPO - Large Problem with TL:  72%|███████▏  | 144/200 [00:31<00:18,  3.06it/s, failures=0, objective=-3.61]
HPO - Large Problem with TL:  72%|███████▏  | 144/200 [00:31<00:18,  3.06it/s, failures=0, objective=-3.61]
HPO - Large Problem with TL:  72%|███████▎  | 145/200 [00:32<00:17,  3.11it/s, failures=0, objective=-3.61]
HPO - Large Problem with TL:  72%|███████▎  | 145/200 [00:32<00:17,  3.11it/s, failures=0, objective=-3.26]
HPO - Large Problem with TL:  73%|███████▎  | 146/200 [00:32<00:16,  3.30it/s, failures=0, objective=-3.26]
HPO - Large Problem with TL:  73%|███████▎  | 146/200 [00:32<00:16,  3.30it/s, failures=0, objective=-3.26]
HPO - Large Problem with TL:  74%|███████▎  | 147/200 [00:32<00:15,  3.49it/s, failures=0, objective=-3.26]
HPO - Large Problem with TL:  74%|███████▎  | 147/200 [00:32<00:15,  3.49it/s, failures=0, objective=-3.26]
HPO - Large Problem with TL:  74%|███████▍  | 148/200 [00:32<00:14,  3.59it/s, failures=0, objective=-3.26]
HPO - Large Problem with TL:  74%|███████▍  | 148/200 [00:32<00:14,  3.59it/s, failures=0, objective=-2.28]
HPO - Large Problem with TL:  74%|███████▍  | 149/200 [00:33<00:17,  2.97it/s, failures=0, objective=-2.28]
HPO - Large Problem with TL:  74%|███████▍  | 149/200 [00:33<00:17,  2.97it/s, failures=0, objective=-2.28]
HPO - Large Problem with TL:  75%|███████▌  | 150/200 [00:33<00:15,  3.23it/s, failures=0, objective=-2.28]
HPO - Large Problem with TL:  75%|███████▌  | 150/200 [00:33<00:15,  3.23it/s, failures=0, objective=-1.31]
HPO - Large Problem with TL:  76%|███████▌  | 151/200 [00:33<00:14,  3.42it/s, failures=0, objective=-1.31]
HPO - Large Problem with TL:  76%|███████▌  | 151/200 [00:33<00:14,  3.42it/s, failures=0, objective=-1.31]
HPO - Large Problem with TL:  76%|███████▌  | 152/200 [00:34<00:14,  3.35it/s, failures=0, objective=-1.31]
HPO - Large Problem with TL:  76%|███████▌  | 152/200 [00:34<00:14,  3.35it/s, failures=0, objective=-1.31]
HPO - Large Problem with TL:  76%|███████▋  | 153/200 [00:34<00:14,  3.29it/s, failures=0, objective=-1.31]
HPO - Large Problem with TL:  76%|███████▋  | 153/200 [00:34<00:14,  3.29it/s, failures=0, objective=-1.31]
HPO - Large Problem with TL:  77%|███████▋  | 154/200 [00:34<00:14,  3.21it/s, failures=0, objective=-1.31]
HPO - Large Problem with TL:  77%|███████▋  | 154/200 [00:34<00:14,  3.21it/s, failures=0, objective=-1.31]
HPO - Large Problem with TL:  78%|███████▊  | 155/200 [00:35<00:13,  3.27it/s, failures=0, objective=-1.31]
HPO - Large Problem with TL:  78%|███████▊  | 155/200 [00:35<00:13,  3.27it/s, failures=0, objective=-1.31]
HPO - Large Problem with TL:  78%|███████▊  | 156/200 [00:35<00:12,  3.52it/s, failures=0, objective=-1.31]
HPO - Large Problem with TL:  78%|███████▊  | 156/200 [00:35<00:12,  3.52it/s, failures=0, objective=-1.31]
HPO - Large Problem with TL:  78%|███████▊  | 157/200 [00:35<00:14,  3.01it/s, failures=0, objective=-1.31]
HPO - Large Problem with TL:  78%|███████▊  | 157/200 [00:35<00:14,  3.01it/s, failures=0, objective=-1.31]
HPO - Large Problem with TL:  79%|███████▉  | 158/200 [00:35<00:13,  3.17it/s, failures=0, objective=-1.31]
HPO - Large Problem with TL:  79%|███████▉  | 158/200 [00:35<00:13,  3.17it/s, failures=0, objective=-1.31]
HPO - Large Problem with TL:  80%|███████▉  | 159/200 [00:36<00:12,  3.35it/s, failures=0, objective=-1.31]
HPO - Large Problem with TL:  80%|███████▉  | 159/200 [00:36<00:12,  3.35it/s, failures=0, objective=-1.31]
HPO - Large Problem with TL:  80%|████████  | 160/200 [00:36<00:12,  3.24it/s, failures=0, objective=-1.31]
HPO - Large Problem with TL:  80%|████████  | 160/200 [00:36<00:12,  3.24it/s, failures=0, objective=-1.31]
HPO - Large Problem with TL:  80%|████████  | 161/200 [00:36<00:12,  3.09it/s, failures=0, objective=-1.31]
HPO - Large Problem with TL:  80%|████████  | 161/200 [00:36<00:12,  3.09it/s, failures=0, objective=-1.31]
HPO - Large Problem with TL:  81%|████████  | 162/200 [00:37<00:11,  3.20it/s, failures=0, objective=-1.31]
HPO - Large Problem with TL:  81%|████████  | 162/200 [00:37<00:11,  3.20it/s, failures=0, objective=-1.31]
HPO - Large Problem with TL:  82%|████████▏ | 163/200 [00:37<00:11,  3.35it/s, failures=0, objective=-1.31]
HPO - Large Problem with TL:  82%|████████▏ | 163/200 [00:37<00:11,  3.35it/s, failures=0, objective=-1.31]
HPO - Large Problem with TL:  82%|████████▏ | 164/200 [00:37<00:10,  3.47it/s, failures=0, objective=-1.31]
HPO - Large Problem with TL:  82%|████████▏ | 164/200 [00:37<00:10,  3.47it/s, failures=0, objective=-1.31]
HPO - Large Problem with TL:  82%|████████▎ | 165/200 [00:38<00:11,  3.06it/s, failures=0, objective=-1.31]
HPO - Large Problem with TL:  82%|████████▎ | 165/200 [00:38<00:11,  3.06it/s, failures=0, objective=-1.31]
HPO - Large Problem with TL:  83%|████████▎ | 166/200 [00:38<00:10,  3.15it/s, failures=0, objective=-1.31]
HPO - Large Problem with TL:  83%|████████▎ | 166/200 [00:38<00:10,  3.15it/s, failures=0, objective=-1.31]
HPO - Large Problem with TL:  84%|████████▎ | 167/200 [00:38<00:10,  3.29it/s, failures=0, objective=-1.31]
HPO - Large Problem with TL:  84%|████████▎ | 167/200 [00:38<00:10,  3.29it/s, failures=0, objective=-1.31]
HPO - Large Problem with TL:  84%|████████▍ | 168/200 [00:39<00:09,  3.32it/s, failures=0, objective=-1.31]
HPO - Large Problem with TL:  84%|████████▍ | 168/200 [00:39<00:09,  3.32it/s, failures=0, objective=-1.31]
HPO - Large Problem with TL:  84%|████████▍ | 169/200 [00:39<00:10,  3.02it/s, failures=0, objective=-1.31]
HPO - Large Problem with TL:  84%|████████▍ | 169/200 [00:39<00:10,  3.02it/s, failures=0, objective=-1.31]
HPO - Large Problem with TL:  85%|████████▌ | 170/200 [00:39<00:10,  2.89it/s, failures=0, objective=-1.31]
HPO - Large Problem with TL:  85%|████████▌ | 170/200 [00:39<00:10,  2.89it/s, failures=0, objective=-1.29]
HPO - Large Problem with TL:  86%|████████▌ | 171/200 [00:40<00:10,  2.71it/s, failures=0, objective=-1.29]
HPO - Large Problem with TL:  86%|████████▌ | 171/200 [00:40<00:10,  2.71it/s, failures=0, objective=-1.07]
HPO - Large Problem with TL:  86%|████████▌ | 172/200 [00:40<00:09,  2.84it/s, failures=0, objective=-1.07]
HPO - Large Problem with TL:  86%|████████▌ | 172/200 [00:40<00:09,  2.84it/s, failures=0, objective=-1.04]
HPO - Large Problem with TL:  86%|████████▋ | 173/200 [00:40<00:10,  2.69it/s, failures=0, objective=-1.04]
HPO - Large Problem with TL:  86%|████████▋ | 173/200 [00:40<00:10,  2.69it/s, failures=0, objective=-1.04]
HPO - Large Problem with TL:  87%|████████▋ | 174/200 [00:41<00:09,  2.80it/s, failures=0, objective=-1.04]
HPO - Large Problem with TL:  87%|████████▋ | 174/200 [00:41<00:09,  2.80it/s, failures=0, objective=-1.04]
HPO - Large Problem with TL:  88%|████████▊ | 175/200 [00:41<00:08,  2.90it/s, failures=0, objective=-1.04]
HPO - Large Problem with TL:  88%|████████▊ | 175/200 [00:41<00:08,  2.90it/s, failures=0, objective=-0.586]
HPO - Large Problem with TL:  88%|████████▊ | 176/200 [00:41<00:08,  2.97it/s, failures=0, objective=-0.586]
HPO - Large Problem with TL:  88%|████████▊ | 176/200 [00:41<00:08,  2.97it/s, failures=0, objective=-0.586]
HPO - Large Problem with TL:  88%|████████▊ | 177/200 [00:42<00:07,  3.03it/s, failures=0, objective=-0.586]
HPO - Large Problem with TL:  88%|████████▊ | 177/200 [00:42<00:07,  3.03it/s, failures=0, objective=-0.22]
HPO - Large Problem with TL:  89%|████████▉ | 178/200 [00:42<00:07,  3.12it/s, failures=0, objective=-0.22]
HPO - Large Problem with TL:  89%|████████▉ | 178/200 [00:42<00:07,  3.12it/s, failures=0, objective=-0.22]
HPO - Large Problem with TL:  90%|████████▉ | 179/200 [00:42<00:06,  3.06it/s, failures=0, objective=-0.22]
HPO - Large Problem with TL:  90%|████████▉ | 179/200 [00:42<00:06,  3.06it/s, failures=0, objective=-0.22]
HPO - Large Problem with TL:  90%|█████████ | 180/200 [00:43<00:06,  3.03it/s, failures=0, objective=-0.22]
HPO - Large Problem with TL:  90%|█████████ | 180/200 [00:43<00:06,  3.03it/s, failures=0, objective=-0.22]
HPO - Large Problem with TL:  90%|█████████ | 181/200 [00:43<00:06,  2.97it/s, failures=0, objective=-0.22]
HPO - Large Problem with TL:  90%|█████████ | 181/200 [00:43<00:06,  2.97it/s, failures=0, objective=-0.22]
HPO - Large Problem with TL:  91%|█████████ | 182/200 [00:43<00:05,  3.25it/s, failures=0, objective=-0.22]
HPO - Large Problem with TL:  91%|█████████ | 182/200 [00:43<00:05,  3.25it/s, failures=0, objective=-0.22]
HPO - Large Problem with TL:  92%|█████████▏| 183/200 [00:44<00:05,  3.40it/s, failures=0, objective=-0.22]
HPO - Large Problem with TL:  92%|█████████▏| 183/200 [00:44<00:05,  3.40it/s, failures=0, objective=-0.22]
HPO - Large Problem with TL:  92%|█████████▏| 184/200 [00:44<00:04,  3.32it/s, failures=0, objective=-0.22]
HPO - Large Problem with TL:  92%|█████████▏| 184/200 [00:44<00:04,  3.32it/s, failures=0, objective=-0.22]
HPO - Large Problem with TL:  92%|█████████▎| 185/200 [00:44<00:04,  3.01it/s, failures=0, objective=-0.22]
HPO - Large Problem with TL:  92%|█████████▎| 185/200 [00:44<00:04,  3.01it/s, failures=0, objective=-0.22]
HPO - Large Problem with TL:  93%|█████████▎| 186/200 [00:45<00:04,  3.31it/s, failures=0, objective=-0.22]
HPO - Large Problem with TL:  93%|█████████▎| 186/200 [00:45<00:04,  3.31it/s, failures=0, objective=-0.22]
HPO - Large Problem with TL:  94%|█████████▎| 187/200 [00:45<00:03,  3.41it/s, failures=0, objective=-0.22]
HPO - Large Problem with TL:  94%|█████████▎| 187/200 [00:45<00:03,  3.41it/s, failures=0, objective=-0.22]
HPO - Large Problem with TL:  94%|█████████▍| 188/200 [00:45<00:03,  3.21it/s, failures=0, objective=-0.22]
HPO - Large Problem with TL:  94%|█████████▍| 188/200 [00:45<00:03,  3.21it/s, failures=0, objective=-0.22]
HPO - Large Problem with TL:  94%|█████████▍| 189/200 [00:46<00:04,  2.60it/s, failures=0, objective=-0.22]
HPO - Large Problem with TL:  94%|█████████▍| 189/200 [00:46<00:04,  2.60it/s, failures=0, objective=-0.22]
HPO - Large Problem with TL:  95%|█████████▌| 190/200 [00:46<00:03,  2.52it/s, failures=0, objective=-0.22]
HPO - Large Problem with TL:  95%|█████████▌| 190/200 [00:46<00:03,  2.52it/s, failures=0, objective=-0.22]
HPO - Large Problem with TL:  96%|█████████▌| 191/200 [00:47<00:03,  2.48it/s, failures=0, objective=-0.22]
HPO - Large Problem with TL:  96%|█████████▌| 191/200 [00:47<00:03,  2.48it/s, failures=0, objective=-0.22]
HPO - Large Problem with TL:  96%|█████████▌| 192/200 [00:47<00:03,  2.52it/s, failures=0, objective=-0.22]
HPO - Large Problem with TL:  96%|█████████▌| 192/200 [00:47<00:03,  2.52it/s, failures=0, objective=-0.22]
HPO - Large Problem with TL:  96%|█████████▋| 193/200 [00:47<00:02,  2.74it/s, failures=0, objective=-0.22]
HPO - Large Problem with TL:  96%|█████████▋| 193/200 [00:47<00:02,  2.74it/s, failures=0, objective=-0.22]
HPO - Large Problem with TL:  97%|█████████▋| 194/200 [00:48<00:02,  2.80it/s, failures=0, objective=-0.22]
HPO - Large Problem with TL:  97%|█████████▋| 194/200 [00:48<00:02,  2.80it/s, failures=0, objective=-0.22]
HPO - Large Problem with TL:  98%|█████████▊| 195/200 [00:48<00:02,  2.35it/s, failures=0, objective=-0.22]
HPO - Large Problem with TL:  98%|█████████▊| 195/200 [00:48<00:02,  2.35it/s, failures=0, objective=-0.22]
HPO - Large Problem with TL:  98%|█████████▊| 196/200 [00:49<00:01,  2.26it/s, failures=0, objective=-0.22]
HPO - Large Problem with TL:  98%|█████████▊| 196/200 [00:49<00:01,  2.26it/s, failures=0, objective=-0.22]
HPO - Large Problem with TL:  98%|█████████▊| 197/200 [00:49<00:01,  2.06it/s, failures=0, objective=-0.22]
HPO - Large Problem with TL:  98%|█████████▊| 197/200 [00:49<00:01,  2.06it/s, failures=0, objective=-0.205]
HPO - Large Problem with TL:  99%|█████████▉| 198/200 [00:50<00:00,  2.08it/s, failures=0, objective=-0.205]
HPO - Large Problem with TL:  99%|█████████▉| 198/200 [00:50<00:00,  2.08it/s, failures=0, objective=-0.205]
HPO - Large Problem with TL: 100%|█████████▉| 199/200 [00:50<00:00,  2.25it/s, failures=0, objective=-0.205]
HPO - Large Problem with TL: 100%|█████████▉| 199/200 [00:50<00:00,  2.25it/s, failures=0, objective=-0.205]
HPO - Large Problem with TL: 100%|██████████| 200/200 [00:50<00:00,  2.30it/s, failures=0, objective=-0.205]
HPO - Large Problem with TL: 100%|██████████| 200/200 [00:50<00:00,  2.30it/s, failures=0, objective=-0.205]
HPO - Large Problem with TL: 100%|██████████| 200/200 [00:50<00:00,  3.93it/s, failures=0, objective=-0.205]

Finally, we compare the results and quickly see that transfer-learning provided a consequant speed-up for the search:

fig, ax = plt.subplots(figsize=(WIDTH_PLOTS, HEIGHT_PLOTS), tight_layout=True)

for i, (strategy, df) in enumerate(results.items()):
    plot_search_trajectory_single_objective_hpo(
        df,
        show_failures=False,
        mode="min",
        ax=ax,
        label=strategy,
        plot_kwargs={"color": f"C{i}"},
        scatter_success_kwargs={"c": f"C{i}"},
    )

ax.set_xlabel
ax.set_xlabel("Time (sec.)")
ax.set_ylabel("Objective")
ax.set_yscale("log")
ax.grid(visible=True, which="minor", linestyle=":")
ax.grid(visible=True, which="major", linestyle="-")
ax.legend()

<matplotlib.legend.Legend object at 0x3094ceea0>