DeepHyper: Distributed Neural Architecture and Hyperparameter Optimization for Machine Learning#
DeepHyper is a powerful Python package for automating machine learning tasks, particularly focused on optimizing hyperparameters, searching for optimal neural architectures, and quantifying uncertainty through the deep ensembles. With DeepHyper, users can easily perform these tasks on a single machine or distributed across multiple machines, making it ideal for use in a variety of environments. Whether you’re a beginner looking to optimize your machine learning models or an experienced data scientist looking to streamline your workflow, DeepHyper has something to offer. So why wait? Start using DeepHyper today and take your machine learning skills to the next level!
DeepHyper is specialized for machine learning tasks but it can also be used for generic black-box and gray-box optimization problems of expensive functions.
DeepHyper’s software architecture is designed to be modular and extensible. It is built on top of the following main sub-packages:
deephyper.ensemble
: Tools to build ensembles of neural networks with uncertainty quantification.deephyper.nas
: Tools to define neural architecture search space and evaluation strategy.deephyper.problem
: Tools for defining neural architecture and hyper-parameter search problems.deephyper.evaluator
: Tools to distribute the evaluation of tasks (e.g., neural network trainings).deephyper.search
: Tools to define search strategies for neural architecture search and hyper-parameter optimization.deephyper.stopper
: Tools to define multi-fidelity strategies for neural architecture and hyper-parameter optimization.
DeepHyper installation requires Python >= 3.7.
Install instructions#
Install with pip
# For the most basic set of features (hyperparameter search)
pip install deephyper
# For the default set of features including:
# - hyperparameter search with transfer-learning
# - neural architecture search
# - deep ensembles
# - Ray-based distributed computing
# - Learning-curve extrapolation for multi-fidelity hyperparameter search
pip install "deephyper[default]"
More details about the installation process can be found at DeepHyper Installations.
Quick Start#
The black-box function named run
is defined by taking an input dictionnary named config
which contains the different variables to optimize. Then the run-function is binded to an Evaluator
in charge of distributing the computation of multiple evaluations. Finally, a Bayesian search named CBO
is created and executed to find the values of config which MAXIMIZE the return value of run(config)
.
def run(job):
# The suggested parameters are accessible in job.parameters (dict)
x = job.parameters["x"]
b = job.parameters["b"]
if job.parameters["function"] == "linear":
y = x + b
elif job.parameters["function"] == "cubic":
y = x**3 + b
# Maximization!
return y
# Necessary IF statement otherwise it will enter in a infinite loop
# when loading the 'run' function from a new process
if __name__ == "__main__":
from deephyper.problem import HpProblem
from deephyper.search.hps import CBO
from deephyper.evaluator import Evaluator
# define the variable you want to optimize
problem = HpProblem()
problem.add_hyperparameter((-10.0, 10.0), "x") # real parameter
problem.add_hyperparameter((0, 10), "b") # discrete parameter
problem.add_hyperparameter(["linear", "cubic"], "function") # categorical parameter
# define the evaluator to distribute the computation
evaluator = Evaluator.create(
run,
method="process",
method_kwargs={
"num_workers": 2,
},
)
# define your search and execute it
search = CBO(problem, evaluator, random_state=42)
results = search.search(max_evals=100)
print(results)
Which outputs the following results where the best parameters are with function == "cubic"
, x == 9.99
and b == 10
.
p:b p:function p:x objective job_id m:timestamp_submit m:timestamp_gather
0 7 linear 8.831019 15.831019 1 0.064874 1.430992
1 4 linear 9.788889 13.788889 0 0.064862 1.453012
2 0 cubic 2.144989 9.869049 2 1.452692 1.468436
3 9 linear -9.236860 -0.236860 3 1.468123 1.483654
4 2 cubic -9.783865 -934.550818 4 1.483340 1.588162
.. ... ... ... ... ... ... ...
95 6 cubic 9.862098 965.197192 95 13.538506 13.671872
96 10 cubic 9.997512 1009.253866 96 13.671596 13.884530
97 6 cubic 9.965615 995.719961 97 13.884188 14.020144
98 5 cubic 9.998324 1004.497422 98 14.019737 14.154467
99 9 cubic 9.995800 1007.740379 99 14.154169 14.289366
The code defines a function run
that takes a RunningJob job
as input and returns the maximized objective y
. The if
block at the end of the code defines a black-box optimization process using the CBO
(Centralized Bayesian Optimization) algorithm from the deephyper
library.
The optimization process is defined as follows:
A hyperparameter optimization problem is created using the
HpProblem
class fromdeephyper
. In this case, the problem has a three variables. Thex
hyperparameter is a real variable in a range from -10.0 to 10.0. Theb
hyperparameter is a discrete variable in a range from 0 to 10. Thefunction
hyperparameter is a categorical variable with two possible values.An evaluator is created using the
Evaluator.create
method. The evaluator will be used to evaluate the functionrun
with different configurations of suggested hyperparameters in the optimization problem. The evaluator uses theprocess
method to distribute the evaluations across multiple worker processes, in this case 2 worker processes.A search object is created using the
CBO
class, the problem and evaluator defined earlier. TheCBO
algorithm is a derivative-free optimization method that uses a Bayesian optimization approach to explore the hyperparameter space.The optimization process is executed by calling the
search.search
method, which performs the evaluations of therun
function with different configurations of the hyperparameters until a maximum number of evaluations (100 in this case) is reached.The results of the optimization process, including the optimal configuration of the hyperparameters and the corresponding objective value, are printed to the console.
Warning
All search algorithms are MAXIMIZING the objective function. If you want to MINIMIZE the objective function, you have to return the negative of you objective.
Table of Contents#
API Reference
- Analysis
- Core
- deephyper.core.analytics
- deephyper.core.cli
- deephyper.core.exceptions
- deephyper.core.exceptions.DeephyperError
- deephyper.core.exceptions.DeephyperRuntimeError
- deephyper.core.exceptions.MissingRequirementError
- deephyper.core.exceptions.RunFunctionError
- deephyper.core.exceptions.SearchTerminationError
- deephyper.core.exceptions.loading
- deephyper.core.exceptions.nas
- deephyper.core.exceptions.nas.DeephyperError
- deephyper.core.exceptions.nas.NASError
- deephyper.core.exceptions.nas.space
- deephyper.core.exceptions.nas.space.InputShapeOfWrongType
- deephyper.core.exceptions.nas.space.NASError
- deephyper.core.exceptions.nas.space.NodeAlreadyAdded
- deephyper.core.exceptions.nas.space.StructureHasACycle
- deephyper.core.exceptions.nas.space.WrongOutputShape
- deephyper.core.exceptions.nas.space.WrongSequenceToSetOperations
- deephyper.core.exceptions.problem
- deephyper.core.exceptions.problem.DeephyperError
- deephyper.core.exceptions.problem.NaProblemError
- deephyper.core.exceptions.problem.ProblemLoadDataIsNotCallable
- deephyper.core.exceptions.problem.ProblemPreprocessingIsNotCallable
- deephyper.core.exceptions.problem.SearchSpaceBuilderIsNotCallable
- deephyper.core.exceptions.problem.SearchSpaceBuilderMissingDefaultParameter
- deephyper.core.exceptions.problem.SearchSpaceBuilderMissingParameter
- deephyper.core.exceptions.problem.SpaceDimNameOfWrongType
- deephyper.core.exceptions.problem.WrongProblemObjective
- deephyper.core.parser
- deephyper.core.utils
- Ensemble
- deephyper.ensemble.BaggingEnsembleClassifier
- deephyper.ensemble.BaggingEnsembleRegressor
- deephyper.ensemble.BaseEnsemble
- deephyper.ensemble.UQBaggingEnsembleClassifier
- deephyper.ensemble.UQBaggingEnsembleRegressor
UQBaggingEnsembleRegressor
UQBaggingEnsembleRegressor.evaluate()
UQBaggingEnsembleRegressor.fit()
UQBaggingEnsembleRegressor.load()
UQBaggingEnsembleRegressor.load_members_files()
UQBaggingEnsembleRegressor.predict()
UQBaggingEnsembleRegressor.predict_var_decomposition()
UQBaggingEnsembleRegressor.save()
UQBaggingEnsembleRegressor.save_members_files()
- Evaluator
- deephyper.evaluator.distributed
- deephyper.evaluator.parse_subprocess_result
- deephyper.evaluator.profile
- deephyper.evaluator.queued
- deephyper.evaluator.to_json
- deephyper.evaluator.Evaluator
- deephyper.evaluator.Job
- deephyper.evaluator.MPICommEvaluator
- deephyper.evaluator.ProcessPoolEvaluator
- deephyper.evaluator.RayEvaluator
- deephyper.evaluator.RunningJob
- deephyper.evaluator.SerialEvaluator
- deephyper.evaluator.ThreadPoolEvaluator
- deephyper.evaluator.callback
- deephyper.evaluator.storage
- deephyper.evaluator.storage.MemoryStorage
MemoryStorage
MemoryStorage.connect()
MemoryStorage.create()
MemoryStorage.create_new_job()
MemoryStorage.create_new_search()
MemoryStorage.load_all_job_ids()
MemoryStorage.load_all_search_ids()
MemoryStorage.load_job()
MemoryStorage.load_jobs()
MemoryStorage.load_metadata_from_all_jobs()
MemoryStorage.load_out_from_all_jobs()
MemoryStorage.load_search()
MemoryStorage.load_search_value()
MemoryStorage.store_job()
MemoryStorage.store_job_in()
MemoryStorage.store_job_metadata()
MemoryStorage.store_job_out()
MemoryStorage.store_search_value()
- deephyper.evaluator.storage.RayStorage
RayStorage
RayStorage.connect()
RayStorage.create()
RayStorage.create_new_job()
RayStorage.create_new_search()
RayStorage.load_all_job_ids()
RayStorage.load_all_search_ids()
RayStorage.load_job()
RayStorage.load_jobs()
RayStorage.load_metadata_from_all_jobs()
RayStorage.load_out_from_all_jobs()
RayStorage.load_search()
RayStorage.load_search_value()
RayStorage.store_job()
RayStorage.store_job_in()
RayStorage.store_job_metadata()
RayStorage.store_job_out()
RayStorage.store_search_value()
- deephyper.evaluator.storage.RedisStorage
RedisStorage
RedisStorage.connect()
RedisStorage.create()
RedisStorage.create_new_job()
RedisStorage.create_new_search()
RedisStorage.load_all_job_ids()
RedisStorage.load_all_search_ids()
RedisStorage.load_job()
RedisStorage.load_jobs()
RedisStorage.load_metadata_from_all_jobs()
RedisStorage.load_out_from_all_jobs()
RedisStorage.load_search()
RedisStorage.load_search_value()
RedisStorage.store_job()
RedisStorage.store_job_in()
RedisStorage.store_job_metadata()
RedisStorage.store_job_out()
RedisStorage.store_search_value()
- deephyper.evaluator.storage.Storage
Storage
Storage.connect()
Storage.create()
Storage.create_new_job()
Storage.create_new_search()
Storage.load_all_job_ids()
Storage.load_all_search_ids()
Storage.load_job()
Storage.load_jobs()
Storage.load_metadata_from_all_jobs()
Storage.load_out_from_all_jobs()
Storage.load_search()
Storage.load_search_value()
Storage.store_job()
Storage.store_job_in()
Storage.store_job_metadata()
Storage.store_job_out()
Storage.store_search_value()
- deephyper.evaluator.storage.MemoryStorage
- Keras
- deephyper.keras.callbacks
- deephyper.keras.callbacks.import_callback
- deephyper.keras.callbacks.CSVExtendedLogger
- deephyper.keras.callbacks.LearningRateScheduleCallback
- deephyper.keras.callbacks.LearningRateWarmupCallback
- deephyper.keras.callbacks.StopIfUnfeasible
- deephyper.keras.callbacks.TimeStopping
- deephyper.keras.callbacks.csv_extended_logger
- deephyper.keras.callbacks.learning_rate_warmup
- deephyper.keras.callbacks.stop_if_unfeasible
- deephyper.keras.callbacks.stop_on_timeout
- deephyper.keras.callbacks.stop_on_timeout.TerminateOnTimeOut
- deephyper.keras.callbacks.stop_on_timeout.datetime
datetime
datetime.__add__()
datetime.astimezone()
datetime.combine()
datetime.ctime()
datetime.date()
datetime.dst()
datetime.fromisocalendar()
datetime.fromisoformat()
datetime.fromordinal()
datetime.fromtimestamp()
datetime.isocalendar()
datetime.isoformat()
datetime.isoweekday()
datetime.now()
datetime.replace()
datetime.strftime()
datetime.strptime()
datetime.time()
datetime.timestamp()
datetime.timetuple()
datetime.timetz()
datetime.today()
datetime.toordinal()
datetime.tzname()
datetime.utcfromtimestamp()
datetime.utcnow()
datetime.utcoffset()
datetime.utctimetuple()
datetime.weekday()
- deephyper.keras.callbacks.time_stopping
- deephyper.keras.callbacks.utils
- deephyper.keras.layers
- deephyper.keras.layers.AttentionCOS
- deephyper.keras.layers.AttentionConst
- deephyper.keras.layers.AttentionGAT
- deephyper.keras.layers.AttentionGCN
- deephyper.keras.layers.AttentionGenLinear
- deephyper.keras.layers.AttentionLinear
- deephyper.keras.layers.AttentionSymGAT
- deephyper.keras.layers.GlobalAttentionPool
- deephyper.keras.layers.GlobalAttentionSumPool
- deephyper.keras.layers.GlobalAvgPool
- deephyper.keras.layers.GlobalMaxPool
- deephyper.keras.layers.GlobalSumPool
- deephyper.keras.layers.MessagePasserNNM
- deephyper.keras.layers.MessagePassing
- deephyper.keras.layers.Padding
- deephyper.keras.layers.SparseMPNN
- deephyper.keras.layers.UpdateFuncGRU
- deephyper.keras.layers.UpdateFuncMLP
- deephyper.keras.utils
- deephyper.keras.callbacks
- NAS
- deephyper.nas.KSearchSpace
- deephyper.nas.NxSearchSpace
- deephyper.nas.losses
- deephyper.nas.lr_scheduler
- deephyper.nas.metrics
- deephyper.nas.metrics.acc
- deephyper.nas.metrics.load_attr
- deephyper.nas.metrics.mae
- deephyper.nas.metrics.mse
- deephyper.nas.metrics.r2
- deephyper.nas.metrics.rmse
- deephyper.nas.metrics.selectMetric
- deephyper.nas.metrics.sparse_perplexity
- deephyper.nas.metrics.tfp_mae
- deephyper.nas.metrics.tfp_mse
- deephyper.nas.metrics.tfp_r2
- deephyper.nas.metrics.tfp_rmse
- deephyper.nas.metrics.to_tfp
- deephyper.nas.metrics.OrderedDict
- deephyper.nas.node
- deephyper.nas.operation
- deephyper.nas.operation.operation
- deephyper.nas.operation.AddByPadding
- deephyper.nas.operation.AddByProjecting
- deephyper.nas.operation.Concatenate
- deephyper.nas.operation.Connect
- deephyper.nas.operation.Identity
- deephyper.nas.operation.Operation
- deephyper.nas.operation.Tensor
- deephyper.nas.operation.Zero
- deephyper.nas.preprocessing
- deephyper.nas.run
- deephyper.nas.spacelib
- deephyper.nas.spacelib.tabular
- deephyper.nas.spacelib.tabular.DenseSkipCoSpace
DenseSkipCoSpace
DenseSkipCoSpace.add_node()
DenseSkipCoSpace.build()
DenseSkipCoSpace.choices()
DenseSkipCoSpace.connect()
DenseSkipCoSpace.denormalize()
DenseSkipCoSpace.max_num_ops
DenseSkipCoSpace.mime_nodes
DenseSkipCoSpace.nodes
DenseSkipCoSpace.num_nodes
DenseSkipCoSpace.sample()
DenseSkipCoSpace.size
DenseSkipCoSpace.variable_nodes
- deephyper.nas.spacelib.tabular.FeedForwardSpace
FeedForwardSpace
FeedForwardSpace.add_node()
FeedForwardSpace.build()
FeedForwardSpace.choices()
FeedForwardSpace.connect()
FeedForwardSpace.denormalize()
FeedForwardSpace.max_num_ops
FeedForwardSpace.mime_nodes
FeedForwardSpace.nodes
FeedForwardSpace.num_nodes
FeedForwardSpace.sample()
FeedForwardSpace.size
FeedForwardSpace.variable_nodes
- deephyper.nas.spacelib.tabular.OneLayerSpace
- deephyper.nas.spacelib.tabular.SupervisedRegAutoEncoderSpace
SupervisedRegAutoEncoderSpace
SupervisedRegAutoEncoderSpace.add_node()
SupervisedRegAutoEncoderSpace.build()
SupervisedRegAutoEncoderSpace.choices()
SupervisedRegAutoEncoderSpace.connect()
SupervisedRegAutoEncoderSpace.denormalize()
SupervisedRegAutoEncoderSpace.max_num_ops
SupervisedRegAutoEncoderSpace.mime_nodes
SupervisedRegAutoEncoderSpace.nodes
SupervisedRegAutoEncoderSpace.num_nodes
SupervisedRegAutoEncoderSpace.sample()
SupervisedRegAutoEncoderSpace.size
SupervisedRegAutoEncoderSpace.variable_nodes
- deephyper.nas.spacelib.tabular.dense_skipco
- deephyper.nas.spacelib.tabular.dense_skipco.operation
- deephyper.nas.spacelib.tabular.dense_skipco.AddByProjecting
- deephyper.nas.spacelib.tabular.dense_skipco.Connect
- deephyper.nas.spacelib.tabular.dense_skipco.ConstantNode
- deephyper.nas.spacelib.tabular.dense_skipco.Dense
- deephyper.nas.spacelib.tabular.dense_skipco.DenseSkipCoSpace
DenseSkipCoSpace
DenseSkipCoSpace.add_node()
DenseSkipCoSpace.build()
DenseSkipCoSpace.choices()
DenseSkipCoSpace.connect()
DenseSkipCoSpace.denormalize()
DenseSkipCoSpace.max_num_ops
DenseSkipCoSpace.mime_nodes
DenseSkipCoSpace.nodes
DenseSkipCoSpace.num_nodes
DenseSkipCoSpace.sample()
DenseSkipCoSpace.size
DenseSkipCoSpace.variable_nodes
- deephyper.nas.spacelib.tabular.dense_skipco.Dropout
- deephyper.nas.spacelib.tabular.dense_skipco.Identity
- deephyper.nas.spacelib.tabular.dense_skipco.KSearchSpace
- deephyper.nas.spacelib.tabular.dense_skipco.VariableNode
- deephyper.nas.spacelib.tabular.dense_skipco.Zero
- deephyper.nas.spacelib.tabular.feed_forward
- deephyper.nas.spacelib.tabular.feed_forward.operation
- deephyper.nas.spacelib.tabular.feed_forward.ConstantNode
- deephyper.nas.spacelib.tabular.feed_forward.Dense
- deephyper.nas.spacelib.tabular.feed_forward.FeedForwardSpace
FeedForwardSpace
FeedForwardSpace.add_node()
FeedForwardSpace.build()
FeedForwardSpace.choices()
FeedForwardSpace.connect()
FeedForwardSpace.denormalize()
FeedForwardSpace.max_num_ops
FeedForwardSpace.mime_nodes
FeedForwardSpace.nodes
FeedForwardSpace.num_nodes
FeedForwardSpace.sample()
FeedForwardSpace.size
FeedForwardSpace.variable_nodes
- deephyper.nas.spacelib.tabular.feed_forward.Identity
- deephyper.nas.spacelib.tabular.feed_forward.KSearchSpace
- deephyper.nas.spacelib.tabular.feed_forward.VariableNode
- deephyper.nas.spacelib.tabular.one_layer
- deephyper.nas.spacelib.tabular.one_layer.operation
- deephyper.nas.spacelib.tabular.one_layer.Concatenate
- deephyper.nas.spacelib.tabular.one_layer.ConstantNode
- deephyper.nas.spacelib.tabular.one_layer.Dense
- deephyper.nas.spacelib.tabular.one_layer.Dropout
- deephyper.nas.spacelib.tabular.one_layer.KSearchSpace
- deephyper.nas.spacelib.tabular.one_layer.OneLayerSpace
- deephyper.nas.spacelib.tabular.one_layer.VariableNode
- deephyper.nas.spacelib.tabular.supervised_reg_auto_encoder
- deephyper.nas.spacelib.tabular.supervised_reg_auto_encoder.operation
- deephyper.nas.spacelib.tabular.supervised_reg_auto_encoder.ConstantNode
- deephyper.nas.spacelib.tabular.supervised_reg_auto_encoder.Dense
- deephyper.nas.spacelib.tabular.supervised_reg_auto_encoder.Identity
- deephyper.nas.spacelib.tabular.supervised_reg_auto_encoder.KSearchSpace
- deephyper.nas.spacelib.tabular.supervised_reg_auto_encoder.SupervisedRegAutoEncoderSpace
SupervisedRegAutoEncoderSpace
SupervisedRegAutoEncoderSpace.add_node()
SupervisedRegAutoEncoderSpace.build()
SupervisedRegAutoEncoderSpace.choices()
SupervisedRegAutoEncoderSpace.connect()
SupervisedRegAutoEncoderSpace.denormalize()
SupervisedRegAutoEncoderSpace.max_num_ops
SupervisedRegAutoEncoderSpace.mime_nodes
SupervisedRegAutoEncoderSpace.nodes
SupervisedRegAutoEncoderSpace.num_nodes
SupervisedRegAutoEncoderSpace.sample()
SupervisedRegAutoEncoderSpace.size
SupervisedRegAutoEncoderSpace.variable_nodes
- deephyper.nas.spacelib.tabular.supervised_reg_auto_encoder.VariableNode
- deephyper.nas.spacelib.tabular.DenseSkipCoSpace
- deephyper.nas.spacelib.tabular
- deephyper.nas.trainer
- Problem
- deephyper.problem.HpProblem
- deephyper.problem.NaProblem
NaProblem
NaProblem.add_hyperparameter()
NaProblem.build_search_space()
NaProblem.default_hp_configuration
NaProblem.extract_hp_values()
NaProblem.gen_config()
NaProblem.get_keras_model()
NaProblem.hyperparameter_names
NaProblem.hyperparameters()
NaProblem.load_data()
NaProblem.loss()
NaProblem.metrics()
NaProblem.objective()
NaProblem.preprocessing()
NaProblem.search_space()
- Search
- deephyper.search.Search
- deephyper.search.hps
- deephyper.search.nas
- Skopt
- deephyper.skopt.dummy_minimize
- deephyper.skopt.dump
- deephyper.skopt.expected_minimum
- deephyper.skopt.forest_minimize
- deephyper.skopt.gbrt_minimize
- deephyper.skopt.gp_minimize
- deephyper.skopt.load
- deephyper.skopt.BayesSearchCV
- deephyper.skopt.Optimizer
- deephyper.skopt.Space
Space
Space.bounds
Space.dimension_names
Space.distance()
Space.from_yaml()
Space.get_transformer()
Space.inverse_transform()
Space.is_categorical
Space.is_partly_categorical
Space.is_real
Space.n_constant_dimensions
Space.n_dims
Space.rvs()
Space.set_transformer()
Space.set_transformer_by_type()
Space.transform()
Space.transformed_bounds
Space.transformed_n_dims
Space.update_prior()
- deephyper.skopt.acquisition
- deephyper.skopt.benchmarks
- deephyper.skopt.callbacks
- deephyper.skopt.callbacks.check_callback
- deephyper.skopt.callbacks.dump
- deephyper.skopt.callbacks.time
- deephyper.skopt.callbacks.Callable
- deephyper.skopt.callbacks.CheckpointSaver
- deephyper.skopt.callbacks.DeadlineStopper
- deephyper.skopt.callbacks.DeltaXStopper
- deephyper.skopt.callbacks.DeltaYStopper
- deephyper.skopt.callbacks.EarlyStopper
- deephyper.skopt.callbacks.HollowIterationsStopper
- deephyper.skopt.callbacks.ThresholdStopper
- deephyper.skopt.callbacks.TimerCallback
- deephyper.skopt.callbacks.VerboseCallback
- deephyper.skopt.learning
- deephyper.skopt.learning.ExtraTreesRegressor
- deephyper.skopt.learning.GradientBoostingQuantileRegressor
- deephyper.skopt.learning.RandomForestRegressor
- deephyper.skopt.learning.forest
- deephyper.skopt.learning.gbrt
- deephyper.skopt.moo
- deephyper.skopt.moo.hypervolume
- deephyper.skopt.moo.is_pareto_efficient
- deephyper.skopt.moo.non_dominated_set
- deephyper.skopt.moo.non_dominated_set_ranked
- deephyper.skopt.moo.pareto_front
- deephyper.skopt.moo.MoAugmentedChebyshevFunction
- deephyper.skopt.moo.MoChebyshevFunction
- deephyper.skopt.moo.MoLinearFunction
- deephyper.skopt.moo.MoPBIFunction
- deephyper.skopt.moo.MoQuadraticFunction
- deephyper.skopt.moo.MoScalarFunction
- deephyper.skopt.optimizer
- deephyper.skopt.optimizer.base_minimize
- deephyper.skopt.optimizer.dummy_minimize
- deephyper.skopt.optimizer.forest_minimize
- deephyper.skopt.optimizer.gbrt_minimize
- deephyper.skopt.optimizer.gp_minimize
- deephyper.skopt.optimizer.Optimizer
- deephyper.skopt.optimizer.base
- deephyper.skopt.optimizer.dummy
- deephyper.skopt.optimizer.forest
- deephyper.skopt.optimizer.gbrt
- deephyper.skopt.optimizer.gp
- deephyper.skopt.optimizer.optimizer
- deephyper.skopt.optimizer.optimizer.boltzmann_distribution
- deephyper.skopt.optimizer.optimizer.check_x_in_space
- deephyper.skopt.optimizer.optimizer.cook_estimator
- deephyper.skopt.optimizer.optimizer.cook_initial_point_generator
- deephyper.skopt.optimizer.optimizer.cook_objective_scaler
- deephyper.skopt.optimizer.optimizer.create_result
- deephyper.skopt.optimizer.optimizer.gaussian_acquisition_1D
- deephyper.skopt.optimizer.optimizer.has_gradients
- deephyper.skopt.optimizer.optimizer.is_2Dlistlike
- deephyper.skopt.optimizer.optimizer.is_listlike
- deephyper.skopt.optimizer.optimizer.log
- deephyper.skopt.optimizer.optimizer.normalize_dimensions
- deephyper.skopt.optimizer.optimizer.Categorical
- deephyper.skopt.optimizer.optimizer.MoScalarFunction
- deephyper.skopt.optimizer.optimizer.Optimizer
- deephyper.skopt.optimizer.optimizer.Space
Space
Space.bounds
Space.dimension_names
Space.distance()
Space.from_yaml()
Space.get_transformer()
Space.inverse_transform()
Space.is_categorical
Space.is_partly_categorical
Space.is_real
Space.n_constant_dimensions
Space.n_dims
Space.rvs()
Space.set_transformer()
Space.set_transformer_by_type()
Space.transform()
Space.transformed_bounds
Space.transformed_n_dims
Space.update_prior()
- deephyper.skopt.optimizer.optimizer.ExhaustedFailures
- deephyper.skopt.optimizer.optimizer.ExhaustedSearchSpace
- deephyper.skopt.sampler
- deephyper.skopt.sampler.Grid
- deephyper.skopt.sampler.Halton
- deephyper.skopt.sampler.Hammersly
- deephyper.skopt.sampler.InitialPointGenerator
- deephyper.skopt.sampler.Lhs
- deephyper.skopt.sampler.Sobol
- deephyper.skopt.sampler.base
- deephyper.skopt.sampler.grid
- deephyper.skopt.sampler.grid.Grid
- deephyper.skopt.sampler.grid.InitialPointGenerator
- deephyper.skopt.sampler.grid.Space
Space
Space.bounds
Space.dimension_names
Space.distance()
Space.from_yaml()
Space.get_transformer()
Space.inverse_transform()
Space.is_categorical
Space.is_partly_categorical
Space.is_real
Space.n_constant_dimensions
Space.n_dims
Space.rvs()
Space.set_transformer()
Space.set_transformer_by_type()
Space.transform()
Space.transformed_bounds
Space.transformed_n_dims
Space.update_prior()
- deephyper.skopt.sampler.halton
- deephyper.skopt.sampler.halton.Halton
- deephyper.skopt.sampler.halton.InitialPointGenerator
- deephyper.skopt.sampler.halton.Space
Space
Space.bounds
Space.dimension_names
Space.distance()
Space.from_yaml()
Space.get_transformer()
Space.inverse_transform()
Space.is_categorical
Space.is_partly_categorical
Space.is_real
Space.n_constant_dimensions
Space.n_dims
Space.rvs()
Space.set_transformer()
Space.set_transformer_by_type()
Space.transform()
Space.transformed_bounds
Space.transformed_n_dims
Space.update_prior()
- deephyper.skopt.sampler.hammersly
- deephyper.skopt.sampler.hammersly.Halton
- deephyper.skopt.sampler.hammersly.Hammersly
- deephyper.skopt.sampler.hammersly.InitialPointGenerator
- deephyper.skopt.sampler.hammersly.Space
Space
Space.bounds
Space.dimension_names
Space.distance()
Space.from_yaml()
Space.get_transformer()
Space.inverse_transform()
Space.is_categorical
Space.is_partly_categorical
Space.is_real
Space.n_constant_dimensions
Space.n_dims
Space.rvs()
Space.set_transformer()
Space.set_transformer_by_type()
Space.transform()
Space.transformed_bounds
Space.transformed_n_dims
Space.update_prior()
- deephyper.skopt.sampler.lhs
- deephyper.skopt.sampler.lhs.InitialPointGenerator
- deephyper.skopt.sampler.lhs.Lhs
- deephyper.skopt.sampler.lhs.Space
Space
Space.bounds
Space.dimension_names
Space.distance()
Space.from_yaml()
Space.get_transformer()
Space.inverse_transform()
Space.is_categorical
Space.is_partly_categorical
Space.is_real
Space.n_constant_dimensions
Space.n_dims
Space.rvs()
Space.set_transformer()
Space.set_transformer_by_type()
Space.transform()
Space.transformed_bounds
Space.transformed_n_dims
Space.update_prior()
- deephyper.skopt.sampler.sobol
- deephyper.skopt.sampler.sobol.InitialPointGenerator
- deephyper.skopt.sampler.sobol.Sobol
- deephyper.skopt.sampler.sobol.Space
Space
Space.bounds
Space.dimension_names
Space.distance()
Space.from_yaml()
Space.get_transformer()
Space.inverse_transform()
Space.is_categorical
Space.is_partly_categorical
Space.is_real
Space.n_constant_dimensions
Space.n_dims
Space.rvs()
Space.set_transformer()
Space.set_transformer_by_type()
Space.transform()
Space.transformed_bounds
Space.transformed_n_dims
Space.update_prior()
- deephyper.skopt.searchcv
- deephyper.skopt.searchcv.check_callback
- deephyper.skopt.searchcv.check_dimension
- deephyper.skopt.searchcv.dimensions_aslist
- deephyper.skopt.searchcv.eval_callbacks
- deephyper.skopt.searchcv.point_asdict
- deephyper.skopt.searchcv.rankdata
- deephyper.skopt.searchcv.BayesSearchCV
- deephyper.skopt.searchcv.Optimizer
- deephyper.skopt.space
- deephyper.skopt.space.check_dimension
- deephyper.skopt.space.Categorical
- deephyper.skopt.space.CategoricalEncoder
- deephyper.skopt.space.Dimension
- deephyper.skopt.space.Identity
- deephyper.skopt.space.Integer
- deephyper.skopt.space.LabelEncoder
- deephyper.skopt.space.LogN
- deephyper.skopt.space.Normalize
- deephyper.skopt.space.Pipeline
- deephyper.skopt.space.Real
- deephyper.skopt.space.Space
Space
Space.bounds
Space.dimension_names
Space.distance()
Space.from_yaml()
Space.get_transformer()
Space.inverse_transform()
Space.is_categorical
Space.is_partly_categorical
Space.is_real
Space.n_constant_dimensions
Space.n_dims
Space.rvs()
Space.set_transformer()
Space.set_transformer_by_type()
Space.transform()
Space.transformed_bounds
Space.transformed_n_dims
Space.update_prior()
- deephyper.skopt.space.StringEncoder
- deephyper.skopt.space.ToInteger
- deephyper.skopt.space.gaussian_kde
gaussian_kde
gaussian_kde.dataset
gaussian_kde.d
gaussian_kde.n
gaussian_kde.neff
gaussian_kde.factor
gaussian_kde.covariance
gaussian_kde.inv_cov
gaussian_kde.evaluate()
gaussian_kde.__call__()
gaussian_kde.integrate_gaussian()
gaussian_kde.integrate_box_1d()
gaussian_kde.integrate_box()
gaussian_kde.integrate_kde()
gaussian_kde.pdf()
gaussian_kde.logpdf()
gaussian_kde.resample()
gaussian_kde.set_bandwidth()
gaussian_kde.covariance_factor()
gaussian_kde.__call__()
gaussian_kde.covariance_factor()
gaussian_kde.evaluate()
gaussian_kde.integrate_box()
gaussian_kde.integrate_box_1d()
gaussian_kde.integrate_gaussian()
gaussian_kde.integrate_kde()
gaussian_kde.logpdf()
gaussian_kde.marginal()
gaussian_kde.pdf()
gaussian_kde.resample()
gaussian_kde.scotts_factor()
gaussian_kde.set_bandwidth()
gaussian_kde.silverman_factor()
- deephyper.skopt.space.rv_discrete
rv_discrete
rv_discrete.rvs()
rv_discrete.pmf()
rv_discrete.logpmf()
rv_discrete.cdf()
rv_discrete.logcdf()
rv_discrete.sf()
rv_discrete.logsf()
rv_discrete.ppf()
rv_discrete.isf()
rv_discrete.moment()
rv_discrete.stats()
rv_discrete.entropy()
rv_discrete.expect()
rv_discrete.median()
rv_discrete.mean()
rv_discrete.std()
rv_discrete.var()
rv_discrete.interval()
rv_discrete.__call__()
rv_discrete.support()
rv_discrete.__call__()
rv_discrete.cdf()
rv_discrete.entropy()
rv_discrete.expect()
rv_discrete.freeze()
rv_discrete.interval()
rv_discrete.isf()
rv_discrete.logcdf()
rv_discrete.logpmf()
rv_discrete.logsf()
rv_discrete.mean()
rv_discrete.median()
rv_discrete.moment()
rv_discrete.nnlf()
rv_discrete.pmf()
rv_discrete.ppf()
rv_discrete.random_state
rv_discrete.rvs()
rv_discrete.sf()
rv_discrete.stats()
rv_discrete.std()
rv_discrete.support()
rv_discrete.var()
- deephyper.skopt.space.space
- deephyper.skopt.space.space.check_dimension
- deephyper.skopt.space.space.Categorical
- deephyper.skopt.space.space.CategoricalEncoder
- deephyper.skopt.space.space.Dimension
- deephyper.skopt.space.space.Identity
- deephyper.skopt.space.space.Integer
- deephyper.skopt.space.space.LabelEncoder
- deephyper.skopt.space.space.LogN
- deephyper.skopt.space.space.Normalize
- deephyper.skopt.space.space.Pipeline
- deephyper.skopt.space.space.Real
- deephyper.skopt.space.space.Space
Space
Space.bounds
Space.dimension_names
Space.distance()
Space.from_yaml()
Space.get_transformer()
Space.inverse_transform()
Space.is_categorical
Space.is_partly_categorical
Space.is_real
Space.n_constant_dimensions
Space.n_dims
Space.rvs()
Space.set_transformer()
Space.set_transformer_by_type()
Space.transform()
Space.transformed_bounds
Space.transformed_n_dims
Space.update_prior()
- deephyper.skopt.space.space.StringEncoder
- deephyper.skopt.space.space.ToInteger
- deephyper.skopt.space.space.gaussian_kde
gaussian_kde
gaussian_kde.dataset
gaussian_kde.d
gaussian_kde.n
gaussian_kde.neff
gaussian_kde.factor
gaussian_kde.covariance
gaussian_kde.inv_cov
gaussian_kde.evaluate()
gaussian_kde.__call__()
gaussian_kde.integrate_gaussian()
gaussian_kde.integrate_box_1d()
gaussian_kde.integrate_box()
gaussian_kde.integrate_kde()
gaussian_kde.pdf()
gaussian_kde.logpdf()
gaussian_kde.resample()
gaussian_kde.set_bandwidth()
gaussian_kde.covariance_factor()
gaussian_kde.__call__()
gaussian_kde.covariance_factor()
gaussian_kde.evaluate()
gaussian_kde.integrate_box()
gaussian_kde.integrate_box_1d()
gaussian_kde.integrate_gaussian()
gaussian_kde.integrate_kde()
gaussian_kde.logpdf()
gaussian_kde.marginal()
gaussian_kde.pdf()
gaussian_kde.resample()
gaussian_kde.scotts_factor()
gaussian_kde.set_bandwidth()
gaussian_kde.silverman_factor()
- deephyper.skopt.space.space.rv_discrete
rv_discrete
rv_discrete.rvs()
rv_discrete.pmf()
rv_discrete.logpmf()
rv_discrete.cdf()
rv_discrete.logcdf()
rv_discrete.sf()
rv_discrete.logsf()
rv_discrete.ppf()
rv_discrete.isf()
rv_discrete.moment()
rv_discrete.stats()
rv_discrete.entropy()
rv_discrete.expect()
rv_discrete.median()
rv_discrete.mean()
rv_discrete.std()
rv_discrete.var()
rv_discrete.interval()
rv_discrete.__call__()
rv_discrete.support()
rv_discrete.__call__()
rv_discrete.cdf()
rv_discrete.entropy()
rv_discrete.expect()
rv_discrete.freeze()
rv_discrete.interval()
rv_discrete.isf()
rv_discrete.logcdf()
rv_discrete.logpmf()
rv_discrete.logsf()
rv_discrete.mean()
rv_discrete.median()
rv_discrete.moment()
rv_discrete.nnlf()
rv_discrete.pmf()
rv_discrete.ppf()
rv_discrete.random_state
rv_discrete.rvs()
rv_discrete.sf()
rv_discrete.stats()
rv_discrete.std()
rv_discrete.support()
rv_discrete.var()
- deephyper.skopt.space.transformers
- deephyper.skopt.space.transformers.CategoricalEncoder
- deephyper.skopt.space.transformers.Identity
- deephyper.skopt.space.transformers.LabelEncoder
- deephyper.skopt.space.transformers.LogN
- deephyper.skopt.space.transformers.Normalize
- deephyper.skopt.space.transformers.Pipeline
- deephyper.skopt.space.transformers.StringEncoder
- deephyper.skopt.space.transformers.ToInteger
- deephyper.skopt.space.transformers.Transformer
- deephyper.skopt.utils
- deephyper.skopt.utils.check_dimension_names
- deephyper.skopt.utils.check_list_types
- deephyper.skopt.utils.check_x_in_space
- deephyper.skopt.utils.cook_estimator
- deephyper.skopt.utils.cook_initial_point_generator
- deephyper.skopt.utils.cook_objective_scaler
- deephyper.skopt.utils.create_result
- deephyper.skopt.utils.deepcopy
- deephyper.skopt.utils.dimensions_aslist
- deephyper.skopt.utils.dump
- deephyper.skopt.utils.eval_callbacks
- deephyper.skopt.utils.expected_minimum
- deephyper.skopt.utils.expected_minimum_random_sampling
- deephyper.skopt.utils.has_gradients
- deephyper.skopt.utils.is_2Dlistlike
- deephyper.skopt.utils.is_listlike
- deephyper.skopt.utils.load
- deephyper.skopt.utils.normalize_dimensions
- deephyper.skopt.utils.point_asdict
- deephyper.skopt.utils.point_aslist
- deephyper.skopt.utils.use_named_args
- deephyper.skopt.utils.wraps
- deephyper.skopt.utils.Dimension
- deephyper.skopt.utils.ExtraTreesRegressor
- deephyper.skopt.utils.GradientBoostingQuantileRegressor
- deephyper.skopt.utils.Grid
- deephyper.skopt.utils.Halton
- deephyper.skopt.utils.Hammersly
- deephyper.skopt.utils.InitialPointGenerator
- deephyper.skopt.utils.Lhs
- deephyper.skopt.utils.OrderedDict
- deephyper.skopt.utils.RandomForestRegressor
- deephyper.skopt.utils.Sobol
- deephyper.skopt.utils.Space
Space
Space.bounds
Space.dimension_names
Space.distance()
Space.from_yaml()
Space.get_transformer()
Space.inverse_transform()
Space.is_categorical
Space.is_partly_categorical
Space.is_real
Space.n_constant_dimensions
Space.n_dims
Space.rvs()
Space.set_transformer()
Space.set_transformer_by_type()
Space.transform()
Space.transformed_bounds
Space.transformed_n_dims
Space.update_prior()
- Stopper
- deephyper.stopper.ConstantStopper
- deephyper.stopper.IdleStopper
- deephyper.stopper.LCModelStopper
- deephyper.stopper.MedianStopper
- deephyper.stopper.Stopper
- deephyper.stopper.SuccessiveHalvingStopper
- deephyper.stopper.integration
Developer Guides