R Branin Saasbo - High Dimensional Optimization¶
This notebook is an example of a single objective R model optimization using a branin synthetic function (2 dimensions) embedded in a higher dimensional space. We only run a few trials in this notebook because SAASBO is more computationally expensive than BO algorithms.
See the folder r_branin_saasbo for the R script and the configuration file.
1# This notebook uses hidden cells to import and display things so
2# that it can be ran regullary to make sure the documentation
3# is up to date and not broken (as opposed to a markdown file
4# that would have an exmaple written once and get out of date
5# as the code base changes)
6
7# These hidden cells are only responsible for rerunning
8# the documentation to ensure it is correct.
9# the actual relavent part of the documentation
10# are the non hidden parts
Configuration File¶
config.yaml
{% set n_dim_per_domain = 50 %}
{% set init_trials = 3 %}
{% set n_trials = init_trials + 6 %}
objective:
metrics:
# List all of your metrics here,
# only list 1 metric for a single objective optimization
- metric: branin
metric_type: synthetic_metric
noise_sd: 0.0
param_names: ["x2", "x{{ n_dim_per_domain + 2 }}"]
minimize: true
parameters:
{% for i in range(n_dim_per_domain) %}
x{{ i }}:
type: range
bounds: [-5, 10]
value_type: float
{% endfor %}
{% for i in range(n_dim_per_domain) %}
x{{ i + n_dim_per_domain }}:
type: range
bounds: [0, 15]
value_type: float
{% endfor %}
scheduler:
n_trials: {{ n_trials }}
generation_strategy:
use_saasbo: true
num_initialization_trials: {{ init_trials }}
script_options:
run_model: Rscript run_model.R
exp_name: {{ config_dir_name }}_{{ 2*n_dim_per_domain }}d
Run Model Wrapper Script¶
run_model.R
# load in any libraries and modules we need
library(jsonlite)
trial_dir <- commandArgs(trailingOnly=TRUE)[1]
data <- read_json(path=file.path(trial_dir, "filtered_parameters.json"))
params <- rep(NA, length(data$branin))
for(i in 1:length(params)) {
params[i] <-data$branin[i]
}
write(toJSON(list(branin=params), auto_unbox=TRUE), file.path(trial_dir, "output.json"))
Running our script¶
To run our script we just need to pass the config file to BOA’s CLI
python -m boa --config-file path/to/config.yaml
or
python -m boa -c path/to/config.yaml
[WARNING 07-18 23:48:30] ax.service.utils.with_db_settings_base: Ax currently requires a sqlalchemy version below 2.0. This will be addressed in a future release. Disabling SQL storage in Ax for now, if you would like to use SQL storage please install Ax with mysql extras via `pip install ax-platform[mysql]`.
[INFO 07-18 23:48:31] ax.service.utils.instantiation: Created search space: SearchSpace(parameters=[RangeParameter(name='x0', parameter_type=FLOAT, range=[-5.0, 10.0]), RangeParameter(name='x1', parameter_type=FLOAT, range=[-5.0, 10.0]), RangeParameter(name='x2', parameter_type=FLOAT, range=[-5.0, 10.0]), RangeParameter(name='x3', parameter_type=FLOAT, range=[-5.0, 10.0]), RangeParameter(name='x4', parameter_type=FLOAT, range=[-5.0, 10.0]), RangeParameter(name='x5', parameter_type=FLOAT, range=[-5.0, 10.0]), RangeParameter(name='x6', parameter_type=FLOAT, range=[-5.0, 10.0]), RangeParameter(name='x7', parameter_type=FLOAT, range=[-5.0, 10.0]), RangeParameter(name='x8', parameter_type=FLOAT, range=[-5.0, 10.0]), RangeParameter(name='x9', parameter_type=FLOAT, range=[-5.0, 10.0]), RangeParameter(name='x10', parameter_type=FLOAT, range=[-5.0, 10.0]), RangeParameter(name='x11', parameter_type=FLOAT, range=[-5.0, 10.0]), RangeParameter(name='x12', parameter_type=FLOAT, range=[-5.0, 10.0]), RangeParameter(name='x13', parameter_type=FLOAT, range=[-5.0, 10.0]), RangeParameter(name='x14', parameter_type=FLOAT, range=[-5.0, 10.0]), RangeParameter(name='x15', parameter_type=FLOAT, range=[-5.0, 10.0]), RangeParameter(name='x16', parameter_type=FLOAT, range=[-5.0, 10.0]), RangeParameter(name='x17', parameter_type=FLOAT, range=[-5.0, 10.0]), RangeParameter(name='x18', parameter_type=FLOAT, range=[-5.0, 10.0]), RangeParameter(name='x19', parameter_type=FLOAT, range=[-5.0, 10.0]), RangeParameter(name='x20', parameter_type=FLOAT, range=[-5.0, 10.0]), RangeParameter(name='x21', parameter_type=FLOAT, range=[-5.0, 10.0]), RangeParameter(name='x22', parameter_type=FLOAT, range=[-5.0, 10.0]), RangeParameter(name='x23', parameter_type=FLOAT, range=[-5.0, 10.0]), RangeParameter(name='x24', parameter_type=FLOAT, range=[-5.0, 10.0]), RangeParameter(name='x25', parameter_type=FLOAT, range=[-5.0, 10.0]), RangeParameter(name='x26', parameter_type=FLOAT, range=[-5.0, 10.0]), RangeParameter(name='x27', parameter_type=FLOAT, range=[-5.0, 10.0]), RangeParameter(name='x28', parameter_type=FLOAT, range=[-5.0, 10.0]), RangeParameter(name='x29', parameter_type=FLOAT, range=[-5.0, 10.0]), RangeParameter(name='x30', parameter_type=FLOAT, range=[-5.0, 10.0]), RangeParameter(name='x31', parameter_type=FLOAT, range=[-5.0, 10.0]), RangeParameter(name='x32', parameter_type=FLOAT, range=[-5.0, 10.0]), RangeParameter(name='x33', parameter_type=FLOAT, range=[-5.0, 10.0]), RangeParameter(name='x34', parameter_type=FLOAT, range=[-5.0, 10.0]), RangeParameter(name='x35', parameter_type=FLOAT, range=[-5.0, 10.0]), RangeParameter(name='x36', parameter_type=FLOAT, range=[-5.0, 10.0]), RangeParameter(name='x37', parameter_type=FLOAT, range=[-5.0, 10.0]), RangeParameter(name='x38', parameter_type=FLOAT, range=[-5.0, 10.0]), RangeParameter(name='x39', parameter_type=FLOAT, range=[-5.0, 10.0]), RangeParameter(name='x40', parameter_type=FLOAT, range=[-5.0, 10.0]), RangeParameter(name='x41', parameter_type=FLOAT, range=[-5.0, 10.0]), RangeParameter(name='x42', parameter_type=FLOAT, range=[-5.0, 10.0]), RangeParameter(name='x43', parameter_type=FLOAT, range=[-5.0, 10.0]), RangeParameter(name='x44', parameter_type=FLOAT, range=[-5.0, 10.0]), RangeParameter(name='x45', parameter_type=FLOAT, range=[-5.0, 10.0]), RangeParameter(name='x46', parameter_type=FLOAT, range=[-5.0, 10.0]), RangeParameter(name='x47', parameter_type=FLOAT, range=[-5.0, 10.0]), RangeParameter(name='x48', parameter_type=FLOAT, range=[-5.0, 10.0]), RangeParameter(name='x49', parameter_type=FLOAT, range=[-5.0, 10.0]), RangeParameter(name='x50', parameter_type=FLOAT, range=[0.0, 15.0]), RangeParameter(name='x51', parameter_type=FLOAT, range=[0.0, 15.0]), RangeParameter(name='x52', parameter_type=FLOAT, range=[0.0, 15.0]), RangeParameter(name='x53', parameter_type=FLOAT, range=[0.0, 15.0]), RangeParameter(name='x54', parameter_type=FLOAT, range=[0.0, 15.0]), RangeParameter(name='x55', parameter_type=FLOAT, range=[0.0, 15.0]), RangeParameter(name='x56', parameter_type=FLOAT, range=[0.0, 15.0]), RangeParameter(name='x57', parameter_type=FLOAT, range=[0.0, 15.0]), RangeParameter(name='x58', parameter_type=FLOAT, range=[0.0, 15.0]), RangeParameter(name='x59', parameter_type=FLOAT, range=[0.0, 15.0]), RangeParameter(name='x60', parameter_type=FLOAT, range=[0.0, 15.0]), RangeParameter(name='x61', parameter_type=FLOAT, range=[0.0, 15.0]), RangeParameter(name='x62', parameter_type=FLOAT, range=[0.0, 15.0]), RangeParameter(name='x63', parameter_type=FLOAT, range=[0.0, 15.0]), RangeParameter(name='x64', parameter_type=FLOAT, range=[0.0, 15.0]), RangeParameter(name='x65', parameter_type=FLOAT, range=[0.0, 15.0]), RangeParameter(name='x66', parameter_type=FLOAT, range=[0.0, 15.0]), RangeParameter(name='x67', parameter_type=FLOAT, range=[0.0, 15.0]), RangeParameter(name='x68', parameter_type=FLOAT, range=[0.0, 15.0]), RangeParameter(name='x69', parameter_type=FLOAT, range=[0.0, 15.0]), RangeParameter(name='x70', parameter_type=FLOAT, range=[0.0, 15.0]), RangeParameter(name='x71', parameter_type=FLOAT, range=[0.0, 15.0]), RangeParameter(name='x72', parameter_type=FLOAT, range=[0.0, 15.0]), RangeParameter(name='x73', parameter_type=FLOAT, range=[0.0, 15.0]), RangeParameter(name='x74', parameter_type=FLOAT, range=[0.0, 15.0]), RangeParameter(name='x75', parameter_type=FLOAT, range=[0.0, 15.0]), RangeParameter(name='x76', parameter_type=FLOAT, range=[0.0, 15.0]), RangeParameter(name='x77', parameter_type=FLOAT, range=[0.0, 15.0]), RangeParameter(name='x78', parameter_type=FLOAT, range=[0.0, 15.0]), RangeParameter(name='x79', parameter_type=FLOAT, range=[0.0, 15.0]), RangeParameter(name='x80', parameter_type=FLOAT, range=[0.0, 15.0]), RangeParameter(name='x81', parameter_type=FLOAT, range=[0.0, 15.0]), RangeParameter(name='x82', parameter_type=FLOAT, range=[0.0, 15.0]), RangeParameter(name='x83', parameter_type=FLOAT, range=[0.0, 15.0]), RangeParameter(name='x84', parameter_type=FLOAT, range=[0.0, 15.0]), RangeParameter(name='x85', parameter_type=FLOAT, range=[0.0, 15.0]), RangeParameter(name='x86', parameter_type=FLOAT, range=[0.0, 15.0]), RangeParameter(name='x87', parameter_type=FLOAT, range=[0.0, 15.0]), RangeParameter(name='x88', parameter_type=FLOAT, range=[0.0, 15.0]), RangeParameter(name='x89', parameter_type=FLOAT, range=[0.0, 15.0]), RangeParameter(name='x90', parameter_type=FLOAT, range=[0.0, 15.0]), RangeParameter(name='x91', parameter_type=FLOAT, range=[0.0, 15.0]), RangeParameter(name='x92', parameter_type=FLOAT, range=[0.0, 15.0]), RangeParameter(name='x93', parameter_type=FLOAT, range=[0.0, 15.0]), RangeParameter(name='x94', parameter_type=FLOAT, range=[0.0, 15.0]), RangeParameter(name='x95', parameter_type=FLOAT, range=[0.0, 15.0]), RangeParameter(name='x96', parameter_type=FLOAT, range=[0.0, 15.0]), RangeParameter(name='x97', parameter_type=FLOAT, range=[0.0, 15.0]), RangeParameter(name='x98', parameter_type=FLOAT, range=[0.0, 15.0]), RangeParameter(name='x99', parameter_type=FLOAT, range=[0.0, 15.0])], parameter_constraints=[]).
[INFO 07-18 23:48:31] ax.modelbridge.dispatch_utils: Using Models.SAASBO since there are more ordered parameters than there are categories for the unordered categorical parameters.
[INFO 07-18 23:48:31] ax.modelbridge.dispatch_utils: Calculating the number of remaining initialization trials based on num_initialization_trials=3 max_initialization_trials=None num_tunable_parameters=100 num_trials=None use_batch_trials=False
[INFO 07-18 23:48:31] ax.modelbridge.dispatch_utils: num_completed_initialization_trials=0 num_remaining_initialization_trials=3
[INFO 07-18 23:48:31] ax.modelbridge.dispatch_utils: `verbose`, `disable_progbar`, and `jit_compile` are not yet supported when using `choose_generation_strategy` with ModularBoTorchModel, dropping these arguments.
[INFO 07-18 23:48:31] ax.modelbridge.dispatch_utils: Using Bayesian Optimization generation strategy: GenerationStrategy(name='Sobol+SAASBO', steps=[Sobol for 3 trials, SAASBO for subsequent trials]). Iterations after 3 will take longer to generate due to model-fitting.
[INFO 07-18 23:48:31] Scheduler: `Scheduler` requires experiment to have immutable search space and optimization config. Setting property immutable_search_space_and_opt_config to `True` on experiment.
[INFO 2024-07-18 23:48:31,668 MainProcess MainThread {controller.py:165}] boa:
##############################################
BOA Experiment Run
Output Experiment Dir: [/path/to/your/dir/]/r_saasbo_branin_100d_20240718T234831
Scheduler File Path: [/path/to/your/dir/]/r_saasbo_branin_100d_20240718T234831/scheduler.json
Optimization CSV File Path: [/path/to/your/dir/]/r_saasbo_branin_100d_20240718T234831/optimization.csv
Start Time: 20240718T234831
Version: 0.10.3
##############################################
[INFO 07-18 23:48:31] Scheduler: Running trials [0]...
[INFO 2024-07-18 23:48:31,694 MainProcess ThreadPoolExecutor-0_0 {script_wrapper.py:322}] boa: Rscript run_model.R
[INFO 2024-07-18 23:48:31,695 MainProcess ThreadPoolExecutor-0_0 {script_wrapper.py:328}] boa: {'config_path': PosixPath('[/path/to/your/dir/]/config.yaml'), 'config_dir': PosixPath('[/path/to/your/dir/]'), 'config_dir_name': 'r_saasbo_branin', 'config_file_name': 'config.yaml', 'x0': -0.1582975685596466, 'x1': 3.729560375213623, 'x2': -3.414965569972992, 'x3': 0.21300062537193298, 'x4': 5.338813364505768, 'x5': 7.36478865146637, 'x6': -4.295058641582727, 'x7': -0.1385234296321869, 'x8': 1.9358094036579132, 'x9': -4.896667953580618, 'x10': 3.5994642972946167, 'x11': 1.518811285495758, 'x12': 8.018567264080048, 'x13': 6.403949856758118, 'x14': 9.669951498508453, 'x15': 3.5854023694992065, 'x16': 9.29769217967987, 'x17': 2.6980873942375183, 'x18': -1.7083461582660675, 'x19': 5.085349977016449, 'x20': -2.7764415740966797, 'x21': -0.2713946998119354, 'x22': 4.0841591358184814, 'x23': -3.9764535054564476, 'x24': 2.065296620130539, 'x25': 8.502242863178253, 'x26': -2.953765317797661, 'x27': -3.4764953330159187, 'x28': -4.348457455635071, 'x29': -1.656952127814293, 'x30': 2.0922206342220306, 'x31': 3.197212517261505, 'x32': 4.687887728214264, 'x33': -2.2648414969444275, 'x34': 2.561238408088684, 'x35': -0.7021431624889374, 'x36': 0.552486926317215, 'x37': -4.912463719956577, 'x38': 4.135856926441193, 'x39': -1.0704582929611206, 'x40': 4.240974485874176, 'x41': -2.2668129205703735, 'x42': -1.29993736743927, 'x43': 3.308967649936676, 'x44': -1.1103060841560364, 'x45': 0.10482713580131531, 'x46': 5.810668468475342, 'x47': 0.4599243402481079, 'x48': 3.4693199396133423, 'x49': 8.2789945602417, 'x50': 12.216804921627045, 'x51': 2.7824892103672028, 'x52': 8.33572268486023, 'x53': 0.696495920419693, 'x54': 6.773296594619751, 'x55': 7.647491991519928, 'x56': 6.394399255514145, 'x57': 14.166449904441833, 'x58': 14.601401388645172, 'x59': 8.361400365829468, 'x60': 5.020390748977661, 'x61': 5.009451359510422, 'x62': 14.02144968509674, 'x63': 5.028500407934189, 'x64': 9.654297530651093, 'x65': 5.671032518148422, 'x66': 7.926227152347565, 'x67': 8.097012341022491, 'x68': 13.983467817306519, 'x69': 8.12892347574234, 'x70': 12.299193441867828, 'x71': 5.995098352432251, 'x72': 4.606310427188873, 'x73': 14.457942545413971, 'x74': 0.6432963162660599, 'x75': 8.367844820022583, 'x76': 13.875965774059296, 'x77': 1.708005890250206, 'x78': 3.4527162462472916, 'x79': 13.711108267307281, 'x80': 6.64706289768219, 'x81': 7.164750695228577, 'x82': 7.571473717689514, 'x83': 5.048086792230606, 'x84': 10.17394244670868, 'x85': 12.246861755847931, 'x86': 1.3405613601207733, 'x87': 5.13926088809967, 'x88': 7.573672235012054, 'x89': 13.906863033771515, 'x90': 9.848637878894806, 'x91': 7.4446602165699005, 'x92': 6.565088331699371, 'x93': 0.2932817302644253, 'x94': 1.5123854577541351, 'x95': 14.7762331366539, 'x96': 0.21663220133632421, 'x97': 0.22453629411756992, 'x98': 0.6310250982642174, 'x99': 11.517374217510223, 'trial_dir': PosixPath('[/path/to/your/dir/]/r_saasbo_branin_100d_20240718T234831/000000')}
[INFO 2024-07-18 23:48:31,696 MainProcess ThreadPoolExecutor-0_0 {script_wrapper.py:330}] boa: Rscript run_model.R
[INFO 07-18 23:48:32] Scheduler: Running trials [1]...
[INFO 2024-07-18 23:48:32,726 MainProcess ThreadPoolExecutor-1_0 {script_wrapper.py:322}] boa: Rscript run_model.R
[INFO 2024-07-18 23:48:32,727 MainProcess ThreadPoolExecutor-1_0 {script_wrapper.py:328}] boa: {'config_path': PosixPath('[/path/to/your/dir/]/config.yaml'), 'config_dir': PosixPath('[/path/to/your/dir/]'), 'config_dir_name': 'r_saasbo_branin', 'config_file_name': 'config.yaml', 'x0': 0.0013709673658013344, 'x1': 4.025402260012925, 'x2': -2.0057513657957315, 'x3': 6.763230566866696, 'x4': 3.7086489237844944, 'x5': -1.5674693742766976, 'x6': 3.3856845973059535, 'x7': -3.588835159316659, 'x8': 4.92601917590946, 'x9': -0.12317859567701817, 'x10': 8.437186805531383, 'x11': -3.9894871274009347, 'x12': 3.4656590735539794, 'x13': -1.3685155706480145, 'x14': 7.038852912373841, 'x15': 7.72188438102603, 'x16': 8.348297881893814, 'x17': 1.3285111263394356, 'x18': -3.4878903906792402, 'x19': 4.645919105969369, 'x20': 0.7934429496526718, 'x21': 2.664451152086258, 'x22': -1.7369144363328815, 'x23': 7.055760286748409, 'x24': 1.421809601597488, 'x25': 5.467205666936934, 'x26': -3.2536858646199107, 'x27': 0.49460276030004025, 'x28': 4.964141719974577, 'x29': -1.6273576952517033, 'x30': -2.779767457395792, 'x31': 1.4045398076996207, 'x32': -3.7650933116674423, 'x33': 8.025179887190461, 'x34': -4.9429716961458325, 'x35': 7.150556370615959, 'x36': -0.18571281805634499, 'x37': 9.992842427454889, 'x38': -0.524640423245728, 'x39': -2.135992576368153, 'x40': 8.148153275251389, 'x41': -4.470169045962393, 'x42': 8.282522894442081, 'x43': 4.224128481000662, 'x44': 2.650315728969872, 'x45': -3.7685218174010515, 'x46': -2.115698605775833, 'x47': -4.129230845719576, 'x48': 8.143373397178948, 'x49': -1.036081607453525, 'x50': 5.463060890324414, 'x51': 1.0415678238496184, 'x52': 9.904762557707727, 'x53': 14.414948257617652, 'x54': 14.580983966588974, 'x55': 11.497228438965976, 'x56': 6.090454123914242, 'x57': 2.865069033578038, 'x58': 12.726922826841474, 'x59': 5.003805169835687, 'x60': 14.131617243401706, 'x61': 8.81135365460068, 'x62': 4.649255177937448, 'x63': 11.90371201839298, 'x64': 8.274613092653453, 'x65': 11.93350475281477, 'x66': 11.795892035588622, 'x67': 3.01778806373477, 'x68': 2.9097855230793357, 'x69': 7.438162425532937, 'x70': 13.539500604383647, 'x71': 8.050219207070768, 'x72': 3.7115170201286674, 'x73': 4.031325001269579, 'x74': 5.593647714704275, 'x75': 10.377845135517418, 'x76': 3.6927356896921992, 'x77': 11.205246755853295, 'x78': 11.098874201998115, 'x79': 4.837092678062618, 'x80': 7.542309821583331, 'x81': 5.459164883941412, 'x82': 12.970359683968127, 'x83': 9.53623419161886, 'x84': 1.7269976623356342, 'x85': 6.299108834937215, 'x86': 3.316115685738623, 'x87': 5.220188652165234, 'x88': 14.424867471680045, 'x89': 14.839189136400819, 'x90': 14.198811049573123, 'x91': 10.255916705355048, 'x92': 7.453372115269303, 'x93': 10.781724080443382, 'x94': 9.710197965614498, 'x95': 0.6666842568665743, 'x96': 5.482775461860001, 'x97': 7.868831874802709, 'x98': 11.257694978266954, 'x99': 9.027767269872129, 'trial_dir': PosixPath('[/path/to/your/dir/]/r_saasbo_branin_100d_20240718T234831/000001')}
[INFO 2024-07-18 23:48:32,728 MainProcess ThreadPoolExecutor-1_0 {script_wrapper.py:330}] boa: Rscript run_model.R
[INFO 07-18 23:48:33] Scheduler: Running trials [2]...
[INFO 2024-07-18 23:48:33,758 MainProcess ThreadPoolExecutor-2_0 {script_wrapper.py:322}] boa: Rscript run_model.R
[INFO 2024-07-18 23:48:33,759 MainProcess ThreadPoolExecutor-2_0 {script_wrapper.py:328}] boa: {'config_path': PosixPath('[/path/to/your/dir/]/config.yaml'), 'config_dir': PosixPath('[/path/to/your/dir/]'), 'config_dir_name': 'r_saasbo_branin', 'config_file_name': 'config.yaml', 'x0': 8.505831491202116, 'x1': -1.472708466462791, 'x2': 8.552163145504892, 'x3': -2.900869124568999, 'x4': 3.1943586887791753, 'x5': 8.49742244463414, 'x6': 1.4958194876089692, 'x7': 9.601591909304261, 'x8': 1.200458137318492, 'x9': 1.233585262671113, 'x10': 1.4594502979889512, 'x11': 0.9236688073724508, 'x12': -0.22833886090666056, 'x13': -4.821088248863816, 'x14': 6.2005772814154625, 'x15': 9.033787637017667, 'x16': 5.532071217894554, 'x17': 2.830038722604513, 'x18': -0.2805914217606187, 'x19': 1.9823273038491607, 'x20': 0.2723260596394539, 'x21': 8.04309293627739, 'x22': -4.455521404743195, 'x23': -2.2663956973701715, 'x24': 9.428249527700245, 'x25': 0.9506236389279366, 'x26': 8.308748444542289, 'x27': -4.913830598816276, 'x28': -1.8323410069569945, 'x29': 9.542487966828048, 'x30': -1.051966710947454, 'x31': 8.750596921890974, 'x32': 6.2431475427001715, 'x33': 1.4790545217692852, 'x34': -3.753865151666105, 'x35': -0.03249014727771282, 'x36': -3.5173190012574196, 'x37': 3.3535522362217307, 'x38': 0.38332543801516294, 'x39': 3.771489937789738, 'x40': 7.413369952701032, 'x41': 7.337827575393021, 'x42': 9.514041994698346, 'x43': 1.136389384046197, 'x44': 8.966490747407079, 'x45': 2.722466508857906, 'x46': 8.706830395385623, 'x47': -0.07950009312480688, 'x48': 6.219396833330393, 'x49': 2.3461682721972466, 'x50': 3.1849186727777123, 'x51': 5.499918940477073, 'x52': 2.612917944788933, 'x53': 6.118427510373294, 'x54': 3.46520341001451, 'x55': 5.1379224099218845, 'x56': 3.1218425603583455, 'x57': 4.407738586887717, 'x58': 11.212275791913271, 'x59': 8.597017521969974, 'x60': 8.965566591359675, 'x61': 1.6567580681294203, 'x62': 1.2529311189427972, 'x63': 14.002808290533721, 'x64': 4.151200172491372, 'x65': 0.5056715570390224, 'x66': 10.253939456306398, 'x67': 4.942572852596641, 'x68': 8.694065934978426, 'x69': 4.278972186148167, 'x70': 9.590177424252033, 'x71': 1.131921736523509, 'x72': 7.359222611412406, 'x73': 10.881498092785478, 'x74': 12.921546567231417, 'x75': 13.448445391841233, 'x76': 8.093105242587626, 'x77': 14.814989394508302, 'x78': 1.4222917193546891, 'x79': 10.06089823320508, 'x80': 5.623478852212429, 'x81': 1.8480165721848607, 'x82': 10.284442068077624, 'x83': 11.998585578985512, 'x84': 5.157659207470715, 'x85': 12.226758417673409, 'x86': 3.241740851663053, 'x87': 7.14035103097558, 'x88': 7.581582446582615, 'x89': 14.035712066106498, 'x90': 12.237952910363674, 'x91': 7.723182407207787, 'x92': 1.5504003781825304, 'x93': 10.084642209112644, 'x94': 3.3104411652311683, 'x95': 10.845616408623755, 'x96': 14.697162718512118, 'x97': 7.99850226379931, 'x98': 4.843366700224578, 'x99': 4.835734935477376, 'trial_dir': PosixPath('[/path/to/your/dir/]/r_saasbo_branin_100d_20240718T234831/000002')}
[INFO 2024-07-18 23:48:33,760 MainProcess ThreadPoolExecutor-2_0 {script_wrapper.py:330}] boa: Rscript run_model.R
[INFO 07-18 23:48:34] Scheduler: Generated all trials that can be generated currently. Model requires more data to generate more trials.
[INFO 07-18 23:48:34] Scheduler: Retrieved COMPLETED trials: 0 - 2.
[INFO 07-18 23:48:34] Scheduler: Fetching data for trials: 0 - 2.
[WARNING 07-18 23:48:34] ax.service.utils.report_utils: Column reason missing for all trials. Not appending column.
[INFO 2024-07-18 23:48:34,817 MainProcess MainThread {storage.py:303}] boa: Saved optimization parametrization and objective to `[/path/to/your/dir/]/r_saasbo_branin_100d_20240718T234831/optimization.csv`.
[INFO 2024-07-18 23:48:34,844 MainProcess MainThread {storage.py:63}] boa: Saved JSON-serialized state of optimization to `[/path/to/your/dir/]/r_saasbo_branin_100d_20240718T234831/scheduler.json`.
Boa version: 0.10.3
[INFO 2024-07-18 23:48:34,857 MainProcess MainThread {scheduler.py:86}] boa: Trials so far: 3
Currently running trials: []
Will Produce next trials from generation step: Sobol
Best trial so far: {2: {'branin': 4.428764616476069}}
[INFO 07-18 23:51:38] Scheduler: Running trials [3]...
[INFO 2024-07-18 23:51:38,591 MainProcess ThreadPoolExecutor-3_0 {script_wrapper.py:322}] boa: Rscript run_model.R
[INFO 2024-07-18 23:51:38,592 MainProcess ThreadPoolExecutor-3_0 {script_wrapper.py:328}] boa: {'config_path': PosixPath('[/path/to/your/dir/]/config.yaml'), 'config_dir': PosixPath('[/path/to/your/dir/]'), 'config_dir_name': 'r_saasbo_branin', 'config_file_name': 'config.yaml', 'x0': 10.0, 'x1': -5.0, 'x2': 10.0, 'x3': 10.0, 'x4': 2.0577347172523703, 'x5': -5.0, 'x6': 10.0, 'x7': 10.0, 'x8': 10.0, 'x9': 10.0, 'x10': 10.0, 'x11': -5.0, 'x12': -5.0, 'x13': -5.0, 'x14': 4.694639472976531, 'x15': 10.0, 'x16': -5.0, 'x17': -5.0, 'x18': 10.0, 'x19': 2.342101503236126, 'x20': 10.0, 'x21': 10.0, 'x22': -5.0, 'x23': 4.079583282563238, 'x24': 10.0, 'x25': 1.6933881456409976, 'x26': 10.0, 'x27': 1.507282083388847, 'x28': 10.0, 'x29': 8.078802459990037, 'x30': -5.0, 'x31': 6.39630097523721, 'x32': -1.8015109640376972, 'x33': 10.0, 'x34': -5.0, 'x35': 10.0, 'x36': 10.0, 'x37': 10.0, 'x38': 7.674962410449806, 'x39': 3.73094675452114, 'x40': 10.0, 'x41': 5.753821348180308, 'x42': 10.0, 'x43': -5.0, 'x44': 10.0, 'x45': -0.4255902273920782, 'x46': -2.6476084004133664, 'x47': -5.0, 'x48': 10.0, 'x49': -5.0, 'x50': 0.0, 'x51': 5.648931564853835, 'x52': 0.0, 'x53': 15.0, 'x54': 15.0, 'x55': 15.0, 'x56': 15.0, 'x57': 0.0, 'x58': 1.0293286239155859, 'x59': 15.0, 'x60': 11.278814006900893, 'x61': 0.0, 'x62': 0.0, 'x63': 15.0, 'x64': 4.48908499669635, 'x65': 4.732390684008496, 'x66': 14.548270651654214, 'x67': 0.0, 'x68': 0.0, 'x69': 0.0, 'x70': 0.0, 'x71': 0.0, 'x72': 8.277573357823977, 'x73': 0.0, 'x74': 15.0, 'x75': 15.0, 'x76': 0.0, 'x77': 11.245075409902535, 'x78': 15.0, 'x79': 0.0, 'x80': 6.975706757140214, 'x81': 0.0, 'x82': 15.0, 'x83': 15.0, 'x84': 0.0, 'x85': 7.864987232763923, 'x86': 3.5087337713698186, 'x87': 15.0, 'x88': 15.0, 'x89': 15.0, 'x90': 15.0, 'x91': 15.0, 'x92': 5.56239621294415, 'x93': 15.0, 'x94': 15.0, 'x95': 0.0, 'x96': 14.329240556826536, 'x97': 15.0, 'x98': 15.0, 'x99': 2.6986658409305173, 'trial_dir': PosixPath('[/path/to/your/dir/]/r_saasbo_branin_100d_20240718T234831/000003')}
[INFO 2024-07-18 23:51:38,594 MainProcess ThreadPoolExecutor-3_0 {script_wrapper.py:330}] boa: Rscript run_model.R
/home/docs/checkouts/readthedocs.org/user_builds/boa-paper/conda/latest/lib/python3.10/site-packages/ax/core/data.py:284: FutureWarning: The behavior of DataFrame concatenation with empty or all-NA entries is deprecated. In a future version, this will no longer exclude empty or all-NA columns when determining the result dtypes. To retain the old behavior, exclude the relevant entries before the concat operation.
return cls(df=pd.concat(dfs, axis=0, sort=True))
[INFO 07-18 23:51:39] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 07-18 23:52:18] Scheduler: Running trials [4]...
[INFO 2024-07-18 23:52:18,160 MainProcess ThreadPoolExecutor-4_0 {script_wrapper.py:322}] boa: Rscript run_model.R
[INFO 2024-07-18 23:52:18,161 MainProcess ThreadPoolExecutor-4_0 {script_wrapper.py:328}] boa: {'config_path': PosixPath('[/path/to/your/dir/]/config.yaml'), 'config_dir': PosixPath('[/path/to/your/dir/]'), 'config_dir_name': 'r_saasbo_branin', 'config_file_name': 'config.yaml', 'x0': 10.0, 'x1': 10.0, 'x2': -5.0, 'x3': 10.0, 'x4': -0.9196956390297322, 'x5': -5.0, 'x6': -5.0, 'x7': 10.0, 'x8': -5.0, 'x9': 10.0, 'x10': -5.0, 'x11': 10.0, 'x12': -5.0, 'x13': -5.0, 'x14': -5.0, 'x15': 10.0, 'x16': -5.0, 'x17': 10.0, 'x18': -5.0, 'x19': -0.7055402979363832, 'x20': 10.0, 'x21': 10.0, 'x22': -5.0, 'x23': 2.8065404823300026, 'x24': -5.0, 'x25': -5.0, 'x26': -5.0, 'x27': 10.0, 'x28': 10.0, 'x29': 10.0, 'x30': 10.0, 'x31': -5.0, 'x32': 3.305992864761045, 'x33': -5.0, 'x34': -5.0, 'x35': -5.0, 'x36': -5.0, 'x37': 10.0, 'x38': -5.0, 'x39': 10.0, 'x40': -5.0, 'x41': 10.0, 'x42': 10.0, 'x43': 10.0, 'x44': 10.0, 'x45': 2.0857514836982816, 'x46': 10.0, 'x47': 10.0, 'x48': 10.0, 'x49': 10.0, 'x50': 0.0, 'x51': 0.0, 'x52': 15.0, 'x53': 15.0, 'x54': 0.0, 'x55': 0.0, 'x56': 0.0, 'x57': 0.0, 'x58': 0.0, 'x59': 15.0, 'x60': 15.0, 'x61': 15.0, 'x62': 0.0, 'x63': 15.0, 'x64': 0.0, 'x65': 0.0, 'x66': 15.0, 'x67': 0.0, 'x68': 15.0, 'x69': 15.0, 'x70': 0.0, 'x71': 15.0, 'x72': 15.0, 'x73': 0.0, 'x74': 15.0, 'x75': 15.0, 'x76': 0.0, 'x77': 15.0, 'x78': 15.0, 'x79': 0.0, 'x80': 0.0, 'x81': 0.0, 'x82': 15.0, 'x83': 15.0, 'x84': 15.0, 'x85': 12.669597439272051, 'x86': 3.5871288394558554, 'x87': 15.0, 'x88': 15.0, 'x89': 0.0, 'x90': 0.0, 'x91': 0.0, 'x92': 0.0, 'x93': 15.0, 'x94': 15.0, 'x95': 0.0, 'x96': 15.0, 'x97': 15.0, 'x98': 15.0, 'x99': 0.0, 'trial_dir': PosixPath('[/path/to/your/dir/]/r_saasbo_branin_100d_20240718T234831/000004')}
[INFO 2024-07-18 23:52:18,163 MainProcess ThreadPoolExecutor-4_0 {script_wrapper.py:330}] boa: Rscript run_model.R
/home/docs/checkouts/readthedocs.org/user_builds/boa-paper/conda/latest/lib/python3.10/site-packages/ax/core/data.py:284: FutureWarning: The behavior of DataFrame concatenation with empty or all-NA entries is deprecated. In a future version, this will no longer exclude empty or all-NA columns when determining the result dtypes. To retain the old behavior, exclude the relevant entries before the concat operation.
return cls(df=pd.concat(dfs, axis=0, sort=True))
[INFO 07-18 23:52:19] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 07-18 23:53:09] Scheduler: Running trials [5]...
[INFO 2024-07-18 23:53:09,562 MainProcess ThreadPoolExecutor-5_0 {script_wrapper.py:322}] boa: Rscript run_model.R
[INFO 2024-07-18 23:53:09,563 MainProcess ThreadPoolExecutor-5_0 {script_wrapper.py:328}] boa: {'config_path': PosixPath('[/path/to/your/dir/]/config.yaml'), 'config_dir': PosixPath('[/path/to/your/dir/]'), 'config_dir_name': 'r_saasbo_branin', 'config_file_name': 'config.yaml', 'x0': 10.0, 'x1': -5.0, 'x2': 10.0, 'x3': -5.0, 'x4': 1.8192369942857303, 'x5': -5.0, 'x6': 10.0, 'x7': -5.0, 'x8': -5.0, 'x9': 10.0, 'x10': 10.0, 'x11': 10.0, 'x12': 10.0, 'x13': -5.0, 'x14': -5.0, 'x15': 10.0, 'x16': -5.0, 'x17': 10.0, 'x18': 10.0, 'x19': 4.057661701841653, 'x20': -5.0, 'x21': -5.0, 'x22': -5.0, 'x23': 10.0, 'x24': 10.0, 'x25': -5.0, 'x26': 10.0, 'x27': -5.0, 'x28': 10.0, 'x29': -5.0, 'x30': -5.0, 'x31': 10.0, 'x32': 3.3096629717458423, 'x33': 10.0, 'x34': -5.0, 'x35': 10.0, 'x36': -5.0, 'x37': 5.4378386047511, 'x38': -5.0, 'x39': -5.0, 'x40': 10.0, 'x41': -5.0, 'x42': 10.0, 'x43': -5.0, 'x44': 10.0, 'x45': -3.059294976072776, 'x46': 8.912862237855824, 'x47': 10.0, 'x48': 10.0, 'x49': -5.0, 'x50': 15.0, 'x51': 15.0, 'x52': 0.0, 'x53': 15.0, 'x54': 15.0, 'x55': 0.0, 'x56': 0.0, 'x57': 0.0, 'x58': 15.0, 'x59': 0.0, 'x60': 15.0, 'x61': 15.0, 'x62': 0.0, 'x63': 15.0, 'x64': 6.911094417078451, 'x65': 13.977572323311065, 'x66': 0.0, 'x67': 15.0, 'x68': 0.0, 'x69': 15.0, 'x70': 0.0, 'x71': 15.0, 'x72': 15.0, 'x73': 0.0, 'x74': 0.0, 'x75': 0.0, 'x76': 0.0, 'x77': 14.880622145274478, 'x78': 15.0, 'x79': 0.0, 'x80': 15.0, 'x81': 15.0, 'x82': 0.0, 'x83': 0.0, 'x84': 0.0, 'x85': 0.0, 'x86': 3.9555410459969895, 'x87': 0.0, 'x88': 0.0, 'x89': 15.0, 'x90': 15.0, 'x91': 15.0, 'x92': 0.0, 'x93': 15.0, 'x94': 0.0, 'x95': 0.0, 'x96': 15.0, 'x97': 15.0, 'x98': 0.0, 'x99': 15.0, 'trial_dir': PosixPath('[/path/to/your/dir/]/r_saasbo_branin_100d_20240718T234831/000005')}
[INFO 2024-07-18 23:53:09,565 MainProcess ThreadPoolExecutor-5_0 {script_wrapper.py:330}] boa: Rscript run_model.R
/home/docs/checkouts/readthedocs.org/user_builds/boa-paper/conda/latest/lib/python3.10/site-packages/ax/core/data.py:284: FutureWarning: The behavior of DataFrame concatenation with empty or all-NA entries is deprecated. In a future version, this will no longer exclude empty or all-NA columns when determining the result dtypes. To retain the old behavior, exclude the relevant entries before the concat operation.
return cls(df=pd.concat(dfs, axis=0, sort=True))
[INFO 07-18 23:53:09] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 07-18 23:53:09] Scheduler: Generated all trials that can be generated currently. Max parallelism currently reached.
[INFO 07-18 23:53:09] Scheduler: Retrieved COMPLETED trials: 3 - 4.
[INFO 07-18 23:53:09] Scheduler: Fetching data for trials: 3 - 4.
/home/docs/checkouts/readthedocs.org/user_builds/boa-paper/conda/latest/lib/python3.10/site-packages/ax/core/data.py:284: FutureWarning: The behavior of DataFrame concatenation with empty or all-NA entries is deprecated. In a future version, this will no longer exclude empty or all-NA columns when determining the result dtypes. To retain the old behavior, exclude the relevant entries before the concat operation.
return cls(df=pd.concat(dfs, axis=0, sort=True))
[WARNING 07-18 23:53:09] ax.service.utils.report_utils: Column reason missing for all trials. Not appending column.
[INFO 2024-07-18 23:53:09,669 MainProcess MainThread {storage.py:303}] boa: Saved optimization parametrization and objective to `[/path/to/your/dir/]/r_saasbo_branin_100d_20240718T234831/optimization.csv`.
[INFO 2024-07-18 23:53:09,735 MainProcess MainThread {storage.py:63}] boa: Saved JSON-serialized state of optimization to `[/path/to/your/dir/]/r_saasbo_branin_100d_20240718T234831/scheduler.json`.
Boa version: 0.10.3
/home/docs/checkouts/readthedocs.org/user_builds/boa-paper/conda/latest/lib/python3.10/site-packages/ax/core/data.py:284: FutureWarning: The behavior of DataFrame concatenation with empty or all-NA entries is deprecated. In a future version, this will no longer exclude empty or all-NA columns when determining the result dtypes. To retain the old behavior, exclude the relevant entries before the concat operation.
return cls(df=pd.concat(dfs, axis=0, sort=True))
/home/docs/checkouts/readthedocs.org/user_builds/boa-paper/conda/latest/lib/python3.10/site-packages/ax/core/data.py:284: FutureWarning: The behavior of DataFrame concatenation with empty or all-NA entries is deprecated. In a future version, this will no longer exclude empty or all-NA columns when determining the result dtypes. To retain the old behavior, exclude the relevant entries before the concat operation.
return cls(df=pd.concat(dfs, axis=0, sort=True))
[INFO 2024-07-18 23:53:09,761 MainProcess MainThread {scheduler.py:86}] boa: Trials so far: 6
Currently running trials: 5
Will Produce next trials from generation step: SAASBO
Best trial so far: {2: {'branin': 4.428764616476069}}
/home/docs/checkouts/readthedocs.org/user_builds/boa-paper/conda/latest/lib/python3.10/site-packages/ax/core/data.py:284: FutureWarning: The behavior of DataFrame concatenation with empty or all-NA entries is deprecated. In a future version, this will no longer exclude empty or all-NA columns when determining the result dtypes. To retain the old behavior, exclude the relevant entries before the concat operation.
return cls(df=pd.concat(dfs, axis=0, sort=True))
[INFO 07-18 23:56:42] Scheduler: Running trials [6]...
[INFO 2024-07-18 23:56:42,896 MainProcess ThreadPoolExecutor-6_0 {script_wrapper.py:322}] boa: Rscript run_model.R
[INFO 2024-07-18 23:56:42,897 MainProcess ThreadPoolExecutor-6_0 {script_wrapper.py:328}] boa: {'config_path': PosixPath('[/path/to/your/dir/]/config.yaml'), 'config_dir': PosixPath('[/path/to/your/dir/]'), 'config_dir_name': 'r_saasbo_branin', 'config_file_name': 'config.yaml', 'x0': 8.283152721816052, 'x1': -0.4901948470731341, 'x2': 9.91302472039333, 'x3': -2.47982038225267, 'x4': 2.9917859051836935, 'x5': 8.287041162688785, 'x6': 2.6681383537591694, 'x7': 8.508550852880655, 'x8': 1.7058864719016054, 'x9': 0.7510789520261829, 'x10': 1.6763983130094324, 'x11': -1.0625806494860144, 'x12': 0.10416997330441191, 'x13': -5.0, 'x14': 7.135020871302949, 'x15': 9.692889457687476, 'x16': 5.982401278592549, 'x17': 2.0431444109073116, 'x18': -5.0, 'x19': 1.8886444785248884, 'x20': 0.7727457295790998, 'x21': 8.60254503192008, 'x22': -5.0, 'x23': -1.8590936357675454, 'x24': 8.413730319798407, 'x25': 1.8379884339040613, 'x26': 6.013969822526413, 'x27': 10.0, 'x28': -2.181610126854624, 'x29': 10.0, 'x30': -3.1440397222511245, 'x31': 10.0, 'x32': 6.095602865893502, 'x33': 2.0482028942911104, 'x34': -5.0, 'x35': -0.37568457051741255, 'x36': -3.606948885671321, 'x37': 9.018424641446234, 'x38': -0.21303508394980408, 'x39': 2.9553411881348532, 'x40': 10.0, 'x41': 8.416200637608595, 'x42': 10.0, 'x43': 3.4281204200570077, 'x44': 10.0, 'x45': 2.4484392256708407, 'x46': 8.290772853710564, 'x47': -5.0, 'x48': 8.16359021688973, 'x49': -5.0, 'x50': 2.6105341389850096, 'x51': 5.086641611126444, 'x52': 1.8866787922792392, 'x53': 6.750552845668217, 'x54': 8.425540323803736, 'x55': 7.0656831664067345, 'x56': 3.1543464711981946, 'x57': 3.1966162128981006, 'x58': 12.095387205189429, 'x59': 8.254360891122305, 'x60': 9.634450032456003, 'x61': 2.5241357313035198, 'x62': 0.0, 'x63': 14.267959352970164, 'x64': 4.039378159062441, 'x65': 0.9107488677545545, 'x66': 12.16016811703029, 'x67': 2.650928669361179, 'x68': 7.231697775681858, 'x69': 3.263622914718521, 'x70': 11.452925133464854, 'x71': 2.3811419947924306, 'x72': 6.948864438056694, 'x73': 7.752136169089761, 'x74': 15.0, 'x75': 15.0, 'x76': 2.4138314399923786, 'x77': 15.0, 'x78': 2.4357294379804184, 'x79': 14.320932626220667, 'x80': 6.803827324988731, 'x81': 1.9505063997764671, 'x82': 11.235244229639985, 'x83': 13.766281191829982, 'x84': 0.0, 'x85': 10.198040675694614, 'x86': 3.3291492552388915, 'x87': 6.817500221300061, 'x88': 8.858173886608748, 'x89': 14.936930240444543, 'x90': 13.033650320022346, 'x91': 7.655209933417828, 'x92': 2.576030446105111, 'x93': 11.007255679742078, 'x94': 2.8010451662062295, 'x95': 7.449794760744615, 'x96': 13.363445660268399, 'x97': 8.144055524228131, 'x98': 7.6089781089389055, 'x99': 4.251495276285298, 'trial_dir': PosixPath('[/path/to/your/dir/]/r_saasbo_branin_100d_20240718T234831/000006')}
[INFO 2024-07-18 23:56:42,900 MainProcess ThreadPoolExecutor-6_0 {script_wrapper.py:330}] boa: Rscript run_model.R
/home/docs/checkouts/readthedocs.org/user_builds/boa-paper/conda/latest/lib/python3.10/site-packages/ax/core/data.py:284: FutureWarning: The behavior of DataFrame concatenation with empty or all-NA entries is deprecated. In a future version, this will no longer exclude empty or all-NA columns when determining the result dtypes. To retain the old behavior, exclude the relevant entries before the concat operation.
return cls(df=pd.concat(dfs, axis=0, sort=True))
[INFO 07-18 23:56:43] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 07-18 23:57:13] Scheduler: Running trials [7]...
[INFO 2024-07-18 23:57:13,059 MainProcess ThreadPoolExecutor-7_0 {script_wrapper.py:322}] boa: Rscript run_model.R
[INFO 2024-07-18 23:57:13,061 MainProcess ThreadPoolExecutor-7_0 {script_wrapper.py:328}] boa: {'config_path': PosixPath('[/path/to/your/dir/]/config.yaml'), 'config_dir': PosixPath('[/path/to/your/dir/]'), 'config_dir_name': 'r_saasbo_branin', 'config_file_name': 'config.yaml', 'x0': 8.810985067637963, 'x1': -1.7570886804074872, 'x2': 10.0, 'x3': -3.655797846975952, 'x4': 3.1934583547004305, 'x5': 9.27180305974389, 'x6': 1.745372609077318, 'x7': 10.0, 'x8': 1.4414155081249165, 'x9': 1.2892451431354521, 'x10': 1.5154831241193296, 'x11': 1.2593627004609393, 'x12': -2.507515910585239, 'x13': -5.0, 'x14': 6.961787477264911, 'x15': 9.103159901052733, 'x16': 5.515354810114681, 'x17': 2.729035294280803, 'x18': 9.483654092507068, 'x19': 1.5572663553453667, 'x20': 0.697485390403564, 'x21': 10.0, 'x22': -5.0, 'x23': -2.2402554993021635, 'x24': 10.0, 'x25': 0.3453438189000817, 'x26': 10.0, 'x27': -5.0, 'x28': -1.5460992294208853, 'x29': 6.853196917967576, 'x30': -0.9792313594156505, 'x31': 10.0, 'x32': 6.276035115699122, 'x33': 1.3346766397753722, 'x34': -5.0, 'x35': 3.8268750845614417, 'x36': -3.6920365929405854, 'x37': -0.17212992378414604, 'x38': 0.022910253498715782, 'x39': 4.361344297467861, 'x40': 6.50411185587933, 'x41': 6.316878663184797, 'x42': 10.0, 'x43': -1.6088508768966876, 'x44': 2.7813400275662543, 'x45': 2.949114093223548, 'x46': 4.426276229718006, 'x47': 5.023936899838944, 'x48': 5.922734087843725, 'x49': -5.0, 'x50': 3.0674215671288776, 'x51': 7.130641118944667, 'x52': 0.0, 'x53': 6.001079639163615, 'x54': 0.0, 'x55': 10.694292629843579, 'x56': 3.097592896740718, 'x57': 4.151492329823457, 'x58': 11.054552668409642, 'x59': 8.62048588256798, 'x60': 9.117517635595977, 'x61': 0.720804433419476, 'x62': 0.0, 'x63': 14.201586560106543, 'x64': 3.8077841408371267, 'x65': 0.0, 'x66': 10.585288328057596, 'x67': 5.234945940714541, 'x68': 8.37627379632884, 'x69': 4.181376003900328, 'x70': 9.22609515366449, 'x71': 0.0, 'x72': 7.377725780817308, 'x73': 11.478089453270657, 'x74': 15.0, 'x75': 15.0, 'x76': 9.157601628882777, 'x77': 15.0, 'x78': 0.8509385241521243, 'x79': 0.0, 'x80': 4.080475500200563, 'x81': 1.1498309605382293, 'x82': 10.563207281435044, 'x83': 15.0, 'x84': 9.667830233659162, 'x85': 15.0, 'x86': 3.315759544812618, 'x87': 7.6040031910967425, 'x88': 7.505977919167043, 'x89': 13.89393064875427, 'x90': 12.312987773341032, 'x91': 7.767099009263728, 'x92': 0.6580488640700272, 'x93': 10.531476435412433, 'x94': 2.149828663785617, 'x95': 11.467986909948158, 'x96': 15.0, 'x97': 8.06032361612323, 'x98': 3.744680549766484, 'x99': 4.344556260914589, 'trial_dir': PosixPath('[/path/to/your/dir/]/r_saasbo_branin_100d_20240718T234831/000007')}
[INFO 2024-07-18 23:57:13,063 MainProcess ThreadPoolExecutor-7_0 {script_wrapper.py:330}] boa: Rscript run_model.R
/home/docs/checkouts/readthedocs.org/user_builds/boa-paper/conda/latest/lib/python3.10/site-packages/ax/core/data.py:284: FutureWarning: The behavior of DataFrame concatenation with empty or all-NA entries is deprecated. In a future version, this will no longer exclude empty or all-NA columns when determining the result dtypes. To retain the old behavior, exclude the relevant entries before the concat operation.
return cls(df=pd.concat(dfs, axis=0, sort=True))
[INFO 07-18 23:57:14] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 07-18 23:57:14] Scheduler: Generated all trials that can be generated currently. Max parallelism currently reached.
[INFO 07-18 23:57:14] Scheduler: Retrieved COMPLETED trials: 5 - 7.
[INFO 07-18 23:57:14] Scheduler: Fetching data for trials: 5 - 7.
[WARNING 07-18 23:57:14] ax.service.utils.report_utils: Column reason missing for all trials. Not appending column.
[INFO 2024-07-18 23:57:14,141 MainProcess MainThread {storage.py:303}] boa: Saved optimization parametrization and objective to `[/path/to/your/dir/]/r_saasbo_branin_100d_20240718T234831/optimization.csv`.
[INFO 2024-07-18 23:57:14,187 MainProcess MainThread {storage.py:63}] boa: Saved JSON-serialized state of optimization to `[/path/to/your/dir/]/r_saasbo_branin_100d_20240718T234831/scheduler.json`.
Boa version: 0.10.3
[INFO 2024-07-18 23:57:14,202 MainProcess MainThread {scheduler.py:86}] boa: Trials so far: 8
Currently running trials: []
Will Produce next trials from generation step: SAASBO
Best trial so far: {6: {'branin': 2.5825115363472095}}
[INFO 07-19 00:00:14] Scheduler: Running trials [8]...
[INFO 2024-07-19 00:00:14,416 MainProcess ThreadPoolExecutor-8_0 {script_wrapper.py:322}] boa: Rscript run_model.R
[INFO 2024-07-19 00:00:14,417 MainProcess ThreadPoolExecutor-8_0 {script_wrapper.py:328}] boa: {'config_path': PosixPath('[/path/to/your/dir/]/config.yaml'), 'config_dir': PosixPath('[/path/to/your/dir/]'), 'config_dir_name': 'r_saasbo_branin', 'config_file_name': 'config.yaml', 'x0': 8.44554373029809, 'x1': -2.732943513205541, 'x2': 8.900886974675181, 'x3': -3.7912016524101686, 'x4': 3.0790167918207345, 'x5': 7.333844977419508, 'x6': 5.762035134894083, 'x7': 8.3209333724735, 'x8': 1.6230673764045864, 'x9': 1.170435789091818, 'x10': -2.040677915746364, 'x11': -1.785860484221355, 'x12': 3.342088394241216, 'x13': -5.0, 'x14': 6.427427920053695, 'x15': 10.0, 'x16': 9.490609448970552, 'x17': 1.593456077057688, 'x18': -5.0, 'x19': 2.6289915540412903, 'x20': -1.7017119367495237, 'x21': 8.354411904906268, 'x22': -5.0, 'x23': -0.6101809883599483, 'x24': 10.0, 'x25': 1.3761665361875508, 'x26': 5.092544538493096, 'x27': -1.6792746485403192, 'x28': -2.771103206387728, 'x29': 10.0, 'x30': -3.541431353290731, 'x31': 9.392508303986292, 'x32': 3.585900862426584, 'x33': 4.164490535766488, 'x34': -5.0, 'x35': -5.0, 'x36': -5.0, 'x37': 10.0, 'x38': 0.17669833280089442, 'x39': 0.6552283763853346, 'x40': 10.0, 'x41': 8.307691166365318, 'x42': 10.0, 'x43': 2.615402835145881, 'x44': 10.0, 'x45': 0.3562662484225241, 'x46': 10.0, 'x47': -5.0, 'x48': 6.411613537299896, 'x49': 3.6160329145165857, 'x50': 2.8592560159545397, 'x51': 3.312107937904621, 'x52': 4.810277358398368, 'x53': 12.044615723769164, 'x54': 10.834405976750812, 'x55': 1.0235575329997926, 'x56': 0.0, 'x57': 2.2612448949666666, 'x58': 12.68890312857382, 'x59': 5.60370666652953, 'x60': 10.574657563405388, 'x61': 0.0, 'x62': 0.0, 'x63': 15.0, 'x64': 1.436008352506967, 'x65': 1.8073703373930872, 'x66': 10.673901537086476, 'x67': 3.7236509103041553, 'x68': 5.068223226194817, 'x69': 3.791734814676545, 'x70': 11.377760752102938, 'x71': 2.2621760104751414, 'x72': 5.5833333623150825, 'x73': 9.112369123521853, 'x74': 13.07127084343947, 'x75': 11.70417239691209, 'x76': 3.00885736924819, 'x77': 15.0, 'x78': 1.865817037612774, 'x79': 15.0, 'x80': 9.416559081018688, 'x81': 2.424731924806821, 'x82': 11.595706213672647, 'x83': 11.758265283167354, 'x84': 0.0, 'x85': 8.342526406019008, 'x86': 3.792607684933051, 'x87': 4.324367752316433, 'x88': 8.949893276026051, 'x89': 14.783204714285288, 'x90': 15.0, 'x91': 7.439383690722754, 'x92': 3.074440249396655, 'x93': 12.433163840953316, 'x94': 4.76654787927086, 'x95': 7.054430787564301, 'x96': 15.0, 'x97': 8.492955525444476, 'x98': 8.3622693756455, 'x99': 4.260726355767403, 'trial_dir': PosixPath('[/path/to/your/dir/]/r_saasbo_branin_100d_20240718T234831/000008')}
[INFO 2024-07-19 00:00:14,420 MainProcess ThreadPoolExecutor-8_0 {script_wrapper.py:330}] boa: Rscript run_model.R
[INFO 07-19 00:00:15] Scheduler: Retrieved COMPLETED trials: [8].
[INFO 07-19 00:00:15] Scheduler: Fetching data for trials: [8].
[WARNING 07-19 00:00:15] ax.service.utils.report_utils: Column reason missing for all trials. Not appending column.
[INFO 2024-07-19 00:00:15,458 MainProcess MainThread {storage.py:303}] boa: Saved optimization parametrization and objective to `[/path/to/your/dir/]/r_saasbo_branin_100d_20240718T234831/optimization.csv`.
[INFO 2024-07-19 00:00:15,507 MainProcess MainThread {storage.py:63}] boa: Saved JSON-serialized state of optimization to `[/path/to/your/dir/]/r_saasbo_branin_100d_20240718T234831/scheduler.json`.
Boa version: 0.10.3
[INFO 2024-07-19 00:00:15,522 MainProcess MainThread {scheduler.py:86}] boa: Trials so far: 9
Currently running trials: []
Will Produce next trials from generation step: SAASBO
Best trial so far: {6: {'branin': 2.5825115363472095}}
[WARNING 07-19 00:00:15] ax.service.utils.report_utils: Column reason missing for all trials. Not appending column.
[INFO 2024-07-19 00:00:15,543 MainProcess MainThread {storage.py:303}] boa: Saved optimization parametrization and objective to `[/path/to/your/dir/]/r_saasbo_branin_100d_20240718T234831/optimization.csv`.
[INFO 2024-07-19 00:00:15,592 MainProcess MainThread {storage.py:63}] boa: Saved JSON-serialized state of optimization to `[/path/to/your/dir/]/r_saasbo_branin_100d_20240718T234831/scheduler.json`.
Boa version: 0.10.3
[INFO 2024-07-19 00:00:15,606 MainProcess MainThread {scheduler.py:86}] boa: Trials so far: 9
Currently running trials: []
Will Produce next trials from generation step: SAASBO
Best trial so far: {6: {'branin': 2.5825115363472095}}
[WARNING 07-19 00:00:15] ax.service.utils.report_utils: Column reason missing for all trials. Not appending column.
[INFO 2024-07-19 00:00:15,686 MainProcess MainThread {controller.py:188}] boa:
##############################################
Trials Completed!
BOA Experiment Run
Output Experiment Dir: [/path/to/your/dir/]/r_saasbo_branin_100d_20240718T234831
Scheduler File Path: [/path/to/your/dir/]/r_saasbo_branin_100d_20240718T234831/scheduler.json
Optimization CSV File Path: [/path/to/your/dir/]/r_saasbo_branin_100d_20240718T234831/optimization.csv
Start Time: 20240718T234831
Version: 0.10.3
End Time: 20240719T000015
Total Run Time: 703.939525604248
trial_index arm_name trial_status ... x97 x98 x99
0 0 0_0 COMPLETED ... 0.224536 0.631025 11.517374
1 1 1_0 COMPLETED ... 7.868832 11.257695 9.027767
2 2 2_0 COMPLETED ... 7.998502 4.843367 4.835735
3 3 3_0 COMPLETED ... 15.000000 15.000000 2.698666
4 4 4_0 COMPLETED ... 15.000000 15.000000 0.000000
5 5 5_0 COMPLETED ... 15.000000 0.000000 15.000000
6 6 6_0 COMPLETED ... 8.144056 7.608978 4.251495
7 7 7_0 COMPLETED ... 8.060324 3.744681 4.344556
8 8 8_0 COMPLETED ... 8.492956 8.362269 4.260726
[9 rows x 105 columns]
##############################################