R Hartmann6 with Global Stopping Strategy¶
This notebook is an example of a single objective R model optimization using a Hartmann6 function a global stopping strategy. The Hartmann6 function is a synthetic function that is often used as a stand in for a model that is expensive to evaluate. The function has 6 dimensions and is defined on the unit hypercube.
See the folder r_hartmann for the R script and the configuration file.
1# This notebook uses hidden cells to import and display things so
2# that it can be ran regullary to make sure the documentation
3# is up to date and not broken (as opposed to a markdown file
4# that would have an exmaple written once and get out of date
5# as the code base changes)
6
7# These hidden cells are only responsible for rerunning
8# the documentation to ensure it is correct.
9# the actual relavent part of the documentation
10# are the non hidden parts
Configuration File¶
config_constraints.yaml
# This is jinja2 templating, which is a way to dynamically generate text files supported by BOA
{% set n_trials = 10 %}
objective:
# This is the metric(s) we are trying to optimize
# This exact number will be used in our run_model.R script later
metrics:
- name: Hartmann6
parameters:
# Parameters can be 3 types: range, fixed, or choice
# with fixed being inferred if it is a single value (i.e. x1: 3)
# Parameters can be of type int, float, str, or bool
# and are inferred if not specified
{% for i in range(6) %}
x{{ i }}:
type: range
bounds: [0, 1]
value_type: float
{% endfor %}
n_trials: {{ n_trials }}
scheduler:
# Optional, this stops the optimization early if we converge to the specified condition
global_stopping_strategy:
type: improvement
min_trials: {{ n_trials // 4 }}
window_size: {{ n_trials // 4 }}
# (Default) 10% improvement as a fraction of the
# interquartile range (IQR) of the objective values seen so far.
improvement_bar: 0.1
script_options:
# This tells BOA what script from any language to run to evaluate the model
run_model: Rscript run_model.R
# This tells BOA what to name the experiment, which then is used for the output directory
exp_name: {{ config_dir_name }}_{{ n_trials }}_trials_w_stopping_strategy
Run Model Wrapper Script¶
run_model.R
# load in any libraries and modules we need
library(jsonlite)
source("./hartmann6.R")
trial_dir <- commandArgs(trailingOnly=TRUE)[1]
data <- read_json(path=file.path(trial_dir, "parameters.json"))
X <- c(data$x1, data$x2, data$x3, data$x4, data$x5, data$x6)
res <- hartmann6(X)
write(toJSON(list(Hartmann6=res)), file.path(trial_dir, "output.json"))
We also use a function called hartman6 which is a 6 dimensional version of the synthetic hartman function as the stand in for our model function. The code is below. You would substitute this for any call your model, be it local call to your own R model, a system call to a fortran model wrapped in your R script, or perhaps a some code that launches an HPC job and collects the results.
hartmann6.R
1Code(hartmann6_script)
hartmann6 <- function(X) {
out <- tryCatch(
{
alpha <- c(1.0, 1.2, 3.0, 3.2)
A <- c(10, 3, 17, 3.5, 1.7, 8,
0.05, 10, 17, 0.1, 8, 14,
3, 3.5, 1.7, 10, 17, 8,
17, 8, 0.05, 10, 0.1, 14)
A <- matrix(A, 4, 6, byrow=TRUE)
P <- 10^(-4) * c(1312, 1696, 5569, 124, 8283, 5886,
2329, 4135, 8307, 3736, 1004, 9991,
2348, 1451, 3522, 2883, 3047, 6650,
4047, 8828, 8732, 5743, 1091, 381)
P <- matrix(P, 4, 6, byrow=TRUE)
Xmat <- matrix(rep(X,times=4), 4, 6, byrow=TRUE)
inner_sum <- rowSums(A[,1:6]*(Xmat-P[,1:6])^2)
outer_sum <- sum(alpha * exp(-inner_sum))
y <- -outer_sum
return(y)
},
error=function(cond) {
return(NA)
}
)
return(out)
}
Running our script¶
To run our script we just need to pass the config file to BOA’s CLI
python -m boa --config-file path/to/config.yaml
or
python -m boa -c path/to/config.yaml
1!python -m boa -c {config_path}
[WARNING 07-19 00:00:52] ax.service.utils.with_db_settings_base: Ax currently requires a sqlalchemy version below 2.0. This will be addressed in a future release. Disabling SQL storage in Ax for now, if you would like to use SQL storage please install Ax with mysql extras via `pip install ax-platform[mysql]`.
[INFO 07-19 00:00:53] ax.service.utils.instantiation: Created search space: SearchSpace(parameters=[RangeParameter(name='x0', parameter_type=FLOAT, range=[0.0, 1.0]), RangeParameter(name='x1', parameter_type=FLOAT, range=[0.0, 1.0]), RangeParameter(name='x2', parameter_type=FLOAT, range=[0.0, 1.0]), RangeParameter(name='x3', parameter_type=FLOAT, range=[0.0, 1.0]), RangeParameter(name='x4', parameter_type=FLOAT, range=[0.0, 1.0]), RangeParameter(name='x5', parameter_type=FLOAT, range=[0.0, 1.0])], parameter_constraints=[]).
[INFO 07-19 00:00:53] ax.modelbridge.dispatch_utils: Using Models.BOTORCH_MODULAR since there are more ordered parameters than there are categories for the unordered categorical parameters.
[INFO 07-19 00:00:53] ax.modelbridge.dispatch_utils: Calculating the number of remaining initialization trials based on num_initialization_trials=None max_initialization_trials=None num_tunable_parameters=6 num_trials=None use_batch_trials=False
[INFO 07-19 00:00:53] ax.modelbridge.dispatch_utils: calculated num_initialization_trials=12
[INFO 07-19 00:00:53] ax.modelbridge.dispatch_utils: num_completed_initialization_trials=0 num_remaining_initialization_trials=12
[INFO 07-19 00:00:53] ax.modelbridge.dispatch_utils: `verbose`, `disable_progbar`, and `jit_compile` are not yet supported when using `choose_generation_strategy` with ModularBoTorchModel, dropping these arguments.
[INFO 07-19 00:00:53] ax.modelbridge.dispatch_utils: Using Bayesian Optimization generation strategy: GenerationStrategy(name='Sobol+BoTorch', steps=[Sobol for 12 trials, BoTorch for subsequent trials]). Iterations after 12 will take longer to generate due to model-fitting.
[INFO 07-19 00:00:53] Scheduler: `Scheduler` requires experiment to have immutable search space and optimization config. Setting property immutable_search_space_and_opt_config to `True` on experiment.
[INFO 2024-07-19 00:00:53,447 MainProcess MainThread {controller.py:165}] boa:
##############################################
BOA Experiment Run
Output Experiment Dir: /home/docs/checkouts/readthedocs.org/user_builds/boa-paper/checkouts/latest/r_hartmann/r_hartmann_10_trials_w_stopping_strategy_20240719T000053
Scheduler File Path: /home/docs/checkouts/readthedocs.org/user_builds/boa-paper/checkouts/latest/r_hartmann/r_hartmann_10_trials_w_stopping_strategy_20240719T000053/scheduler.json
Optimization CSV File Path: /home/docs/checkouts/readthedocs.org/user_builds/boa-paper/checkouts/latest/r_hartmann/r_hartmann_10_trials_w_stopping_strategy_20240719T000053/optimization.csv
Start Time: 20240719T000053
Version: 0.10.3
##############################################
[INFO 07-19 00:00:53] Scheduler: Running trials [0]...
[INFO 2024-07-19 00:00:53,459 MainProcess ThreadPoolExecutor-0_0 {script_wrapper.py:322}] boa: Rscript run_model.R
[INFO 2024-07-19 00:00:53,460 MainProcess ThreadPoolExecutor-0_0 {script_wrapper.py:328}] boa: {'config_path': PosixPath('/home/docs/checkouts/readthedocs.org/user_builds/boa-paper/checkouts/latest/r_hartmann/config_stopping_strat.yaml'), 'config_dir': PosixPath('/home/docs/checkouts/readthedocs.org/user_builds/boa-paper/checkouts/latest/r_hartmann'), 'config_dir_name': 'r_hartmann', 'config_file_name': 'config_stopping_strat.yaml', 'x0': 0.06989969313144684, 'x1': 0.5321492552757263, 'x2': 0.20325440168380737, 'x3': 0.8778205513954163, 'x4': 0.8861024975776672, 'x5': 0.36819449067115784, 'trial_dir': PosixPath('/home/docs/checkouts/readthedocs.org/user_builds/boa-paper/checkouts/latest/r_hartmann/r_hartmann_10_trials_w_stopping_strategy_20240719T000053/000000')}
[INFO 2024-07-19 00:00:53,461 MainProcess ThreadPoolExecutor-0_0 {script_wrapper.py:330}] boa: Rscript run_model.R
[WARNING 2024-07-19 00:00:53,674 MainProcess Thread-1 (subprocess_output) {script_wrapper.py:368}] boa: Warning message:
[WARNING 2024-07-19 00:00:53,675 MainProcess Thread-1 (subprocess_output) {script_wrapper.py:368}] boa: In matrix(rep(X, times = 4), 4, 6, byrow = TRUE) :
[WARNING 2024-07-19 00:00:53,675 MainProcess Thread-1 (subprocess_output) {script_wrapper.py:368}] boa: data length [20] is not a sub-multiple or multiple of the number of columns [6]
[INFO 07-19 00:00:54] Scheduler: Running trials [1]...
[INFO 2024-07-19 00:00:54,475 MainProcess ThreadPoolExecutor-1_0 {script_wrapper.py:322}] boa: Rscript run_model.R
[INFO 2024-07-19 00:00:54,476 MainProcess ThreadPoolExecutor-1_0 {script_wrapper.py:328}] boa: {'config_path': PosixPath('/home/docs/checkouts/readthedocs.org/user_builds/boa-paper/checkouts/latest/r_hartmann/config_stopping_strat.yaml'), 'config_dir': PosixPath('/home/docs/checkouts/readthedocs.org/user_builds/boa-paper/checkouts/latest/r_hartmann'), 'config_dir_name': 'r_hartmann', 'config_file_name': 'config_stopping_strat.yaml', 'x0': 0.26423664670437574, 'x1': 0.0961731281131506, 'x2': 0.9688650611788034, 'x3': 0.20362605806440115, 'x4': 0.00135042704641819, 'x5': 0.4400446228682995, 'trial_dir': PosixPath('/home/docs/checkouts/readthedocs.org/user_builds/boa-paper/checkouts/latest/r_hartmann/r_hartmann_10_trials_w_stopping_strategy_20240719T000053/000001')}
[INFO 2024-07-19 00:00:54,477 MainProcess ThreadPoolExecutor-1_0 {script_wrapper.py:330}] boa: Rscript run_model.R
[WARNING 2024-07-19 00:00:54,692 MainProcess Thread-2 (subprocess_output) {script_wrapper.py:368}] boa: Warning message:
[WARNING 2024-07-19 00:00:54,693 MainProcess Thread-2 (subprocess_output) {script_wrapper.py:368}] boa: In matrix(rep(X, times = 4), 4, 6, byrow = TRUE) :
[WARNING 2024-07-19 00:00:54,693 MainProcess Thread-2 (subprocess_output) {script_wrapper.py:368}] boa: data length [20] is not a sub-multiple or multiple of the number of columns [6]
[INFO 07-19 00:00:55] Scheduler: Running trials [2]...
[INFO 2024-07-19 00:00:55,493 MainProcess ThreadPoolExecutor-2_0 {script_wrapper.py:322}] boa: Rscript run_model.R
[INFO 2024-07-19 00:00:55,494 MainProcess ThreadPoolExecutor-2_0 {script_wrapper.py:328}] boa: {'config_path': PosixPath('/home/docs/checkouts/readthedocs.org/user_builds/boa-paper/checkouts/latest/r_hartmann/config_stopping_strat.yaml'), 'config_dir': PosixPath('/home/docs/checkouts/readthedocs.org/user_builds/boa-paper/checkouts/latest/r_hartmann'), 'config_dir_name': 'r_hartmann', 'config_file_name': 'config_stopping_strat.yaml', 'x0': 0.7032609647139907, 'x1': 0.26295079477131367, 'x2': 0.18826064560562372, 'x3': 0.4381993468850851, 'x4': 0.7182483086362481, 'x5': 0.3694168161600828, 'trial_dir': PosixPath('/home/docs/checkouts/readthedocs.org/user_builds/boa-paper/checkouts/latest/r_hartmann/r_hartmann_10_trials_w_stopping_strategy_20240719T000053/000002')}
[INFO 2024-07-19 00:00:55,495 MainProcess ThreadPoolExecutor-2_0 {script_wrapper.py:330}] boa: Rscript run_model.R
[WARNING 2024-07-19 00:00:55,710 MainProcess Thread-3 (subprocess_output) {script_wrapper.py:368}] boa: Warning message:
[WARNING 2024-07-19 00:00:55,711 MainProcess Thread-3 (subprocess_output) {script_wrapper.py:368}] boa: In matrix(rep(X, times = 4), 4, 6, byrow = TRUE) :
[WARNING 2024-07-19 00:00:55,712 MainProcess Thread-3 (subprocess_output) {script_wrapper.py:368}] boa: data length [20] is not a sub-multiple or multiple of the number of columns [6]
[INFO 07-19 00:00:56] Scheduler: Running trials [3]...
[INFO 2024-07-19 00:00:56,510 MainProcess ThreadPoolExecutor-3_0 {script_wrapper.py:322}] boa: Rscript run_model.R
[INFO 2024-07-19 00:00:56,512 MainProcess ThreadPoolExecutor-3_0 {script_wrapper.py:328}] boa: {'config_path': PosixPath('/home/docs/checkouts/readthedocs.org/user_builds/boa-paper/checkouts/latest/r_hartmann/config_stopping_strat.yaml'), 'config_dir': PosixPath('/home/docs/checkouts/readthedocs.org/user_builds/boa-paper/checkouts/latest/r_hartmann'), 'config_dir_name': 'r_hartmann', 'config_file_name': 'config_stopping_strat.yaml', 'x0': 0.046465677209198475, 'x1': 0.9545030016452074, 'x2': 0.17637963313609362, 'x3': 0.36006148159503937, 'x4': 0.898311909288168, 'x5': 0.8514025453478098, 'trial_dir': PosixPath('/home/docs/checkouts/readthedocs.org/user_builds/boa-paper/checkouts/latest/r_hartmann/r_hartmann_10_trials_w_stopping_strategy_20240719T000053/000003')}
[INFO 2024-07-19 00:00:56,513 MainProcess ThreadPoolExecutor-3_0 {script_wrapper.py:330}] boa: Rscript run_model.R
[WARNING 2024-07-19 00:00:56,726 MainProcess Thread-4 (subprocess_output) {script_wrapper.py:368}] boa: Warning message:
[WARNING 2024-07-19 00:00:56,727 MainProcess Thread-4 (subprocess_output) {script_wrapper.py:368}] boa: In matrix(rep(X, times = 4), 4, 6, byrow = TRUE) :
[WARNING 2024-07-19 00:00:56,728 MainProcess Thread-4 (subprocess_output) {script_wrapper.py:368}] boa: data length [20] is not a sub-multiple or multiple of the number of columns [6]
[INFO 07-19 00:00:57] Scheduler: Running trials [4]...
[INFO 2024-07-19 00:00:57,529 MainProcess ThreadPoolExecutor-4_0 {script_wrapper.py:322}] boa: Rscript run_model.R
[INFO 2024-07-19 00:00:57,531 MainProcess ThreadPoolExecutor-4_0 {script_wrapper.py:328}] boa: {'config_path': PosixPath('/home/docs/checkouts/readthedocs.org/user_builds/boa-paper/checkouts/latest/r_hartmann/config_stopping_strat.yaml'), 'config_dir': PosixPath('/home/docs/checkouts/readthedocs.org/user_builds/boa-paper/checkouts/latest/r_hartmann'), 'config_dir_name': 'r_hartmann', 'config_file_name': 'config_stopping_strat.yaml', 'x0': 0.883534093387425, 'x1': 0.23446871805936098, 'x2': 0.8409344060346484, 'x3': 0.9577370826154947, 'x4': 0.518021697178483, 'x5': 0.19179626647382975, 'trial_dir': PosixPath('/home/docs/checkouts/readthedocs.org/user_builds/boa-paper/checkouts/latest/r_hartmann/r_hartmann_10_trials_w_stopping_strategy_20240719T000053/000004')}
[INFO 2024-07-19 00:00:57,532 MainProcess ThreadPoolExecutor-4_0 {script_wrapper.py:330}] boa: Rscript run_model.R
[WARNING 2024-07-19 00:00:57,747 MainProcess Thread-5 (subprocess_output) {script_wrapper.py:368}] boa: Warning message:
[WARNING 2024-07-19 00:00:57,749 MainProcess Thread-5 (subprocess_output) {script_wrapper.py:368}] boa: In matrix(rep(X, times = 4), 4, 6, byrow = TRUE) :
[WARNING 2024-07-19 00:00:57,750 MainProcess Thread-5 (subprocess_output) {script_wrapper.py:368}] boa: data length [20] is not a sub-multiple or multiple of the number of columns [6]
[INFO 07-19 00:00:58] Scheduler: Running trials [5]...
[INFO 2024-07-19 00:00:58,549 MainProcess ThreadPoolExecutor-5_0 {script_wrapper.py:322}] boa: Rscript run_model.R
[INFO 2024-07-19 00:00:58,551 MainProcess ThreadPoolExecutor-5_0 {script_wrapper.py:328}] boa: {'config_path': PosixPath('/home/docs/checkouts/readthedocs.org/user_builds/boa-paper/checkouts/latest/r_hartmann/config_stopping_strat.yaml'), 'config_dir': PosixPath('/home/docs/checkouts/readthedocs.org/user_builds/boa-paper/checkouts/latest/r_hartmann'), 'config_dir_name': 'r_hartmann', 'config_file_name': 'config_stopping_strat.yaml', 'x0': 0.18094735406339169, 'x1': 0.06828809157013893, 'x2': 0.5047326311469078, 'x3': 0.793825538828969, 'x4': 0.21260908618569374, 'x5': 0.3894917080178857, 'trial_dir': PosixPath('/home/docs/checkouts/readthedocs.org/user_builds/boa-paper/checkouts/latest/r_hartmann/r_hartmann_10_trials_w_stopping_strategy_20240719T000053/000005')}
[INFO 2024-07-19 00:00:58,552 MainProcess ThreadPoolExecutor-5_0 {script_wrapper.py:330}] boa: Rscript run_model.R
[WARNING 2024-07-19 00:00:58,767 MainProcess Thread-6 (subprocess_output) {script_wrapper.py:368}] boa: Warning message:
[WARNING 2024-07-19 00:00:58,769 MainProcess Thread-6 (subprocess_output) {script_wrapper.py:368}] boa: In matrix(rep(X, times = 4), 4, 6, byrow = TRUE) :
[WARNING 2024-07-19 00:00:58,770 MainProcess Thread-6 (subprocess_output) {script_wrapper.py:368}] boa: data length [20] is not a sub-multiple or multiple of the number of columns [6]
[INFO 07-19 00:00:59] Scheduler: Running trials [6]...
[INFO 2024-07-19 00:00:59,571 MainProcess ThreadPoolExecutor-6_0 {script_wrapper.py:322}] boa: Rscript run_model.R
[INFO 2024-07-19 00:00:59,573 MainProcess ThreadPoolExecutor-6_0 {script_wrapper.py:328}] boa: {'config_path': PosixPath('/home/docs/checkouts/readthedocs.org/user_builds/boa-paper/checkouts/latest/r_hartmann/config_stopping_strat.yaml'), 'config_dir': PosixPath('/home/docs/checkouts/readthedocs.org/user_builds/boa-paper/checkouts/latest/r_hartmann'), 'config_dir_name': 'r_hartmann', 'config_file_name': 'config_stopping_strat.yaml', 'x0': 0.750194251537323, 'x1': 0.3166015846654773, 'x2': 0.4759846143424511, 'x3': 0.4844128992408514, 'x4': 0.15583458542823792, 'x5': 0.5777451330795884, 'trial_dir': PosixPath('/home/docs/checkouts/readthedocs.org/user_builds/boa-paper/checkouts/latest/r_hartmann/r_hartmann_10_trials_w_stopping_strategy_20240719T000053/000006')}
[INFO 2024-07-19 00:00:59,575 MainProcess ThreadPoolExecutor-6_0 {script_wrapper.py:330}] boa: Rscript run_model.R
[WARNING 2024-07-19 00:00:59,791 MainProcess Thread-7 (subprocess_output) {script_wrapper.py:368}] boa: Warning message:
[WARNING 2024-07-19 00:00:59,793 MainProcess Thread-7 (subprocess_output) {script_wrapper.py:368}] boa: In matrix(rep(X, times = 4), 4, 6, byrow = TRUE) :
[WARNING 2024-07-19 00:00:59,794 MainProcess Thread-7 (subprocess_output) {script_wrapper.py:368}] boa: data length [20] is not a sub-multiple or multiple of the number of columns [6]
[INFO 07-19 00:01:00] Scheduler: Running trials [7]...
[INFO 2024-07-19 00:01:00,594 MainProcess ThreadPoolExecutor-7_0 {script_wrapper.py:322}] boa: Rscript run_model.R
[INFO 2024-07-19 00:01:00,596 MainProcess ThreadPoolExecutor-7_0 {script_wrapper.py:328}] boa: {'config_path': PosixPath('/home/docs/checkouts/readthedocs.org/user_builds/boa-paper/checkouts/latest/r_hartmann/config_stopping_strat.yaml'), 'config_dir': PosixPath('/home/docs/checkouts/readthedocs.org/user_builds/boa-paper/checkouts/latest/r_hartmann'), 'config_dir_name': 'r_hartmann', 'config_file_name': 'config_stopping_strat.yaml', 'x0': 0.8944233795627952, 'x1': 0.20834801625460386, 'x2': 0.5569059234112501, 'x3': 0.8152137165889144, 'x4': 0.06354413833469152, 'x5': 0.4307529665529728, 'trial_dir': PosixPath('/home/docs/checkouts/readthedocs.org/user_builds/boa-paper/checkouts/latest/r_hartmann/r_hartmann_10_trials_w_stopping_strategy_20240719T000053/000007')}
[INFO 2024-07-19 00:01:00,597 MainProcess ThreadPoolExecutor-7_0 {script_wrapper.py:330}] boa: Rscript run_model.R
[WARNING 2024-07-19 00:01:00,814 MainProcess Thread-8 (subprocess_output) {script_wrapper.py:368}] boa: Warning message:
[WARNING 2024-07-19 00:01:00,816 MainProcess Thread-8 (subprocess_output) {script_wrapper.py:368}] boa: In matrix(rep(X, times = 4), 4, 6, byrow = TRUE) :
[WARNING 2024-07-19 00:01:00,817 MainProcess Thread-8 (subprocess_output) {script_wrapper.py:368}] boa: data length [20] is not a sub-multiple or multiple of the number of columns [6]
[INFO 07-19 00:01:01] Scheduler: Running trials [8]...
[INFO 2024-07-19 00:01:01,617 MainProcess ThreadPoolExecutor-8_0 {script_wrapper.py:322}] boa: Rscript run_model.R
[INFO 2024-07-19 00:01:01,619 MainProcess ThreadPoolExecutor-8_0 {script_wrapper.py:328}] boa: {'config_path': PosixPath('/home/docs/checkouts/readthedocs.org/user_builds/boa-paper/checkouts/latest/r_hartmann/config_stopping_strat.yaml'), 'config_dir': PosixPath('/home/docs/checkouts/readthedocs.org/user_builds/boa-paper/checkouts/latest/r_hartmann'), 'config_dir_name': 'r_hartmann', 'config_file_name': 'config_stopping_strat.yaml', 'x0': 0.5341396015137434, 'x1': 0.49051456060260534, 'x2': 0.17498017940670252, 'x3': 0.42001691088080406, 'x4': 0.32009317073971033, 'x5': 0.4970081290230155, 'trial_dir': PosixPath('/home/docs/checkouts/readthedocs.org/user_builds/boa-paper/checkouts/latest/r_hartmann/r_hartmann_10_trials_w_stopping_strategy_20240719T000053/000008')}
[INFO 2024-07-19 00:01:01,621 MainProcess ThreadPoolExecutor-8_0 {script_wrapper.py:330}] boa: Rscript run_model.R
[WARNING 2024-07-19 00:01:01,836 MainProcess Thread-9 (subprocess_output) {script_wrapper.py:368}] boa: Warning message:
[WARNING 2024-07-19 00:01:01,838 MainProcess Thread-9 (subprocess_output) {script_wrapper.py:368}] boa: In matrix(rep(X, times = 4), 4, 6, byrow = TRUE) :
[WARNING 2024-07-19 00:01:01,839 MainProcess Thread-9 (subprocess_output) {script_wrapper.py:368}] boa: data length [20] is not a sub-multiple or multiple of the number of columns [6]
[INFO 07-19 00:01:02] Scheduler: Running trials [9]...
[INFO 2024-07-19 00:01:02,644 MainProcess ThreadPoolExecutor-9_0 {script_wrapper.py:322}] boa: Rscript run_model.R
[INFO 2024-07-19 00:01:02,645 MainProcess ThreadPoolExecutor-9_0 {script_wrapper.py:328}] boa: {'config_path': PosixPath('/home/docs/checkouts/readthedocs.org/user_builds/boa-paper/checkouts/latest/r_hartmann/config_stopping_strat.yaml'), 'config_dir': PosixPath('/home/docs/checkouts/readthedocs.org/user_builds/boa-paper/checkouts/latest/r_hartmann'), 'config_dir_name': 'r_hartmann', 'config_file_name': 'config_stopping_strat.yaml', 'x0': 0.39418844413012266, 'x1': 0.21041687298566103, 'x2': 0.18693618662655354, 'x3': 0.5612271344289184, 'x4': 0.28560137655586004, 'x5': 0.6575725926086307, 'trial_dir': PosixPath('/home/docs/checkouts/readthedocs.org/user_builds/boa-paper/checkouts/latest/r_hartmann/r_hartmann_10_trials_w_stopping_strategy_20240719T000053/000009')}
[INFO 2024-07-19 00:01:02,647 MainProcess ThreadPoolExecutor-9_0 {script_wrapper.py:330}] boa: Rscript run_model.R
[WARNING 2024-07-19 00:01:02,862 MainProcess Thread-10 (subprocess_output) {script_wrapper.py:368}] boa: Warning message:
[WARNING 2024-07-19 00:01:02,864 MainProcess Thread-10 (subprocess_output) {script_wrapper.py:368}] boa: In matrix(rep(X, times = 4), 4, 6, byrow = TRUE) :
[WARNING 2024-07-19 00:01:02,866 MainProcess Thread-10 (subprocess_output) {script_wrapper.py:368}] boa: data length [20] is not a sub-multiple or multiple of the number of columns [6]
[INFO 07-19 00:01:03] Scheduler: Retrieved COMPLETED trials: 0 - 9.
[INFO 07-19 00:01:03] Scheduler: Fetching data for trials: 0 - 9.
[WARNING 07-19 00:01:03] ax.service.utils.report_utils: Column reason missing for all trials. Not appending column.
[INFO 2024-07-19 00:01:03,755 MainProcess MainThread {storage.py:303}] boa: Saved optimization parametrization and objective to `/home/docs/checkouts/readthedocs.org/user_builds/boa-paper/checkouts/latest/r_hartmann/r_hartmann_10_trials_w_stopping_strategy_20240719T000053/optimization.csv`.
[INFO 2024-07-19 00:01:03,781 MainProcess MainThread {storage.py:63}] boa: Saved JSON-serialized state of optimization to `/home/docs/checkouts/readthedocs.org/user_builds/boa-paper/checkouts/latest/r_hartmann/r_hartmann_10_trials_w_stopping_strategy_20240719T000053/scheduler.json`.
Boa version: 0.10.3
[INFO 2024-07-19 00:01:03,797 MainProcess MainThread {scheduler.py:86}] boa: Trials so far: 10
Currently running trials: []
Will Produce next trials from generation step: Sobol
Best trial so far: {6: {'Hartmann6': -1.6703}}
[WARNING 07-19 00:01:03] ax.service.utils.report_utils: Column reason missing for all trials. Not appending column.
[INFO 2024-07-19 00:01:03,819 MainProcess MainThread {storage.py:303}] boa: Saved optimization parametrization and objective to `/home/docs/checkouts/readthedocs.org/user_builds/boa-paper/checkouts/latest/r_hartmann/r_hartmann_10_trials_w_stopping_strategy_20240719T000053/optimization.csv`.
[INFO 2024-07-19 00:01:03,844 MainProcess MainThread {storage.py:63}] boa: Saved JSON-serialized state of optimization to `/home/docs/checkouts/readthedocs.org/user_builds/boa-paper/checkouts/latest/r_hartmann/r_hartmann_10_trials_w_stopping_strategy_20240719T000053/scheduler.json`.
Boa version: 0.10.3
[INFO 2024-07-19 00:01:03,858 MainProcess MainThread {scheduler.py:86}] boa: Trials so far: 10
Currently running trials: []
Will Produce next trials from generation step: Sobol
Best trial so far: {6: {'Hartmann6': -1.6703}}
[WARNING 07-19 00:01:03] ax.service.utils.report_utils: Column reason missing for all trials. Not appending column.
[INFO 2024-07-19 00:01:03,889 MainProcess MainThread {controller.py:188}] boa:
##############################################
Trials Completed!
BOA Experiment Run
Output Experiment Dir: /home/docs/checkouts/readthedocs.org/user_builds/boa-paper/checkouts/latest/r_hartmann/r_hartmann_10_trials_w_stopping_strategy_20240719T000053
Scheduler File Path: /home/docs/checkouts/readthedocs.org/user_builds/boa-paper/checkouts/latest/r_hartmann/r_hartmann_10_trials_w_stopping_strategy_20240719T000053/scheduler.json
Optimization CSV File Path: /home/docs/checkouts/readthedocs.org/user_builds/boa-paper/checkouts/latest/r_hartmann/r_hartmann_10_trials_w_stopping_strategy_20240719T000053/optimization.csv
Start Time: 20240719T000053
Version: 0.10.3
End Time: 20240719T000103
Total Run Time: 10.412656784057617
trial_index arm_name trial_status ... x3 x4 x5
0 0 0_0 COMPLETED ... 0.877821 0.886102 0.368194
1 1 1_0 COMPLETED ... 0.203626 0.001350 0.440045
2 2 2_0 COMPLETED ... 0.438199 0.718248 0.369417
3 3 3_0 COMPLETED ... 0.360061 0.898312 0.851403
4 4 4_0 COMPLETED ... 0.957737 0.518022 0.191796
5 5 5_0 COMPLETED ... 0.793826 0.212609 0.389492
6 6 6_0 COMPLETED ... 0.484413 0.155835 0.577745
7 7 7_0 COMPLETED ... 0.815214 0.063544 0.430753
8 8 8_0 COMPLETED ... 0.420017 0.320093 0.497008
9 9 9_0 COMPLETED ... 0.561227 0.285601 0.657573
[10 rows x 11 columns]
##############################################
[WARNING 07-19 00:01:07] ax.service.utils.with_db_settings_base: Ax currently requires a sqlalchemy version below 2.0. This will be addressed in a future release. Disabling SQL storage in Ax for now, if you would like to use SQL storage please install Ax with mysql extras via `pip install ax-platform[mysql]`.
[INFO 07-19 00:01:08] ax.service.utils.instantiation: Created search space: SearchSpace(parameters=[RangeParameter(name='x0', parameter_type=FLOAT, range=[0.0, 1.0]), RangeParameter(name='x1', parameter_type=FLOAT, range=[0.0, 1.0]), RangeParameter(name='x2', parameter_type=FLOAT, range=[0.0, 1.0]), RangeParameter(name='x3', parameter_type=FLOAT, range=[0.0, 1.0]), RangeParameter(name='x4', parameter_type=FLOAT, range=[0.0, 1.0]), RangeParameter(name='x5', parameter_type=FLOAT, range=[0.0, 1.0])], parameter_constraints=[]).
[INFO 07-19 00:01:08] ax.modelbridge.dispatch_utils: Using Models.BOTORCH_MODULAR since there are more ordered parameters than there are categories for the unordered categorical parameters.
[INFO 07-19 00:01:08] ax.modelbridge.dispatch_utils: Calculating the number of remaining initialization trials based on num_initialization_trials=None max_initialization_trials=None num_tunable_parameters=6 num_trials=None use_batch_trials=False
[INFO 07-19 00:01:08] ax.modelbridge.dispatch_utils: calculated num_initialization_trials=12
[INFO 07-19 00:01:08] ax.modelbridge.dispatch_utils: num_completed_initialization_trials=0 num_remaining_initialization_trials=12
[INFO 07-19 00:01:08] ax.modelbridge.dispatch_utils: `verbose`, `disable_progbar`, and `jit_compile` are not yet supported when using `choose_generation_strategy` with ModularBoTorchModel, dropping these arguments.
[INFO 07-19 00:01:08] ax.modelbridge.dispatch_utils: Using Bayesian Optimization generation strategy: GenerationStrategy(name='Sobol+BoTorch', steps=[Sobol for 12 trials, BoTorch for subsequent trials]). Iterations after 12 will take longer to generate due to model-fitting.
[INFO 07-19 00:01:08] Scheduler: `Scheduler` requires experiment to have immutable search space and optimization config. Setting property immutable_search_space_and_opt_config to `True` on experiment.
[INFO 2024-07-19 00:01:08,379 MainProcess MainThread {controller.py:165}] boa:
##############################################
BOA Experiment Run
Output Experiment Dir: [/path/to/your/dir/]/r_hartmann_10_trials_w_stopping_strategy_20240719T000108
Scheduler File Path: [/path/to/your/dir/]/r_hartmann_10_trials_w_stopping_strategy_20240719T000108/scheduler.json
Optimization CSV File Path: [/path/to/your/dir/]/r_hartmann_10_trials_w_stopping_strategy_20240719T000108/optimization.csv
Start Time: 20240719T000108
Version: 0.10.3
##############################################
[INFO 07-19 00:01:08] Scheduler: Running trials [0]...
[INFO 2024-07-19 00:01:08,391 MainProcess ThreadPoolExecutor-0_0 {script_wrapper.py:322}] boa: Rscript run_model.R
[INFO 2024-07-19 00:01:08,392 MainProcess ThreadPoolExecutor-0_0 {script_wrapper.py:328}] boa: {'config_path': PosixPath('[/path/to/your/dir/]/config_stopping_strat.yaml'), 'config_dir': PosixPath('[/path/to/your/dir/]'), 'config_dir_name': 'r_hartmann', 'config_file_name': 'config_stopping_strat.yaml', 'x0': 0.41162607073783875, 'x1': 0.3437858819961548, 'x2': 0.6503646373748779, 'x3': 0.8817135691642761, 'x4': 0.7714420557022095, 'x5': 0.9825463891029358, 'trial_dir': PosixPath('[/path/to/your/dir/]/r_hartmann_10_trials_w_stopping_strategy_20240719T000108/000000')}
[INFO 2024-07-19 00:01:08,393 MainProcess ThreadPoolExecutor-0_0 {script_wrapper.py:330}] boa: Rscript run_model.R
[WARNING 2024-07-19 00:01:08,610 MainProcess Thread-1 (subprocess_output) {script_wrapper.py:368}] boa: Warning message:
[WARNING 2024-07-19 00:01:08,611 MainProcess Thread-1 (subprocess_output) {script_wrapper.py:368}] boa: In matrix(rep(X, times = 4), 4, 6, byrow = TRUE) :
[WARNING 2024-07-19 00:01:08,611 MainProcess Thread-1 (subprocess_output) {script_wrapper.py:368}] boa: data length [20] is not a sub-multiple or multiple of the number of columns [6]
[INFO 07-19 00:01:09] Scheduler: Running trials [1]...
[INFO 2024-07-19 00:01:09,407 MainProcess ThreadPoolExecutor-1_0 {script_wrapper.py:322}] boa: Rscript run_model.R
[INFO 2024-07-19 00:01:09,408 MainProcess ThreadPoolExecutor-1_0 {script_wrapper.py:328}] boa: {'config_path': PosixPath('[/path/to/your/dir/]/config_stopping_strat.yaml'), 'config_dir': PosixPath('[/path/to/your/dir/]'), 'config_dir_name': 'r_hartmann', 'config_file_name': 'config_stopping_strat.yaml', 'x0': 0.8242525141686201, 'x1': 0.8679762845858932, 'x2': 0.9314081957563758, 'x3': 0.42809382919222116, 'x4': 0.25779618695378304, 'x5': 0.9652502229437232, 'trial_dir': PosixPath('[/path/to/your/dir/]/r_hartmann_10_trials_w_stopping_strategy_20240719T000108/000001')}
[INFO 2024-07-19 00:01:09,409 MainProcess ThreadPoolExecutor-1_0 {script_wrapper.py:330}] boa: Rscript run_model.R
[WARNING 2024-07-19 00:01:09,620 MainProcess Thread-2 (subprocess_output) {script_wrapper.py:368}] boa: Warning message:
[WARNING 2024-07-19 00:01:09,621 MainProcess Thread-2 (subprocess_output) {script_wrapper.py:368}] boa: In matrix(rep(X, times = 4), 4, 6, byrow = TRUE) :
[WARNING 2024-07-19 00:01:09,621 MainProcess Thread-2 (subprocess_output) {script_wrapper.py:368}] boa: data length [20] is not a sub-multiple or multiple of the number of columns [6]
[INFO 07-19 00:01:10] Scheduler: Running trials [2]...
[INFO 2024-07-19 00:01:10,424 MainProcess ThreadPoolExecutor-2_0 {script_wrapper.py:322}] boa: Rscript run_model.R
[INFO 2024-07-19 00:01:10,425 MainProcess ThreadPoolExecutor-2_0 {script_wrapper.py:328}] boa: {'config_path': PosixPath('[/path/to/your/dir/]/config_stopping_strat.yaml'), 'config_dir': PosixPath('[/path/to/your/dir/]'), 'config_dir_name': 'r_hartmann', 'config_file_name': 'config_stopping_strat.yaml', 'x0': 0.8189938375726342, 'x1': 0.3095374321565032, 'x2': 0.037260948680341244, 'x3': 0.6487368671223521, 'x4': 0.8012019991874695, 'x5': 0.25186748057603836, 'trial_dir': PosixPath('[/path/to/your/dir/]/r_hartmann_10_trials_w_stopping_strategy_20240719T000108/000002')}
[INFO 2024-07-19 00:01:10,426 MainProcess ThreadPoolExecutor-2_0 {script_wrapper.py:330}] boa: Rscript run_model.R
[INFO 07-19 00:01:10] Scheduler: Running trials [3]...
[INFO 2024-07-19 00:01:10,445 MainProcess ThreadPoolExecutor-3_0 {script_wrapper.py:322}] boa: Rscript run_model.R
[INFO 2024-07-19 00:01:10,447 MainProcess ThreadPoolExecutor-3_0 {script_wrapper.py:328}] boa: {'config_path': PosixPath('[/path/to/your/dir/]/config_stopping_strat.yaml'), 'config_dir': PosixPath('[/path/to/your/dir/]'), 'config_dir_name': 'r_hartmann', 'config_file_name': 'config_stopping_strat.yaml', 'x0': 0.09218783397227526, 'x1': 0.1332488525658846, 'x2': 0.9546963712200522, 'x3': 0.11806548945605755, 'x4': 0.11652353126555681, 'x5': 0.31138436682522297, 'trial_dir': PosixPath('[/path/to/your/dir/]/r_hartmann_10_trials_w_stopping_strategy_20240719T000108/000003')}
[INFO 2024-07-19 00:01:10,448 MainProcess ThreadPoolExecutor-3_0 {script_wrapper.py:330}] boa: Rscript run_model.R
[INFO 07-19 00:01:10] Scheduler: Running trials [4]...
[INFO 2024-07-19 00:01:10,510 MainProcess ThreadPoolExecutor-4_0 {script_wrapper.py:322}] boa: Rscript run_model.R
[INFO 2024-07-19 00:01:10,521 MainProcess ThreadPoolExecutor-4_0 {script_wrapper.py:328}] boa: {'config_path': PosixPath('[/path/to/your/dir/]/config_stopping_strat.yaml'), 'config_dir': PosixPath('[/path/to/your/dir/]'), 'config_dir_name': 'r_hartmann', 'config_file_name': 'config_stopping_strat.yaml', 'x0': 0.863607787527144, 'x1': 0.9825019650161266, 'x2': 0.27240388188511133, 'x3': 0.5958319520577788, 'x4': 0.9174212710931897, 'x5': 0.40151179395616055, 'trial_dir': PosixPath('[/path/to/your/dir/]/r_hartmann_10_trials_w_stopping_strategy_20240719T000108/000004')}
[INFO 2024-07-19 00:01:10,523 MainProcess ThreadPoolExecutor-4_0 {script_wrapper.py:330}] boa: Rscript run_model.R
[WARNING 2024-07-19 00:01:10,917 MainProcess Thread-4 (subprocess_output) {script_wrapper.py:368}] boa: Warning message:
[WARNING 2024-07-19 00:01:10,929 MainProcess Thread-4 (subprocess_output) {script_wrapper.py:368}] boa: In matrix(rep(X, times = 4), 4, 6, byrow = TRUE) :
[WARNING 2024-07-19 00:01:10,930 MainProcess Thread-4 (subprocess_output) {script_wrapper.py:368}] boa: data length [20] is not a sub-multiple or multiple of the number of columns [6]
[WARNING 2024-07-19 00:01:10,944 MainProcess Thread-3 (subprocess_output) {script_wrapper.py:368}] boa: Warning message:
[WARNING 2024-07-19 00:01:10,946 MainProcess Thread-3 (subprocess_output) {script_wrapper.py:368}] boa: In matrix(rep(X, times = 4), 4, 6, byrow = TRUE) :
[WARNING 2024-07-19 00:01:10,947 MainProcess Thread-3 (subprocess_output) {script_wrapper.py:368}] boa: data length [20] is not a sub-multiple or multiple of the number of columns [6]
[WARNING 2024-07-19 00:01:10,998 MainProcess Thread-5 (subprocess_output) {script_wrapper.py:368}] boa: Warning message:
[WARNING 2024-07-19 00:01:11,000 MainProcess Thread-5 (subprocess_output) {script_wrapper.py:368}] boa: In matrix(rep(X, times = 4), 4, 6, byrow = TRUE) :
[WARNING 2024-07-19 00:01:11,001 MainProcess Thread-5 (subprocess_output) {script_wrapper.py:368}] boa: data length [20] is not a sub-multiple or multiple of the number of columns [6]
[INFO 07-19 00:01:11] Scheduler: Running trials [5]...
[INFO 2024-07-19 00:01:11,555 MainProcess ThreadPoolExecutor-5_0 {script_wrapper.py:322}] boa: Rscript run_model.R
[INFO 2024-07-19 00:01:11,557 MainProcess ThreadPoolExecutor-5_0 {script_wrapper.py:328}] boa: {'config_path': PosixPath('[/path/to/your/dir/]/config_stopping_strat.yaml'), 'config_dir': PosixPath('[/path/to/your/dir/]'), 'config_dir_name': 'r_hartmann', 'config_file_name': 'config_stopping_strat.yaml', 'x0': 0.5382255651056767, 'x1': 0.2448831656947732, 'x2': 0.834496732801199, 'x3': 0.08604494668543339, 'x4': 0.7223624950274825, 'x5': 0.47385338600724936, 'trial_dir': PosixPath('[/path/to/your/dir/]/r_hartmann_10_trials_w_stopping_strategy_20240719T000108/000005')}
[INFO 2024-07-19 00:01:11,558 MainProcess ThreadPoolExecutor-5_0 {script_wrapper.py:330}] boa: Rscript run_model.R
[INFO 07-19 00:01:11] Scheduler: Running trials [6]...
[INFO 2024-07-19 00:01:11,582 MainProcess ThreadPoolExecutor-6_0 {script_wrapper.py:322}] boa: Rscript run_model.R
[INFO 2024-07-19 00:01:11,584 MainProcess ThreadPoolExecutor-6_0 {script_wrapper.py:328}] boa: {'config_path': PosixPath('[/path/to/your/dir/]/config_stopping_strat.yaml'), 'config_dir': PosixPath('[/path/to/your/dir/]'), 'config_dir_name': 'r_hartmann', 'config_file_name': 'config_stopping_strat.yaml', 'x0': 0.24699019733816385, 'x1': 0.18508534878492355, 'x2': 0.18456250708550215, 'x3': 0.8760999208316207, 'x4': 0.501504685729742, 'x5': 0.008943745866417885, 'trial_dir': PosixPath('[/path/to/your/dir/]/r_hartmann_10_trials_w_stopping_strategy_20240719T000108/000006')}
[INFO 2024-07-19 00:01:11,586 MainProcess ThreadPoolExecutor-6_0 {script_wrapper.py:330}] boa: Rscript run_model.R
[WARNING 2024-07-19 00:01:11,902 MainProcess Thread-6 (subprocess_output) {script_wrapper.py:368}] boa: Warning message:
[WARNING 2024-07-19 00:01:11,904 MainProcess Thread-6 (subprocess_output) {script_wrapper.py:368}] boa: In matrix(rep(X, times = 4), 4, 6, byrow = TRUE) :
[WARNING 2024-07-19 00:01:11,905 MainProcess Thread-6 (subprocess_output) {script_wrapper.py:368}] boa: data length [20] is not a sub-multiple or multiple of the number of columns [6]
[WARNING 2024-07-19 00:01:11,922 MainProcess Thread-7 (subprocess_output) {script_wrapper.py:368}] boa: Warning message:
[WARNING 2024-07-19 00:01:11,923 MainProcess Thread-7 (subprocess_output) {script_wrapper.py:368}] boa: In matrix(rep(X, times = 4), 4, 6, byrow = TRUE) :
[WARNING 2024-07-19 00:01:11,924 MainProcess Thread-7 (subprocess_output) {script_wrapper.py:368}] boa: data length [20] is not a sub-multiple or multiple of the number of columns [6]
[INFO 07-19 00:01:12] Scheduler: Running trials [7]...
[INFO 2024-07-19 00:01:12,606 MainProcess ThreadPoolExecutor-7_0 {script_wrapper.py:322}] boa: Rscript run_model.R
[INFO 2024-07-19 00:01:12,608 MainProcess ThreadPoolExecutor-7_0 {script_wrapper.py:328}] boa: {'config_path': PosixPath('[/path/to/your/dir/]/config_stopping_strat.yaml'), 'config_dir': PosixPath('[/path/to/your/dir/]'), 'config_dir_name': 'r_hartmann', 'config_file_name': 'config_stopping_strat.yaml', 'x0': 0.5240036034956574, 'x1': 0.3165337797254324, 'x2': 0.3182875011116266, 'x3': 0.4273271718993783, 'x4': 0.5304419528692961, 'x5': 0.7457641297951341, 'trial_dir': PosixPath('[/path/to/your/dir/]/r_hartmann_10_trials_w_stopping_strategy_20240719T000108/000007')}
[INFO 2024-07-19 00:01:12,610 MainProcess ThreadPoolExecutor-7_0 {script_wrapper.py:330}] boa: Rscript run_model.R
[WARNING 2024-07-19 00:01:12,822 MainProcess Thread-8 (subprocess_output) {script_wrapper.py:368}] boa: Warning message:
[WARNING 2024-07-19 00:01:12,824 MainProcess Thread-8 (subprocess_output) {script_wrapper.py:368}] boa: In matrix(rep(X, times = 4), 4, 6, byrow = TRUE) :
[WARNING 2024-07-19 00:01:12,825 MainProcess Thread-8 (subprocess_output) {script_wrapper.py:368}] boa: data length [20] is not a sub-multiple or multiple of the number of columns [6]
[INFO 07-19 00:01:13] Scheduler: Running trials [8]...
[INFO 2024-07-19 00:01:13,629 MainProcess ThreadPoolExecutor-8_0 {script_wrapper.py:322}] boa: Rscript run_model.R
[INFO 2024-07-19 00:01:13,631 MainProcess ThreadPoolExecutor-8_0 {script_wrapper.py:328}] boa: {'config_path': PosixPath('[/path/to/your/dir/]/config_stopping_strat.yaml'), 'config_dir': PosixPath('[/path/to/your/dir/]'), 'config_dir_name': 'r_hartmann', 'config_file_name': 'config_stopping_strat.yaml', 'x0': 0.11494909971952438, 'x1': 0.6754191424697638, 'x2': 0.17404159158468246, 'x3': 0.3581358324736357, 'x4': 0.3153454391285777, 'x5': 0.8673614133149385, 'trial_dir': PosixPath('[/path/to/your/dir/]/r_hartmann_10_trials_w_stopping_strategy_20240719T000108/000008')}
[INFO 2024-07-19 00:01:13,633 MainProcess ThreadPoolExecutor-8_0 {script_wrapper.py:330}] boa: Rscript run_model.R
[WARNING 2024-07-19 00:01:13,847 MainProcess Thread-9 (subprocess_output) {script_wrapper.py:368}] boa: Warning message:
[WARNING 2024-07-19 00:01:13,849 MainProcess Thread-9 (subprocess_output) {script_wrapper.py:368}] boa: In matrix(rep(X, times = 4), 4, 6, byrow = TRUE) :
[WARNING 2024-07-19 00:01:13,850 MainProcess Thread-9 (subprocess_output) {script_wrapper.py:368}] boa: data length [20] is not a sub-multiple or multiple of the number of columns [6]
[INFO 07-19 00:01:14] Scheduler: Running trials [9]...
[INFO 2024-07-19 00:01:14,654 MainProcess ThreadPoolExecutor-9_0 {script_wrapper.py:322}] boa: Rscript run_model.R
[INFO 2024-07-19 00:01:14,656 MainProcess ThreadPoolExecutor-9_0 {script_wrapper.py:328}] boa: {'config_path': PosixPath('[/path/to/your/dir/]/config_stopping_strat.yaml'), 'config_dir': PosixPath('[/path/to/your/dir/]'), 'config_dir_name': 'r_hartmann', 'config_file_name': 'config_stopping_strat.yaml', 'x0': 0.5066144848242402, 'x1': 0.2051377110183239, 'x2': 0.149022008292377, 'x3': 0.0591372586786747, 'x4': 0.9848838783800602, 'x5': 0.7920955764129758, 'trial_dir': PosixPath('[/path/to/your/dir/]/r_hartmann_10_trials_w_stopping_strategy_20240719T000108/000009')}
[INFO 2024-07-19 00:01:14,658 MainProcess ThreadPoolExecutor-9_0 {script_wrapper.py:330}] boa: Rscript run_model.R
[INFO 07-19 00:01:14] Scheduler: Retrieved COMPLETED trials: 0 - 8.
[INFO 07-19 00:01:14] Scheduler: Fetching data for trials: 0 - 8.
/home/docs/checkouts/readthedocs.org/user_builds/boa-paper/conda/latest/lib/python3.10/site-packages/ax/core/data.py:284: FutureWarning: The behavior of DataFrame concatenation with empty or all-NA entries is deprecated. In a future version, this will no longer exclude empty or all-NA columns when determining the result dtypes. To retain the old behavior, exclude the relevant entries before the concat operation.
return cls(df=pd.concat(dfs, axis=0, sort=True))
[WARNING 07-19 00:01:14] ax.service.utils.report_utils: Column reason missing for all trials. Not appending column.
[INFO 2024-07-19 00:01:14,810 MainProcess MainThread {storage.py:303}] boa: Saved optimization parametrization and objective to `[/path/to/your/dir/]/r_hartmann_10_trials_w_stopping_strategy_20240719T000108/optimization.csv`.
[INFO 2024-07-19 00:01:14,851 MainProcess MainThread {storage.py:63}] boa: Saved JSON-serialized state of optimization to `[/path/to/your/dir/]/r_hartmann_10_trials_w_stopping_strategy_20240719T000108/scheduler.json`.
Boa version: 0.10.3
/home/docs/checkouts/readthedocs.org/user_builds/boa-paper/conda/latest/lib/python3.10/site-packages/ax/core/data.py:284: FutureWarning: The behavior of DataFrame concatenation with empty or all-NA entries is deprecated. In a future version, this will no longer exclude empty or all-NA columns when determining the result dtypes. To retain the old behavior, exclude the relevant entries before the concat operation.
return cls(df=pd.concat(dfs, axis=0, sort=True))
/home/docs/checkouts/readthedocs.org/user_builds/boa-paper/conda/latest/lib/python3.10/site-packages/ax/core/data.py:284: FutureWarning: The behavior of DataFrame concatenation with empty or all-NA entries is deprecated. In a future version, this will no longer exclude empty or all-NA columns when determining the result dtypes. To retain the old behavior, exclude the relevant entries before the concat operation.
return cls(df=pd.concat(dfs, axis=0, sort=True))
[INFO 2024-07-19 00:01:14,879 MainProcess MainThread {scheduler.py:86}] boa: Trials so far: 10
Currently running trials: 9
Will Produce next trials from generation step: Sobol
Best trial so far: {7: {'Hartmann6': -0.9148}}
[INFO 07-19 00:01:14] Scheduler: Done submitting trials, waiting for remaining 1 running trials...
[INFO 07-19 00:01:14] Scheduler: Waiting for completed trials (for 1 sec, currently running trials: 1).
[WARNING 2024-07-19 00:01:14,963 MainProcess Thread-10 (subprocess_output) {script_wrapper.py:368}] boa: Warning message:
[WARNING 2024-07-19 00:01:14,965 MainProcess Thread-10 (subprocess_output) {script_wrapper.py:368}] boa: In matrix(rep(X, times = 4), 4, 6, byrow = TRUE) :
[WARNING 2024-07-19 00:01:14,966 MainProcess Thread-10 (subprocess_output) {script_wrapper.py:368}] boa: data length [20] is not a sub-multiple or multiple of the number of columns [6]
[INFO 07-19 00:01:15] Scheduler: Retrieved COMPLETED trials: [9].
[INFO 07-19 00:01:15] Scheduler: Fetching data for trials: [9].
[WARNING 07-19 00:01:15] ax.service.utils.report_utils: Column reason missing for all trials. Not appending column.
[INFO 2024-07-19 00:01:15,919 MainProcess MainThread {storage.py:303}] boa: Saved optimization parametrization and objective to `[/path/to/your/dir/]/r_hartmann_10_trials_w_stopping_strategy_20240719T000108/optimization.csv`.
[INFO 2024-07-19 00:01:15,943 MainProcess MainThread {storage.py:63}] boa: Saved JSON-serialized state of optimization to `[/path/to/your/dir/]/r_hartmann_10_trials_w_stopping_strategy_20240719T000108/scheduler.json`.
Boa version: 0.10.3
[INFO 2024-07-19 00:01:15,957 MainProcess MainThread {scheduler.py:86}] boa: Trials so far: 10
Currently running trials: []
Will Produce next trials from generation step: Sobol
Best trial so far: {7: {'Hartmann6': -0.9148}}
[WARNING 07-19 00:01:15] ax.service.utils.report_utils: Column reason missing for all trials. Not appending column.
[INFO 2024-07-19 00:01:15,977 MainProcess MainThread {storage.py:303}] boa: Saved optimization parametrization and objective to `[/path/to/your/dir/]/r_hartmann_10_trials_w_stopping_strategy_20240719T000108/optimization.csv`.
[INFO 2024-07-19 00:01:16,000 MainProcess MainThread {storage.py:63}] boa: Saved JSON-serialized state of optimization to `[/path/to/your/dir/]/r_hartmann_10_trials_w_stopping_strategy_20240719T000108/scheduler.json`.
Boa version: 0.10.3
[INFO 2024-07-19 00:01:16,015 MainProcess MainThread {scheduler.py:86}] boa: Trials so far: 10
Currently running trials: []
Will Produce next trials from generation step: Sobol
Best trial so far: {7: {'Hartmann6': -0.9148}}
[WARNING 07-19 00:01:16] ax.service.utils.report_utils: Column reason missing for all trials. Not appending column.
[INFO 2024-07-19 00:01:16,043 MainProcess MainThread {controller.py:188}] boa:
##############################################
Trials Completed!
BOA Experiment Run
Output Experiment Dir: [/path/to/your/dir/]/r_hartmann_10_trials_w_stopping_strategy_20240719T000108
Scheduler File Path: [/path/to/your/dir/]/r_hartmann_10_trials_w_stopping_strategy_20240719T000108/scheduler.json
Optimization CSV File Path: [/path/to/your/dir/]/r_hartmann_10_trials_w_stopping_strategy_20240719T000108/optimization.csv
Start Time: 20240719T000108
Version: 0.10.3
End Time: 20240719T000116
Total Run Time: 7.637329339981079
trial_index arm_name trial_status ... x3 x4 x5
0 0 0_0 COMPLETED ... 0.881714 0.771442 0.982546
1 1 1_0 COMPLETED ... 0.428094 0.257796 0.965250
2 2 2_0 COMPLETED ... 0.648737 0.801202 0.251867
3 3 3_0 COMPLETED ... 0.118065 0.116524 0.311384
4 4 4_0 COMPLETED ... 0.595832 0.917421 0.401512
5 5 5_0 COMPLETED ... 0.086045 0.722362 0.473853
6 6 6_0 COMPLETED ... 0.876100 0.501505 0.008944
7 7 7_0 COMPLETED ... 0.427327 0.530442 0.745764
8 8 8_0 COMPLETED ... 0.358136 0.315345 0.867361
9 9 9_0 COMPLETED ... 0.059137 0.984884 0.792096
[10 rows x 11 columns]
##############################################