CRAN Package Check Results for Package mlr3benchmark

Last updated on 2024-11-27 09:49:35 CET.

Flavor Version Tinstall Tcheck Ttotal Status Flags
r-devel-linux-x86_64-debian-clang 0.1.6 5.56 49.97 55.53 ERROR
r-devel-linux-x86_64-debian-gcc 0.1.6 4.01 36.74 40.75 ERROR
r-devel-linux-x86_64-fedora-clang 0.1.6 94.19 ERROR
r-devel-linux-x86_64-fedora-gcc 0.1.6 90.90 ERROR
r-devel-windows-x86_64 0.1.6 8.00 65.00 73.00 ERROR
r-patched-linux-x86_64 0.1.6 9.97 47.62 57.59 ERROR
r-release-linux-x86_64 0.1.6 4.80 60.57 65.37 OK
r-release-macos-arm64 0.1.6 37.00 OK
r-release-macos-x86_64 0.1.6 53.00 OK
r-release-windows-x86_64 0.1.6 8.00 76.00 84.00 OK
r-oldrel-macos-arm64 0.1.6 34.00 OK
r-oldrel-macos-x86_64 0.1.6 48.00 OK
r-oldrel-windows-x86_64 0.1.6 9.00 85.00 94.00 ERROR

Check Details

Version: 0.1.6
Check: Rd cross-references
Result: NOTE Found the following Rd file(s) with Rd \link{} targets missing package anchors: BenchmarkAggr.Rd: data.table autoplot.BenchmarkAggr.Rd: ggsave Please provide package anchors for all Rd \link{} targets not in the package itself and the base packages. Flavors: r-devel-linux-x86_64-debian-clang, r-devel-linux-x86_64-debian-gcc, r-devel-windows-x86_64

Version: 0.1.6
Check: examples
Result: ERROR Running examples in ‘mlr3benchmark-Ex.R’ failed The error most likely occurred in: > base::assign(".ptime", proc.time(), pos = "CheckExEnv") > ### Name: BenchmarkAggr > ### Title: Aggregated Benchmark Result Object > ### Aliases: BenchmarkAggr > > ### ** Examples > > # Not restricted to mlr3 objects > df = data.frame(tasks = factor(rep(c("A", "B"), each = 5), + levels = c("A", "B")), + learners = factor(paste0("L", 1:5)), + RMSE = runif(10), MAE = runif(10)) > as_benchmark_aggr(df, task_id = "tasks", learner_id = "learners") <BenchmarkAggr> of 10 rows with 2 tasks, 5 learners and 2 measures tasks learners RMSE MAE <fctr> <fctr> <num> <num> 1: A L1 0.26550866 0.2059746 2: A L2 0.37212390 0.1765568 3: A L3 0.57285336 0.6870228 4: A L4 0.90820779 0.3841037 5: A L5 0.20168193 0.7698414 6: B L1 0.89838968 0.4976992 7: B L2 0.94467527 0.7176185 8: B L3 0.66079779 0.9919061 9: B L4 0.62911404 0.3800352 10: B L5 0.06178627 0.7774452 > > if (requireNamespaces(c("mlr3", "rpart"))) { + library(mlr3) + task = tsks(c("boston_housing", "mtcars")) + learns = lrns(c("regr.featureless", "regr.rpart")) + bm = benchmark(benchmark_grid(task, learns, rsmp("cv", folds = 2))) + + # coercion + as_benchmark_aggr(bm) + } Error: Element with key 'boston_housing' not found in DictionaryTask! Execution halted Flavors: r-devel-linux-x86_64-debian-clang, r-devel-linux-x86_64-debian-gcc, r-patched-linux-x86_64

Version: 0.1.6
Check: tests
Result: ERROR Running ‘testthat.R’ [6s/11s] Running the tests in ‘tests/testthat.R’ failed. Complete output: > if (requireNamespace("testthat", quietly = TRUE)) { + library("testthat") + library("checkmate") # for more expect_*() functions + library("mlr3benchmark") + test_check("mlr3benchmark") + } INFO [01:43:44.604] [mlr3] Running benchmark with 18 resampling iterations INFO [01:43:44.902] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 1/3) INFO [01:43:44.985] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 2/3) INFO [01:43:45.049] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 3/3) INFO [01:43:45.090] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 1/3) INFO [01:43:45.160] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 2/3) INFO [01:43:45.215] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 3/3) INFO [01:43:45.286] [mlr3] Applying learner 'rpart2' on task 'iris' (iter 1/3) INFO [01:43:45.381] [mlr3] Applying learner 'rpart2' on task 'iris' (iter 2/3) INFO [01:43:45.441] [mlr3] Applying learner 'rpart2' on task 'iris' (iter 3/3) INFO [01:43:45.507] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 1/3) INFO [01:43:45.554] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 2/3) INFO [01:43:45.618] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 3/3) INFO [01:43:45.666] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 1/3) INFO [01:43:45.759] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 2/3) INFO [01:43:45.861] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 3/3) INFO [01:43:45.958] [mlr3] Applying learner 'rpart2' on task 'sonar' (iter 1/3) INFO [01:43:46.056] [mlr3] Applying learner 'rpart2' on task 'sonar' (iter 2/3) INFO [01:43:46.167] [mlr3] Applying learner 'rpart2' on task 'sonar' (iter 3/3) INFO [01:43:46.281] [mlr3] Finished benchmark [ FAIL 1 | WARN 4 | SKIP 0 | PASS 50 ] ══ Failed tests ════════════════════════════════════════════════════════════════ ── Error ('test_BenchmarkAggr.R:99:3'): mlr3 coercions ───────────────────────── Error: Element with key 'boston_housing' not found in DictionaryTask! Backtrace: ▆ 1. └─mlr3::tsks(c("boston_housing", "mtcars")) at test_BenchmarkAggr.R:99:3 2. └─mlr3misc::dictionary_sugar_mget(dict = mlr_tasks, .keys, ...) 3. └─base::lapply(.keys, dictionary_sugar_get, dict = dict, ...) 4. └─mlr3misc (local) FUN(X[[i]], ...) 5. └─mlr3misc:::dictionary_get(dict, .key) 6. └─mlr3misc:::dictionary_retrieve_item(self, key) 7. └─mlr3misc::stopf(...) [ FAIL 1 | WARN 4 | SKIP 0 | PASS 50 ] Error: Test failures Execution halted Flavor: r-devel-linux-x86_64-debian-clang

Version: 0.1.6
Check: tests
Result: ERROR Running ‘testthat.R’ [4s/5s] Running the tests in ‘tests/testthat.R’ failed. Complete output: > if (requireNamespace("testthat", quietly = TRUE)) { + library("testthat") + library("checkmate") # for more expect_*() functions + library("mlr3benchmark") + test_check("mlr3benchmark") + } INFO [16:22:11.263] [mlr3] Running benchmark with 18 resampling iterations INFO [16:22:11.378] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 1/3) INFO [16:22:11.434] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 2/3) INFO [16:22:11.477] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 3/3) INFO [16:22:11.508] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 1/3) INFO [16:22:11.552] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 2/3) INFO [16:22:11.592] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 3/3) INFO [16:22:11.613] [mlr3] Applying learner 'rpart2' on task 'iris' (iter 1/3) INFO [16:22:11.634] [mlr3] Applying learner 'rpart2' on task 'iris' (iter 2/3) INFO [16:22:11.656] [mlr3] Applying learner 'rpart2' on task 'iris' (iter 3/3) INFO [16:22:11.677] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 1/3) INFO [16:22:11.692] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 2/3) INFO [16:22:11.714] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 3/3) INFO [16:22:11.739] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 1/3) INFO [16:22:11.790] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 2/3) INFO [16:22:11.822] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 3/3) INFO [16:22:11.852] [mlr3] Applying learner 'rpart2' on task 'sonar' (iter 1/3) INFO [16:22:11.882] [mlr3] Applying learner 'rpart2' on task 'sonar' (iter 2/3) INFO [16:22:11.916] [mlr3] Applying learner 'rpart2' on task 'sonar' (iter 3/3) INFO [16:22:11.946] [mlr3] Finished benchmark [ FAIL 1 | WARN 4 | SKIP 0 | PASS 50 ] ══ Failed tests ════════════════════════════════════════════════════════════════ ── Error ('test_BenchmarkAggr.R:99:3'): mlr3 coercions ───────────────────────── Error: Element with key 'boston_housing' not found in DictionaryTask! Backtrace: ▆ 1. └─mlr3::tsks(c("boston_housing", "mtcars")) at test_BenchmarkAggr.R:99:3 2. └─mlr3misc::dictionary_sugar_mget(dict = mlr_tasks, .keys, ...) 3. └─base::lapply(.keys, dictionary_sugar_get, dict = dict, ...) 4. └─mlr3misc (local) FUN(X[[i]], ...) 5. └─mlr3misc:::dictionary_get(dict, .key) 6. └─mlr3misc:::dictionary_retrieve_item(self, key) 7. └─mlr3misc::stopf(...) [ FAIL 1 | WARN 4 | SKIP 0 | PASS 50 ] Error: Test failures Execution halted Flavor: r-devel-linux-x86_64-debian-gcc

Version: 0.1.6
Check: examples
Result: ERROR Running examples in ‘mlr3benchmark-Ex.R’ failed The error most likely occurred in: > ### Name: BenchmarkAggr > ### Title: Aggregated Benchmark Result Object > ### Aliases: BenchmarkAggr > > ### ** Examples > > # Not restricted to mlr3 objects > df = data.frame(tasks = factor(rep(c("A", "B"), each = 5), + levels = c("A", "B")), + learners = factor(paste0("L", 1:5)), + RMSE = runif(10), MAE = runif(10)) > as_benchmark_aggr(df, task_id = "tasks", learner_id = "learners") <BenchmarkAggr> of 10 rows with 2 tasks, 5 learners and 2 measures tasks learners RMSE MAE <fctr> <fctr> <num> <num> 1: A L1 0.26550866 0.2059746 2: A L2 0.37212390 0.1765568 3: A L3 0.57285336 0.6870228 4: A L4 0.90820779 0.3841037 5: A L5 0.20168193 0.7698414 6: B L1 0.89838968 0.4976992 7: B L2 0.94467527 0.7176185 8: B L3 0.66079779 0.9919061 9: B L4 0.62911404 0.3800352 10: B L5 0.06178627 0.7774452 > > if (requireNamespaces(c("mlr3", "rpart"))) { + library(mlr3) + task = tsks(c("boston_housing", "mtcars")) + learns = lrns(c("regr.featureless", "regr.rpart")) + bm = benchmark(benchmark_grid(task, learns, rsmp("cv", folds = 2))) + + # coercion + as_benchmark_aggr(bm) + } Error: Element with key 'boston_housing' not found in DictionaryTask! Execution halted Flavors: r-devel-linux-x86_64-fedora-clang, r-devel-linux-x86_64-fedora-gcc, r-devel-windows-x86_64, r-oldrel-windows-x86_64

Version: 0.1.6
Check: tests
Result: ERROR Running ‘testthat.R’ [11s/27s] Running the tests in ‘tests/testthat.R’ failed. Complete output: > if (requireNamespace("testthat", quietly = TRUE)) { + library("testthat") + library("checkmate") # for more expect_*() functions + library("mlr3benchmark") + test_check("mlr3benchmark") + } INFO [11:22:08.744] [mlr3] Running benchmark with 18 resampling iterations INFO [11:22:09.631] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 1/3) INFO [11:22:09.971] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 2/3) INFO [11:22:10.086] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 3/3) INFO [11:22:10.214] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 1/3) INFO [11:22:10.397] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 2/3) INFO [11:22:10.538] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 3/3) INFO [11:22:10.662] [mlr3] Applying learner 'rpart2' on task 'iris' (iter 1/3) INFO [11:22:10.818] [mlr3] Applying learner 'rpart2' on task 'iris' (iter 2/3) INFO [11:22:11.032] [mlr3] Applying learner 'rpart2' on task 'iris' (iter 3/3) INFO [11:22:11.233] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 1/3) INFO [11:22:11.423] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 2/3) INFO [11:22:11.575] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 3/3) INFO [11:22:11.676] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 1/3) INFO [11:22:11.935] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 2/3) INFO [11:22:12.235] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 3/3) INFO [11:22:12.482] [mlr3] Applying learner 'rpart2' on task 'sonar' (iter 1/3) INFO [11:22:12.743] [mlr3] Applying learner 'rpart2' on task 'sonar' (iter 2/3) INFO [11:22:12.980] [mlr3] Applying learner 'rpart2' on task 'sonar' (iter 3/3) INFO [11:22:13.296] [mlr3] Finished benchmark [ FAIL 1 | WARN 4 | SKIP 0 | PASS 50 ] ══ Failed tests ════════════════════════════════════════════════════════════════ ── Error ('test_BenchmarkAggr.R:99:3'): mlr3 coercions ───────────────────────── Error: Element with key 'boston_housing' not found in DictionaryTask! Backtrace: ▆ 1. └─mlr3::tsks(c("boston_housing", "mtcars")) at test_BenchmarkAggr.R:99:3 2. └─mlr3misc::dictionary_sugar_mget(dict = mlr_tasks, .keys, ...) 3. └─base::lapply(.keys, dictionary_sugar_get, dict = dict, ...) 4. └─mlr3misc (local) FUN(X[[i]], ...) 5. └─mlr3misc:::dictionary_get(dict, .key) 6. └─mlr3misc:::dictionary_retrieve_item(self, key) 7. └─mlr3misc::stopf(...) [ FAIL 1 | WARN 4 | SKIP 0 | PASS 50 ] Error: Test failures Execution halted Flavor: r-devel-linux-x86_64-fedora-clang

Version: 0.1.6
Check: tests
Result: ERROR Running ‘testthat.R’ [10s/43s] Running the tests in ‘tests/testthat.R’ failed. Complete output: > if (requireNamespace("testthat", quietly = TRUE)) { + library("testthat") + library("checkmate") # for more expect_*() functions + library("mlr3benchmark") + test_check("mlr3benchmark") + } INFO [13:55:30.227] [mlr3] Running benchmark with 18 resampling iterations INFO [13:55:31.249] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 1/3) INFO [13:55:31.524] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 2/3) INFO [13:55:31.650] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 3/3) INFO [13:55:31.775] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 1/3) INFO [13:55:32.013] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 2/3) INFO [13:55:32.192] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 3/3) INFO [13:55:32.380] [mlr3] Applying learner 'rpart2' on task 'iris' (iter 1/3) INFO [13:55:32.545] [mlr3] Applying learner 'rpart2' on task 'iris' (iter 2/3) INFO [13:55:32.715] [mlr3] Applying learner 'rpart2' on task 'iris' (iter 3/3) INFO [13:55:32.933] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 1/3) INFO [13:55:33.085] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 2/3) INFO [13:55:33.221] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 3/3) INFO [13:55:33.377] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 1/3) INFO [13:55:33.673] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 2/3) INFO [13:55:34.011] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 3/3) INFO [13:55:34.290] [mlr3] Applying learner 'rpart2' on task 'sonar' (iter 1/3) INFO [13:55:34.557] [mlr3] Applying learner 'rpart2' on task 'sonar' (iter 2/3) INFO [13:55:34.859] [mlr3] Applying learner 'rpart2' on task 'sonar' (iter 3/3) INFO [13:55:35.203] [mlr3] Finished benchmark [ FAIL 1 | WARN 4 | SKIP 0 | PASS 50 ] ══ Failed tests ════════════════════════════════════════════════════════════════ ── Error ('test_BenchmarkAggr.R:99:3'): mlr3 coercions ───────────────────────── Error: Element with key 'boston_housing' not found in DictionaryTask! Backtrace: ▆ 1. └─mlr3::tsks(c("boston_housing", "mtcars")) at test_BenchmarkAggr.R:99:3 2. └─mlr3misc::dictionary_sugar_mget(dict = mlr_tasks, .keys, ...) 3. └─base::lapply(.keys, dictionary_sugar_get, dict = dict, ...) 4. └─mlr3misc (local) FUN(X[[i]], ...) 5. └─mlr3misc:::dictionary_get(dict, .key) 6. └─mlr3misc:::dictionary_retrieve_item(self, key) 7. └─mlr3misc::stopf(...) [ FAIL 1 | WARN 4 | SKIP 0 | PASS 50 ] Error: Test failures Execution halted Flavor: r-devel-linux-x86_64-fedora-gcc

Version: 0.1.6
Check: tests
Result: ERROR Running 'testthat.R' [5s] Running the tests in 'tests/testthat.R' failed. Complete output: > if (requireNamespace("testthat", quietly = TRUE)) { + library("testthat") + library("checkmate") # for more expect_*() functions + library("mlr3benchmark") + test_check("mlr3benchmark") + } INFO [05:33:28.188] [mlr3] Running benchmark with 18 resampling iterations INFO [05:33:28.297] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 1/3) INFO [05:33:28.333] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 2/3) INFO [05:33:28.351] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 3/3) INFO [05:33:28.369] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 1/3) INFO [05:33:28.396] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 2/3) INFO [05:33:28.422] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 3/3) INFO [05:33:28.447] [mlr3] Applying learner 'rpart2' on task 'iris' (iter 1/3) INFO [05:33:28.473] [mlr3] Applying learner 'rpart2' on task 'iris' (iter 2/3) INFO [05:33:28.499] [mlr3] Applying learner 'rpart2' on task 'iris' (iter 3/3) INFO [05:33:28.532] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 1/3) INFO [05:33:28.546] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 2/3) INFO [05:33:28.559] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 3/3) INFO [05:33:28.577] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 1/3) INFO [05:33:28.612] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 2/3) INFO [05:33:28.640] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 3/3) INFO [05:33:28.685] [mlr3] Applying learner 'rpart2' on task 'sonar' (iter 1/3) INFO [05:33:28.726] [mlr3] Applying learner 'rpart2' on task 'sonar' (iter 2/3) INFO [05:33:28.765] [mlr3] Applying learner 'rpart2' on task 'sonar' (iter 3/3) INFO [05:33:28.811] [mlr3] Finished benchmark [ FAIL 1 | WARN 4 | SKIP 0 | PASS 50 ] ══ Failed tests ════════════════════════════════════════════════════════════════ ── Error ('test_BenchmarkAggr.R:99:3'): mlr3 coercions ───────────────────────── Error: Element with key 'boston_housing' not found in DictionaryTask! Backtrace: ▆ 1. └─mlr3::tsks(c("boston_housing", "mtcars")) at test_BenchmarkAggr.R:99:3 2. └─mlr3misc::dictionary_sugar_mget(dict = mlr_tasks, .keys, ...) 3. └─base::lapply(.keys, dictionary_sugar_get, dict = dict, ...) 4. └─mlr3misc (local) FUN(X[[i]], ...) 5. └─mlr3misc:::dictionary_get(dict, .key) 6. └─mlr3misc:::dictionary_retrieve_item(self, key) 7. └─mlr3misc::stopf(...) [ FAIL 1 | WARN 4 | SKIP 0 | PASS 50 ] Error: Test failures Execution halted Flavor: r-devel-windows-x86_64

Version: 0.1.6
Check: tests
Result: ERROR Running ‘testthat.R’ [6s/6s] Running the tests in ‘tests/testthat.R’ failed. Complete output: > if (requireNamespace("testthat", quietly = TRUE)) { + library("testthat") + library("checkmate") # for more expect_*() functions + library("mlr3benchmark") + test_check("mlr3benchmark") + } INFO [01:43:35.226] [mlr3] Running benchmark with 18 resampling iterations INFO [01:43:35.376] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 1/3) INFO [01:43:35.413] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 2/3) INFO [01:43:35.433] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 3/3) INFO [01:43:35.460] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 1/3) INFO [01:43:35.490] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 2/3) INFO [01:43:35.517] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 3/3) INFO [01:43:35.543] [mlr3] Applying learner 'rpart2' on task 'iris' (iter 1/3) INFO [01:43:35.569] [mlr3] Applying learner 'rpart2' on task 'iris' (iter 2/3) INFO [01:43:35.596] [mlr3] Applying learner 'rpart2' on task 'iris' (iter 3/3) INFO [01:43:35.646] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 1/3) INFO [01:43:35.674] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 2/3) INFO [01:43:35.695] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 3/3) INFO [01:43:35.715] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 1/3) INFO [01:43:35.756] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 2/3) INFO [01:43:35.797] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 3/3) INFO [01:43:35.839] [mlr3] Applying learner 'rpart2' on task 'sonar' (iter 1/3) INFO [01:43:35.890] [mlr3] Applying learner 'rpart2' on task 'sonar' (iter 2/3) INFO [01:43:35.941] [mlr3] Applying learner 'rpart2' on task 'sonar' (iter 3/3) INFO [01:43:36.029] [mlr3] Finished benchmark [ FAIL 1 | WARN 4 | SKIP 0 | PASS 50 ] ══ Failed tests ════════════════════════════════════════════════════════════════ ── Error ('test_BenchmarkAggr.R:99:3'): mlr3 coercions ───────────────────────── Error: Element with key 'boston_housing' not found in DictionaryTask! Backtrace: ▆ 1. └─mlr3::tsks(c("boston_housing", "mtcars")) at test_BenchmarkAggr.R:99:3 2. └─mlr3misc::dictionary_sugar_mget(dict = mlr_tasks, .keys, ...) 3. └─base::lapply(.keys, dictionary_sugar_get, dict = dict, ...) 4. └─mlr3misc (local) FUN(X[[i]], ...) 5. └─mlr3misc:::dictionary_get(dict, .key) 6. └─mlr3misc:::dictionary_retrieve_item(self, key) 7. └─mlr3misc::stopf(...) [ FAIL 1 | WARN 4 | SKIP 0 | PASS 50 ] Error: Test failures Execution halted Flavor: r-patched-linux-x86_64

Version: 0.1.6
Check: tests
Result: ERROR Running 'testthat.R' [7s] Running the tests in 'tests/testthat.R' failed. Complete output: > if (requireNamespace("testthat", quietly = TRUE)) { + library("testthat") + library("checkmate") # for more expect_*() functions + library("mlr3benchmark") + test_check("mlr3benchmark") + } INFO [06:07:23.829] [mlr3] Running benchmark with 18 resampling iterations INFO [06:07:24.019] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 1/3) INFO [06:07:24.079] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 2/3) INFO [06:07:24.106] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 3/3) INFO [06:07:24.133] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 1/3) INFO [06:07:24.175] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 2/3) INFO [06:07:24.222] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 3/3) INFO [06:07:24.259] [mlr3] Applying learner 'rpart2' on task 'iris' (iter 1/3) INFO [06:07:24.298] [mlr3] Applying learner 'rpart2' on task 'iris' (iter 2/3) INFO [06:07:24.327] [mlr3] Applying learner 'rpart2' on task 'iris' (iter 3/3) INFO [06:07:24.396] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 1/3) INFO [06:07:24.424] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 2/3) INFO [06:07:24.452] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 3/3) INFO [06:07:24.481] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 1/3) INFO [06:07:24.534] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 2/3) INFO [06:07:24.772] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 3/3) INFO [06:07:24.826] [mlr3] Applying learner 'rpart2' on task 'sonar' (iter 1/3) INFO [06:07:24.885] [mlr3] Applying learner 'rpart2' on task 'sonar' (iter 2/3) INFO [06:07:24.936] [mlr3] Applying learner 'rpart2' on task 'sonar' (iter 3/3) INFO [06:07:25.005] [mlr3] Finished benchmark [ FAIL 1 | WARN 4 | SKIP 0 | PASS 50 ] ══ Failed tests ════════════════════════════════════════════════════════════════ ── Error ('test_BenchmarkAggr.R:99:3'): mlr3 coercions ───────────────────────── Error: Element with key 'boston_housing' not found in DictionaryTask! Backtrace: ▆ 1. └─mlr3::tsks(c("boston_housing", "mtcars")) at test_BenchmarkAggr.R:99:3 2. └─mlr3misc::dictionary_sugar_mget(dict = mlr_tasks, .keys, ...) 3. └─base::lapply(.keys, dictionary_sugar_get, dict = dict, ...) 4. └─mlr3misc (local) FUN(X[[i]], ...) 5. └─mlr3misc:::dictionary_get(dict, .key) 6. └─mlr3misc:::dictionary_retrieve_item(self, key) 7. └─mlr3misc::stopf(...) [ FAIL 1 | WARN 4 | SKIP 0 | PASS 50 ] Error: Test failures Execution halted Flavor: r-oldrel-windows-x86_64