Changes in version 2024.11.15 - only run tests that involve Matrix if it is available. - row -> column names in error message for custom units. - New feature: atime(result=fun) means that fun will be applied to the output of each expression, and that result will be saved. Useful when you want to specify a custom unit, with a function that returns a 1-row data frame, that can be applied to each expression. Changes in version 2024.11.8 - only run tests that involve plotting if ggplot2 is available, to fix CRAN noSuggests issue, https://github.com/tdhock/atime/issues/67 Changes in version 2024.11.5 - new feature: atime_grid() stores a data table of parameters that were specified as input, with corresponding new column names in - atime() measurements table, - references_best() measurements and plot.references tables, - predict() tables: measurements and predictions tables. - new sparse vignette which shows how to make a custom plot with facets defined by variables that were used in atime_grid(). Changes in version 2024.10.5 - bugfix: atime_test again outputs historical versions which were specified in ... Changes in version 2024.10.3 - atime_pkg generates files such as _test_name_.png with underscores instead of special characters such as > which are not supported on some file systems, including github actions (https://github.com/tdhock/atime/issues/62). - atime and atime_versions gain N.env.parent arg, which is set by atime_pkg to environment created for evaluation of atime/tests.R code. N.env.parent is the parent env of N.env, the environment in which code is run for a given data size N. So now setup in tests can refer to variables defined in atime/tests.R. Changes in version 2024.9.27 - atime_pkg tests_preview_facet.png width fixed/smaller (was same as width of tests_all_facet.png). Changes in version 2024.9.25 - atime_pkg creates tests_preview_facet.png if N.tests.preview (default 4, can be defined in atime/tests.R) is less than the number of test cases. It should be informative even when zoomed out, since it shows only the test cases which had smallest p-values (most significant differences between HEAD and min). Recommended for display as thumbnail/preview image with links to the larger tests_preview_all.png that includes all test results (which may not be readable/informative unless you zoom/scroll, if there are 10+ tests). Changes in version 2024.9.23 - atime_pkg_test_info returns un-evaluated calls to atime_versions, to make it easier to run one test at a time. - atime_versions result list contains bench.seconds and install.seconds, to compare how much time is spent in each step. atime_pkg also writes total install time over all test cases to install_seconds.txt. - atime_pkg tests_all_facet.png now has ggtitle with number of plots and p-value interpretation. Changes in version 2024.8.11 - atime_test_list evaluates any arguments that are copied to each test, except setup and expr. Changes in version 2024.8.8 - plot.references_best now only adds geom_hline if there is at least one row with unit=="seconds" in measurements or plot.references. Changes in version 2024.8.7 - list returned by references_best contains new element "plot.references" which was previously computed in plot method, and now can be changed by user, to customize the references shown by plot method. Changes in version 2024.7.12 - atime_versions has default_N(), same as atime. Changes in version 2024.5.17 - atime_versions_exprs better error message, one instance of pkg:: (two colons instead of one), thanks @MichaelChirico for the suggestion. Changes in version 2024.4.23 - Fix test-CRAN.R: kilobytes is not available on some systems. - added atime_test and atime_test_list for convenience in test definitions. - atime_versions_exprs now errors if expr has no Package: in code. Changes in version 2024.4.17 - New, simpler method for defining additional units to analyze (other than kilobytes and seconds): if result is data frame with 1 row, numeric columns are used as additional units. Arguments unit.col.vec and more.units have been removed from references_best. - atime_pkg version names HEAD/base/CRAN defined in R color names are now translated to their expanded names on the plot (CRAN=1.15.0 etc), and default colors were added for Slow and Fast. Changes in version 2024.4.12 - atime_pkg gains tests.dir arg, thanks @MichaelChirico for the suggestion. - atime no longer keeps memory column (sometimes too large) from bench::mark. Changes in version 2024.3.5 - if(requireNamespace("nc")) in tests, thanks CRAN. Changes in version 2024.2.13 - atime_grid gains new argument symbol.params, and more informative error messages. Changes in version 2024.1.31 - modify predict tests to use length.num instead of kilobytes (fails on CRAN). - improved error message for predict when unit value is out of range of data. Changes in version 2024.1.24 - improved documentation for atime_versions and atime_versions_exprs. - results argument of atime_versions renamed to result, for consistency with atime. Changes in version 2023.12.4 - improved documentation for atime_pkg, which clarifies that SHA versions and pkg.edit.fun may be specified in test.list elements. Changes in version 2023.11.11 - new function get_sha_vec, which is called in atime_versions_exprs, to check for correctly specified versions (new helpful errors when versions are not specified correctly) - atime_versions_install now uses R CMD INSTALL instead of install.packages, so we can stop with an error if there was some problem with installation. Changes in version 2023.10.9 - default and errors for N in atime. - warning if only one N evaluated in atime. - error if no SHA specified in atime_versions. - regex vignette/test uses re2 if present. Changes in version 2023.4.27 - predict.references_best(kilobytes=1000) etc. Changes in version 2023.3.31 - delete test which failed on CRAN. Changes in version 2023.3.30 - atime_grid(list(VAR="one value")) no longer errors. Changes in version 2023.1.24 - new function atime_pkg with vignette ci.Rmd. Changes in version 2022.12.14 - new function atime_grid. - atime argument results changed to result to be consistent with result column of output. Changes in version 2022.9.16 - if(FALSE) in atime_versions*.Rd examples, for CRAN. Changes in version 2022.9.8 - git vignette uses eval=F, .libPaths under /tmp, for CRAN. - try() in binseg and cum_median vignettes, for CRAN. Changes in version 2022.8.25 - remove callr in examples (keep in vignette). Changes in version 2022.8.24 - CRAN suggestions. Changes in version 2022.8.16 - use callr in examples/vignettes to avoid CRAN warnings. Changes in version 2022.7.26 - new vignette: data.table. - new atime_versions_exprs function. Changes in version 2022.7.22 - new vignette: git. - new atime_versions function. Changes in version 2022.7.20 - new vignettes: cum_median, PeakSegDisk. - new references_best function. Changes in version 2022.7.13 - initial version with atime function. - vignettes: regex, binseg, optseg.