Bencher-Backend
view release on metacpan or search on metacpan
- Turn on with_process_size by default when in module_startup mode
on linux.
1.031 2016-11-23 Released-By: PERLANCAR
- Record scenario file's mtime and checksums (MD5, SHA1, SHA256) in
result metadata.
1.030 2016-10-28 Released-By: PERLANCAR
- [ux] Provide completion for --sort/--sorts.
1.029 2016-10-27 Released-By: PERLANCAR
- Add argument: scenario (to pass scenario data structure).
1.028 2016-10-20 Released-By: PERLANCAR
- Do not require Sys::Load on Windows because it doesn't install there.
Bencher now works on Windows.
1.027 2016-10-14 Released-By: PERLANCAR
- Add options: --exclude-xs-modules (--noxs) --exclude-pp-modules
(--nopp).
1.026 2016-10-13 Released-By: PERLANCAR
- Add hooks before_parse_{datasets,participants} and deprecated
before_list_{datasets,participants}. To generate
datasets/participants dynamically, use the before_parse_* hooks
because the datasets/participants can later still be filtered.
- Add hooks 'before_test_item' & 'after_test_item'.
1.025 2016-10-09 Released-By: PERLANCAR
- [Bugfix] Several bug fixes.
- Add property/option 'test' to skip testing participant code prior to
benchmarking. Useful if code runs for at least a few seconds and we
don't want to wait for too long.
1.024 2016-10-09 Released-By: PERLANCAR
- [Incompatible change] Remove action 'bench-with-benchmark-pm' (see
below to run benchmark with Benchmark.pm).
- Add property/option 'runner' which can be the default
'Benchmark::Dumb', or 'Benchmark', or the new
'Benchmark::Dumb::SimpleTime' which can be used if you want to
benchmark code that runs for at least a few seconds with very few
iterations (like 1 or 2) without "Number of runs too small" warning
from Benchmark::Dumb.
1.023 2016-09-09 Released-By: PERLANCAR
- Aside from observing per-dataset 'result' property, also observe
scenario's 'result' property for when we don't have any datasets.
1.022 2016-09-09 Released-By: PERLANCAR
- [workaround] Some completions were broken because we use
'str_comma_sep' coercion rules for --include-path, this is
because include_path is now a string instead or array[str] before
validation+coercion, and completion currently does not use
Data::Sah, so now we disable this coercion rule for now.
1.021 2016-08-26 Released-By: PERLANCAR
- Introduce --with-args-sizes.
1.020 2016-08-24 Released-By: PERLANCAR
- [Incompatible change] Rename options for consistency
--include-process-size to --with-process-size,
--include-result-size to --with-result-size (--include-* are for
filter options).
- [ux] Add completion for comma-separated filter options, e.g.
--include-participants, --exclude-dataset-seqs, etc.
1.019 2016-08-24 Released-By: PERLANCAR
- [ux] Allow specifying options like --include-datasets with
comma-separated value, so --include-datasets 1,2,3 instead of
--include-dataset 1 --include-dataset 2 --include-dataset 3 or
--include-datasets-json '[1,2,3]'.
- [Bugfix][Regression] Accidentally removed a code to permute
dataset, breaking v1.018.
1.018 2016-08-20 Released-By: PERLANCAR
- UPDATE: this release is broken, don't use.
[NEW FEATURES]
- Allow items to be benchmarked using Benchmark.pm instead of
Benchmark::Dumb. To do this, specify bencher option
--bench-with-benchmark-pm. Currently if you do this, the raw result
from Benchmark.pm will be used and no result table will be
returned/saved. Also don't forget to set --benchmark-pm-count when
appropriate (the default is -0.5).
- Introduce scenario property 'env_hashes' (can also be set from the CLI
using --env-hash). This allows permuting multiple environment variable
( run in 1.041 second using v1.01-cache-2.11-cpan-71847e10f99 )