Update comparison script.

Browse Source

- Handle multiple benchmarks.
- Split output to resemble nvbench markdown output:
  - Headings for benchmarks / devices
  - Compact tables with axis values / stats
- Handle `null` stdev (these are infinite, e.g. too few samples)
- Format numbers, times, percentages similar to nvbench.
- Add summary of total/pass/unknown/failure stats
- Add new test.json files (with multiple benchmarks in each)

...

This commit is contained in:

Allison Vacanti

2021-06-22 16:15:22 -04:00

parent 668a98ef16

commit 861f66c161

4 changed files with 46286 additions and 3923 deletions

Show all changes Ignore whitespace when comparing lines Ignore changes in amount of whitespace Ignore changes in whitespace at EOL

Download Patch File Download Diff File Expand all files Collapse all files

23045

scripts/test_cmp.json Normal file

File diff suppressed because it is too large Load Diff