Commit Graph

6 Commits

Author SHA1 Message Date
Oleksandr Pavlyk
d74c06f4b7 Harden nvbench-compare CLI failure handling
Apply the same small stability fixes to the modern and legacy compare scripts:
report malformed nested JSON through the structured parse-error path, reject
directory comparisons that produce no matching JSON files, use the supported
pipe table format for old tabulate versions, and retitle the summary plot as a
GPU timing change.

Add regression coverage for the modern comparator error paths and output
formatting.
2026-07-14 16:49:28 -05:00
Oleksandr Pavlyk
0f6e712b8f Fix bulk debug paths and duplicate plot series
Emit absolute sidecar paths in bulk-debug rows so generated debug scripts can
be replayed from a different working directory.

Also include duplicate state occurrence information in --plot-along series keys
for both modern and legacy comparators, preventing later duplicate states from
overwriting earlier plotted series.

Add regression coverage for absolute bulk-debug paths and duplicate plot-along
series.
2026-07-14 16:40:31 -05:00
Oleksandr Pavlyk
7d0940275c Remove unused parameters and unreachable code 2026-07-14 16:17:55 -05:00
Oleksandr Pavlyk
45cea23c89 Fix formatting of negative durations 2026-07-14 16:14:19 -05:00
Oleksandr Pavlyk
25005fc9c4 Address review feedback for Python tooling scripts
Tighten missing-dependency install hints so compare-only dependencies point
to cuda-bench[compare] and plotting/dataframe dependencies point to
cuda-bench[plot], instead of defaulting every script to the broader tools
extra.

Also harden nvbench_compare_legacy by reporting missing or skipped state
summaries as UNKNOWN rows instead of silently dropping them, and by converting
missing axis metadata into the existing JSON-structure error path rather than
leaking StopIteration.

Finally, consolidate duplicate finite-number predicates in both compare
scripts so duration formatting and numeric validation share the same helper.
2026-07-09 16:50:36 -05:00
Oleksandr Pavlyk
cc17e96c3b Add nvbench-compare-legacy 2026-07-09 15:22:08 -05:00