mirror of
https://github.com/ROCm/composable_kernel.git
synced 2026-04-18 06:00:30 +00:00
270b1445b1
Add multi-file trace parsing and analysis pipeline MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit Extends build time analysis from ROCm/composable_kernel#3644 to handle multiple trace files across build directories (see #4229): - pipeline.py: Generic pipeline framework with fluent interface for composable data processing. Provides parallel processing, progress tracking, and error handling independent of trace-specific code. Processes thousands of trace files at default resolution in minutes, aggregating results into in-memory DataFrames for analysis. - parse_build.py: Parse all trace files in a build directory - build_analysis_example.ipynb: Demonstrates pipeline aggregation across all build files The pipeline design improves capability (composable operations), performance (parallel processing), and user-friendliness (fluent API) of the analysis modules. It enables analyzing compilation patterns across the entire codebase with all trace data available in pandas DataFrames for interactive exploration.
25 lines
403 B
Plaintext
25 lines
403 B
Plaintext
# Build Trace Analysis - Python Dependencies
|
|
|
|
# Core data processing
|
|
pandas>=2.0.0
|
|
orjson>=3.9.0
|
|
|
|
# Statistical analysis
|
|
statsmodels>=0.14.0
|
|
|
|
# Jupyter notebook support
|
|
nbformat>=4.2.0
|
|
ipykernel>=6.0.0
|
|
|
|
# Interactive visualizations
|
|
plotly>=5.0.0
|
|
|
|
# Static image export from Plotly
|
|
kaleido>=0.2.0
|
|
|
|
# Full Jupyter environment (if not using VSCode)
|
|
jupyter>=1.0.0
|
|
|
|
# Progress meter in notebook
|
|
tqdm>=4.0.0
|