mscclpp

mirror of https://github.com/microsoft/mscclpp.git synced 2026-05-11 17:00:22 +00:00

Files

Binyang Li 2c52937b26 Fix FP8 ROCm build/test issues and dtype naming (#792 )

## Summary
- Fix ROCm FP8 build failure by using the actual FP8 `DataType` enum
constants in allreduce packet tuning.
- Fix FP8 E4M3FNUZ test encoding so small negative values do not produce
the FNUZ NaN byte (`0x80`).
- Align FP8 `DataType` enum constants and Python bindings with
torch-style names (`FLOAT8_E4M3FN`, `FLOAT8_E4M3FNUZ`, `FLOAT8_E5M2FNUZ`
/ `float8_e4m3fn`, `float8_e4m3fnuz`, `float8_e5m2fnuz`).

## Validation
- `./tools/lint.sh`
- `make -j` from `build/`
- `mpirun --allow-run-as-root -np 8 python3 -m pytest
python/test/test_fp8_accum.py -q` (`36 passed, 9 skipped`)
- `DTYPE=float8_e4m3fnuz ACCUM_DTYPE=float32 torchrun --nnodes=1
--nproc_per_node=8
examples/torch-integration/customized_comm_with_tuning.py`

---------

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>

2026-04-28 15:02:22 -07:00

csrc

Fix FP8 ROCm build/test issues and dtype naming (#792 )

2026-04-28 15:02:22 -07:00

mscclpp

Fix FP8 ROCm build/test issues and dtype naming (#792 )

2026-04-28 15:02:22 -07:00

mscclpp_benchmark

Torch integration (#692 )

2026-01-21 20:32:24 -08:00

test

Fix FP8 ROCm build/test issues and dtype naming (#792 )