Enable efficient 16-rank HT EP

Extend direct-fabric HT launch and runtime support to 16 ranks. Decouple TMA contributor staging from global rank discovery and restore adaptive warp geometry.

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
This commit is contained in:
Binyang Li
2026-07-15 06:35:34 +00:00
parent bb58d5e42b
commit 5ebbd340bb
6 changed files with 49 additions and 17 deletions

View File

@@ -152,7 +152,7 @@ specialized advanced path.
The active implementation supports `mode=MoEMode.LOW_LATENCY` and
`mode=MoEMode.HIGH_THROUGHPUT`. `mode` must be a `MoEMode` enum value, not a
string. LL uses an expert-major output layout. HT uses a flat output layout and
supports only 2, 4, or 8 ranks within one detected GPU IPC/NVL fabric domain;
supports 2, 4, 8, or 16 ranks within one detected GPU IPC/NVL fabric domain;
that domain may span multiple hosts.
```python