mirror of
https://github.com/deepseek-ai/DeepEP.git
synced 2026-11-05 00:47:32 +00:00
[GH-ISSUE #90] Consultation on the maximum number of nodes supported by internode #83
Labels
No labels
pull-request
No milestone
No project
No assignees
1 participant
Notifications
Due date
No due date set.
Dependencies
No dependencies set.
Reference
deepseek-ai/DeepEP#83
Loading…
Add table
Add a link
Reference in a new issue
No description provided.
Delete branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Originally created by @yeliang2258 on GitHub (Mar 25, 2025).
Original GitHub issue: https://github.com/deepseek-ai/DeepEP/issues/90
From the code, does DeepEP internode currently support a maximum of 32 nodes and up to 256 GPUs ?
@LyricZhao commented on GitHub (Mar 26, 2025):
Normal kernels supports EP2/4/8/16/32/64/144/160.
No hard limit for low-latency kernels, but it may depends on the number of experts and SMs. Generally speaking, for V3/R1, low-latency kernels support up to EP320 (tested).
@yeliang2258 commented on GitHub (Mar 26, 2025):
Got it, thank you very much for your reply