[GH-ISSUE #666] Would deepep work in a hybrid GPU networking topology inside a single node(intronode)? #392

Open
opened 2026-10-26 09:59:59 +00:00 by bsakaguchi · 0 comments
Owner

Originally created by @shrutimohanty on GitHub (Jun 15, 2026).
Original GitHub issue: https://github.com/deepseek-ai/DeepEP/issues/666

Hi,

I have a node as follows:
NUMA 0:
GPU0-GPU1: NVLink pair
GPU2-GPU3: NVLink pair
Cross between those pairs: NODE/PCIe

NUMA 1:
GPU4-GPU5: NVLink pair

Cross NUMA:
GPU0-3 <-> GPU4-5: SYS/PCIe + CPU interconnect

Would I be able to use DeepEP for EP = 4 in this setup? Please do let me know if it's possible.

Originally created by @shrutimohanty on GitHub (Jun 15, 2026). Original GitHub issue: https://github.com/deepseek-ai/DeepEP/issues/666 Hi, I have a node as follows: NUMA 0: GPU0-GPU1: NVLink pair GPU2-GPU3: NVLink pair Cross between those pairs: NODE/PCIe NUMA 1: GPU4-GPU5: NVLink pair Cross NUMA: GPU0-3 <-> GPU4-5: SYS/PCIe + CPU interconnect Would I be able to use DeepEP for EP = 4 in this setup? Please do let me know if it's possible.
Sign in to join this conversation.
No labels
pull-request
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
deepseek-ai/DeepEP#392
No description provided.