[PR #494] [MERGED] Add RDMA support for hybrid-EP #595

New issue

Closed

opened 2026-10-27 21:04:22 +00:00 by bsakaguchi · 0 comments

bsakaguchi commented

2026-10-27 21:04:22 +00:00

Owner

📋 Pull Request Information

Original PR: https://github.com/deepseek-ai/DeepEP/pull/494
Author: @Autumn1998
Created: 11/14/2025
Status: ✅ Merged
Merged: 11/18/2025
Merged by: @jershi425

Base: hybrid-ep ← Head: tongliu/inter_node

📝 Commits (10+)

8fcaea2 init 3rd party
507f358 rdma dependency
8b960f4 inter-node
2871bb8 The left part of the inter-node
2e20529 Merge remote-tracking branch 'origin/hybrid-ep' into tongliu/inter_node
2313535 make compiler work
aa1fcd4 fix bug
5c11072 fix bugs, make it runnable on the intra-node case
aa3740b fix some bug
217b5b1 fix jit

📊 Changes

21 files changed (+2285 additions, -385 deletions)

View changed files

➕ .gitmodules (+3 -0)
📝 Hybrid-EP_Implementation.md (+65 -9)
📝 csrc/hybrid_ep/allocator/allocator.cu (+6 -6)
📝 csrc/hybrid_ep/allocator/allocator.cuh (+2 -2)
📝 csrc/hybrid_ep/backend/hybrid_ep_backend.cuh (+671 -49)
📝 csrc/hybrid_ep/backend/utils.cuh (+132 -42)
📝 csrc/hybrid_ep/config.cuh (+4 -2)
📝 csrc/hybrid_ep/executor/executor.cu (+45 -15)
📝 csrc/hybrid_ep/executor/executor.cuh (+1 -1)
📝 csrc/hybrid_ep/hybrid_ep.cu (+115 -125)
📝 csrc/hybrid_ep/hybrid_ep.cuh (+14 -3)
➕ csrc/hybrid_ep/internode.cu (+721 -0)
➕ csrc/hybrid_ep/internode.cuh (+194 -0)
📝 csrc/hybrid_ep/jit/compiler.cu (+46 -25)
📝 csrc/hybrid_ep/jit/compiler.cuh (+4 -2)
📝 csrc/hybrid_ep/pybind_hybrid_ep.cu (+30 -14)
📝 deep_ep/hybrid_ep_buffer.py (+51 -22)
📝 setup.py (+79 -10)
📝 tests/test_hybrid_ep.py (+79 -52)
📝 tests/utils.py (+22 -6)

...and 1 more files

📄 Description

Add the RDMA support of hybrid-ep

_{🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.}

## 📋 Pull Request Information **Original PR:** https://github.com/deepseek-ai/DeepEP/pull/494 **Author:** [@Autumn1998](https://github.com/Autumn1998) **Created:** 11/14/2025 **Status:** ✅ Merged **Merged:** 11/18/2025 **Merged by:** [@jershi425](https://github.com/jershi425) **Base:** `hybrid-ep` ← **Head:** `tongliu/inter_node` --- ### 📝 Commits (10+) - [`8fcaea2`](https://github.com/deepseek-ai/DeepEP/commit/8fcaea2067135909eccf398b0141f90e865034fe) init 3rd party - [`507f358`](https://github.com/deepseek-ai/DeepEP/commit/507f358ef736db82af370700663b2b60c1cd5570) rdma dependency - [`8b960f4`](https://github.com/deepseek-ai/DeepEP/commit/8b960f428fd4edfeb3081ebe225215582edc39cc) inter-node - [`2871bb8`](https://github.com/deepseek-ai/DeepEP/commit/2871bb8022bdc8ec8082463b09e96ef2356ad1cd) The left part of the inter-node - [`2e20529`](https://github.com/deepseek-ai/DeepEP/commit/2e205290b1c2828bf62bc2993f234d06b193236a) Merge remote-tracking branch 'origin/hybrid-ep' into tongliu/inter_node - [`2313535`](https://github.com/deepseek-ai/DeepEP/commit/2313535d73a65ac478b3fbae794d9659d34200d8) make compiler work - [`aa1fcd4`](https://github.com/deepseek-ai/DeepEP/commit/aa1fcd410d13aac6afb937894890a5e600998cc0) fix bug - [`5c11072`](https://github.com/deepseek-ai/DeepEP/commit/5c110724e5c5945e999237263711a793e1380847) fix bugs, make it runnable on the intra-node case - [`aa3740b`](https://github.com/deepseek-ai/DeepEP/commit/aa3740bc876ad2e57f8701db7be60a50524aaeed) fix some bug - [`217b5b1`](https://github.com/deepseek-ai/DeepEP/commit/217b5b10cfc61907b1a81758d2b79092b36e4f22) fix jit ### 📊 Changes **21 files changed** (+2285 additions, -385 deletions) <details> <summary>View changed files</summary> ➕ `.gitmodules` (+3 -0) 📝 `Hybrid-EP_Implementation.md` (+65 -9) 📝 `csrc/hybrid_ep/allocator/allocator.cu` (+6 -6) 📝 `csrc/hybrid_ep/allocator/allocator.cuh` (+2 -2) 📝 `csrc/hybrid_ep/backend/hybrid_ep_backend.cuh` (+671 -49) 📝 `csrc/hybrid_ep/backend/utils.cuh` (+132 -42) 📝 `csrc/hybrid_ep/config.cuh` (+4 -2) 📝 `csrc/hybrid_ep/executor/executor.cu` (+45 -15) 📝 `csrc/hybrid_ep/executor/executor.cuh` (+1 -1) 📝 `csrc/hybrid_ep/hybrid_ep.cu` (+115 -125) 📝 `csrc/hybrid_ep/hybrid_ep.cuh` (+14 -3) ➕ `csrc/hybrid_ep/internode.cu` (+721 -0) ➕ `csrc/hybrid_ep/internode.cuh` (+194 -0) 📝 `csrc/hybrid_ep/jit/compiler.cu` (+46 -25) 📝 `csrc/hybrid_ep/jit/compiler.cuh` (+4 -2) 📝 `csrc/hybrid_ep/pybind_hybrid_ep.cu` (+30 -14) 📝 `deep_ep/hybrid_ep_buffer.py` (+51 -22) 📝 `setup.py` (+79 -10) 📝 `tests/test_hybrid_ep.py` (+79 -52) 📝 `tests/utils.py` (+22 -6) _...and 1 more files_ </details> ### 📄 Description Add the RDMA support of hybrid-ep --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>

bsakaguchi

2026-10-27 21:04:22 +00:00

closed this issue
added the
pull-request
label

No labels

pull-request

No milestone

No project

No assignees

1 participant

Notifications

Due date

The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference

deepseek-ai/DeepEP#595

No description provided.

Rows
Columns