[PR #438] [MERGED] Support CUDA Graph for internode dispatch normal kernel #570

Closed
opened 2026-10-27 21:04:08 +00:00 by bsakaguchi · 0 comments
Owner

📋 Pull Request Information

Original PR: https://github.com/deepseek-ai/DeepEP/pull/438
Author: @yifeizhang-c
Created: 9/30/2025
Status: ✅ Merged
Merged: 11/5/2025
Merged by: @sphish

Base: main ← Head: enable-internode-cuda-graph


📝 Commits (1)

  • d5e6717 Enable CUDA Graph for internode dispatch

📊 Changes

6 files changed (+93 additions, -37 deletions)

View changed files

📝 csrc/deep_ep.cpp (+30 -22)
📝 csrc/deep_ep.hpp (+1 -0)
📝 csrc/kernels/api.cuh (+2 -0)
📝 csrc/kernels/internode.cu (+37 -9)
📝 deep_ep/buffer.py (+5 -6)
📝 tests/test_internode.py (+18 -0)

📄 Description

Support CUDA Graph for internode dispatch kernels with the same logic as what has been done for intranode dispatch kernels.


🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.

## 📋 Pull Request Information **Original PR:** https://github.com/deepseek-ai/DeepEP/pull/438 **Author:** [@yifeizhang-c](https://github.com/yifeizhang-c) **Created:** 9/30/2025 **Status:** ✅ Merged **Merged:** 11/5/2025 **Merged by:** [@sphish](https://github.com/sphish) **Base:** `main` ← **Head:** `enable-internode-cuda-graph` --- ### 📝 Commits (1) - [`d5e6717`](https://github.com/deepseek-ai/DeepEP/commit/d5e6717e7a391f6c19471d0c08bb9d5f2da898f6) Enable CUDA Graph for internode dispatch ### 📊 Changes **6 files changed** (+93 additions, -37 deletions) <details> <summary>View changed files</summary> 📝 `csrc/deep_ep.cpp` (+30 -22) 📝 `csrc/deep_ep.hpp` (+1 -0) 📝 `csrc/kernels/api.cuh` (+2 -0) 📝 `csrc/kernels/internode.cu` (+37 -9) 📝 `deep_ep/buffer.py` (+5 -6) 📝 `tests/test_internode.py` (+18 -0) </details> ### 📄 Description Support CUDA Graph for internode dispatch kernels with the same logic as what has been done for intranode dispatch kernels. --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>
bsakaguchi 2026-10-27 21:04:08 +00:00
Sign in to join this conversation.
No labels
pull-request
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
deepseek-ai/DeepEP#570
No description provided.