[PR #287] [MERGED] Use TMA to optimize internode combine. #504

New issue

Closed

opened 2026-10-27 21:03:19 +00:00 by bsakaguchi · 0 comments

bsakaguchi commented

2026-10-27 21:03:19 +00:00

Owner

📋 Pull Request Information

Original PR: https://github.com/deepseek-ai/DeepEP/pull/287
Author: @sphish
Created: 7/9/2025
Status: ✅ Merged
Merged: 7/10/2025
Merged by: @LyricZhao

Base: main ← Head: internode-combine-tma

📝 Commits (10+)

8096742 Let forwarders use a dedicated SM
70edc81 Shuffle rdma idx
e94752a Sender use TMA.
499ec88 Adjust the tuning chunk size.
d6c3fe4 Modify NVL chunk layout.
bcab6b2 Update some combine config.
7449df8 Small lint
e686dca Merge remote-tracking branch 'origin/main' into internode-combine-tma
a4cbf5c Minor fix
9212853 Overlap TMA store

📊 Changes

3 files changed (+94 additions, -72 deletions)

View changed files

📝 csrc/kernels/internode.cu (+90 -68)
📝 deep_ep/buffer.py (+3 -3)
📝 tests/test_internode.py (+1 -1)

📄 Description

No description provided

_{🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.}

## 📋 Pull Request Information **Original PR:** https://github.com/deepseek-ai/DeepEP/pull/287 **Author:** [@sphish](https://github.com/sphish) **Created:** 7/9/2025 **Status:** ✅ Merged **Merged:** 7/10/2025 **Merged by:** [@LyricZhao](https://github.com/LyricZhao) **Base:** `main` ← **Head:** `internode-combine-tma` --- ### 📝 Commits (10+) - [`8096742`](https://github.com/deepseek-ai/DeepEP/commit/8096742e3549abec6cfb9cf40f2e668feaa78bf2) Let forwarders use a dedicated SM - [`70edc81`](https://github.com/deepseek-ai/DeepEP/commit/70edc81af47c26bc2f02d95d14167c49bf7f7134) Shuffle rdma idx - [`e94752a`](https://github.com/deepseek-ai/DeepEP/commit/e94752a0dbd9db9b860232b75952087c4c09a8fc) Sender use TMA. - [`499ec88`](https://github.com/deepseek-ai/DeepEP/commit/499ec88ba28dad8448a26798e60e7e683278b9a0) Adjust the tuning chunk size. - [`d6c3fe4`](https://github.com/deepseek-ai/DeepEP/commit/d6c3fe436c56407fc453e14bcdaeabc739445c49) Modify NVL chunk layout. - [`bcab6b2`](https://github.com/deepseek-ai/DeepEP/commit/bcab6b2bef5c7306f7c4ad503209ee3a12dd3a95) Update some combine config. - [`7449df8`](https://github.com/deepseek-ai/DeepEP/commit/7449df889e8b3d3a7875eb904ec5403fd9236af8) Small lint - [`e686dca`](https://github.com/deepseek-ai/DeepEP/commit/e686dca57a4254e8876a21b56d3635d958be31ae) Merge remote-tracking branch 'origin/main' into internode-combine-tma - [`a4cbf5c`](https://github.com/deepseek-ai/DeepEP/commit/a4cbf5c77b0be85ef91a0c58e936202053b45d50) Minor fix - [`9212853`](https://github.com/deepseek-ai/DeepEP/commit/9212853c3bb6a18c764be655f927ee144dc340f0) Overlap TMA store ### 📊 Changes **3 files changed** (+94 additions, -72 deletions) <details> <summary>View changed files</summary> 📝 `csrc/kernels/internode.cu` (+90 -68) 📝 `deep_ep/buffer.py` (+3 -3) 📝 `tests/test_internode.py` (+1 -1) </details> ### 📄 Description _No description provided_ --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>

bsakaguchi

2026-10-27 21:03:19 +00:00