[PR #588] [MERGED] Add Permute/Unpermute Fusion Code Path #647

New issue

Closed

opened 2026-10-27 21:04:51 +00:00 by bsakaguchi · 0 comments

bsakaguchi commented

2026-10-27 21:04:51 +00:00

Owner

📋 Pull Request Information

Original PR: https://github.com/deepseek-ai/DeepEP/pull/588
Author: @Autumn1998
Created: 3/3/2026
Status: ✅ Merged
Merged: 3/31/2026
Merged by: @jershi425

Base: hybrid-ep ← Head: tongliu_permute_fusion

📝 Commits (10+)

ccd840a refator to ready for permute fusion
b779dfa try to add new backend for fuse permute-dispatch
57cc5ee finish adding fuse permute-dispatch
e21347a fix inter-node bug
090de83 fix inter-node
8f87560 refactor, tune the fused permure API
c137775 aufo configurer
8838bc4 rm fence.release.sys
8f3b43c refactor benchmark
36cac45 minor change

📊 Changes

25 files changed (+4504 additions, -1187 deletions)

View changed files

📝 csrc/hybrid_ep/allocator/allocator.cu (+9 -7)
📝 csrc/hybrid_ep/backend/hybrid_ep_backend.cuh (+2610 -186)
📝 csrc/hybrid_ep/buffer/internode.cu (+47 -23)
📝 csrc/hybrid_ep/buffer/internode.cuh (+13 -10)
📝 csrc/hybrid_ep/buffer/intranode.cu (+136 -18)
📝 csrc/hybrid_ep/buffer/intranode.cuh (+21 -8)
📝 csrc/hybrid_ep/config.cuh (+394 -5)
➕ csrc/hybrid_ep/coordinator.cuh (+13 -0)
📝 csrc/hybrid_ep/executor/executor.cu (+169 -101)
📝 csrc/hybrid_ep/executor/executor.cuh (+50 -7)
📝 csrc/hybrid_ep/extension/allgather.cu (+18 -5)
📝 csrc/hybrid_ep/extension/allgather.cuh (+10 -6)
📝 csrc/hybrid_ep/extension/permute.cu (+47 -73)
📝 csrc/hybrid_ep/extension/permute.cuh (+24 -44)
📝 csrc/hybrid_ep/hybrid_ep.cu (+119 -109)
📝 csrc/hybrid_ep/hybrid_ep.cuh (+24 -29)
📝 csrc/hybrid_ep/jit/compiler.cu (+70 -21)
📝 csrc/hybrid_ep/jit/compiler.cuh (+16 -3)
📝 csrc/hybrid_ep/pybind_hybrid_ep.cu (+84 -31)
📝 csrc/hybrid_ep/utils.cuh (+2 -0)

...and 5 more files

📄 Description

Refactor
Add (un)permute fusion path
Update documentation
Refactor tests for cleaner output

_{🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.}

## 📋 Pull Request Information **Original PR:** https://github.com/deepseek-ai/DeepEP/pull/588 **Author:** [@Autumn1998](https://github.com/Autumn1998) **Created:** 3/3/2026 **Status:** ✅ Merged **Merged:** 3/31/2026 **Merged by:** [@jershi425](https://github.com/jershi425) **Base:** `hybrid-ep` ← **Head:** `tongliu_permute_fusion` --- ### 📝 Commits (10+) - [`ccd840a`](https://github.com/deepseek-ai/DeepEP/commit/ccd840a8121e0e2f37931cffc24c1dd4983c3d4a) refator to ready for permute fusion - [`b779dfa`](https://github.com/deepseek-ai/DeepEP/commit/b779dfaaafdb771c5ef3c71356e73784399d2ab7) try to add new backend for fuse permute-dispatch - [`57cc5ee`](https://github.com/deepseek-ai/DeepEP/commit/57cc5ee1088dbb7f3c8b6d85444dec16642cfe3e) finish adding fuse permute-dispatch - [`e21347a`](https://github.com/deepseek-ai/DeepEP/commit/e21347a7d695537c91944110202b2af45ac028e8) fix inter-node bug - [`090de83`](https://github.com/deepseek-ai/DeepEP/commit/090de8371ad429a45b747b84c62555fd5e31ee4f) fix inter-node - [`8f87560`](https://github.com/deepseek-ai/DeepEP/commit/8f87560378f8a929e7b23f293e2b391ceddf3e83) refactor, tune the fused permure API - [`c137775`](https://github.com/deepseek-ai/DeepEP/commit/c137775bad6f639bcc5ebd9ee0f3ff10c7f4810b) aufo configurer - [`8838bc4`](https://github.com/deepseek-ai/DeepEP/commit/8838bc4afa261e3bca81b84c2d714deda608fe0a) rm fence.release.sys - [`8f3b43c`](https://github.com/deepseek-ai/DeepEP/commit/8f3b43cd07747d1f42067be444770924ac7a17f6) refactor benchmark - [`36cac45`](https://github.com/deepseek-ai/DeepEP/commit/36cac45e01a3be53cf0a415d42aadc0e98df387e) minor change ### 📊 Changes **25 files changed** (+4504 additions, -1187 deletions) <details> <summary>View changed files</summary> 📝 `csrc/hybrid_ep/allocator/allocator.cu` (+9 -7) 📝 `csrc/hybrid_ep/backend/hybrid_ep_backend.cuh` (+2610 -186) 📝 `csrc/hybrid_ep/buffer/internode.cu` (+47 -23) 📝 `csrc/hybrid_ep/buffer/internode.cuh` (+13 -10) 📝 `csrc/hybrid_ep/buffer/intranode.cu` (+136 -18) 📝 `csrc/hybrid_ep/buffer/intranode.cuh` (+21 -8) 📝 `csrc/hybrid_ep/config.cuh` (+394 -5) ➕ `csrc/hybrid_ep/coordinator.cuh` (+13 -0) 📝 `csrc/hybrid_ep/executor/executor.cu` (+169 -101) 📝 `csrc/hybrid_ep/executor/executor.cuh` (+50 -7) 📝 `csrc/hybrid_ep/extension/allgather.cu` (+18 -5) 📝 `csrc/hybrid_ep/extension/allgather.cuh` (+10 -6) 📝 `csrc/hybrid_ep/extension/permute.cu` (+47 -73) 📝 `csrc/hybrid_ep/extension/permute.cuh` (+24 -44) 📝 `csrc/hybrid_ep/hybrid_ep.cu` (+119 -109) 📝 `csrc/hybrid_ep/hybrid_ep.cuh` (+24 -29) 📝 `csrc/hybrid_ep/jit/compiler.cu` (+70 -21) 📝 `csrc/hybrid_ep/jit/compiler.cuh` (+16 -3) 📝 `csrc/hybrid_ep/pybind_hybrid_ep.cu` (+84 -31) 📝 `csrc/hybrid_ep/utils.cuh` (+2 -0) _...and 5 more files_ </details> ### 📄 Description - Refactor - Add (un)permute fusion path - Update documentation - Refactor tests for cleaner output --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>

bsakaguchi

2026-10-27 21:04:51 +00:00

closed this issue
added the
pull-request
label

No labels

pull-request

No milestone

No project

No assignees

1 participant

Notifications

Due date

The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference

deepseek-ai/DeepEP#647

No description provided.

Rows
Columns