[PR #515] Shuffle experts columns between iterations #605

New issue

Open

opened 2026-10-27 21:04:28 +00:00 by bsakaguchi · 0 comments

bsakaguchi commented

2026-10-27 21:04:28 +00:00

Owner

📋 Pull Request Information

Original PR: https://github.com/deepseek-ai/DeepEP/pull/515
Author: @ybenvidia
Created: 12/9/2025
Status: 🔄 Open

Base: main ← Head: main

📝 Commits (5)

df73a95 shuffle columns between iterations
06fde5c add seed as parameter
acc3faf Merge branch 'deepseek-ai:main' into main
91eb3fa Merge branch 'deepseek-ai:main' into main
f98e5fc Merge branch 'deepseek-ai:main' into main

📊 Changes

4 files changed (+68 additions, -6 deletions)

View changed files

📝 deep_ep/buffer.py (+37 -0)
📝 tests/test_internode.py (+12 -2)
📝 tests/test_low_latency.py (+10 -2)
📝 tests/utils.py (+9 -2)

📄 Description

This PR introduces a new method shuffle_expert_columns to the Buffer class that allows permuting the destination ranks for expert routing between iterations.

_{🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.}

## 📋 Pull Request Information **Original PR:** https://github.com/deepseek-ai/DeepEP/pull/515 **Author:** [@ybenvidia](https://github.com/ybenvidia) **Created:** 12/9/2025 **Status:** 🔄 Open **Base:** `main` ← **Head:** `main` --- ### 📝 Commits (5) - [`df73a95`](https://github.com/deepseek-ai/DeepEP/commit/df73a95486107c39c500fd1024a8e1e8fa1e97c7) shuffle columns between iterations - [`06fde5c`](https://github.com/deepseek-ai/DeepEP/commit/06fde5c1c1c205d1d3e88d0a5552247f06470eea) add seed as parameter - [`acc3faf`](https://github.com/deepseek-ai/DeepEP/commit/acc3faf9b8fe7f490c775de9e659b8c9b25c16d5) Merge branch 'deepseek-ai:main' into main - [`91eb3fa`](https://github.com/deepseek-ai/DeepEP/commit/91eb3fabaec1e1958c931a930b4ce5d30723d9d3) Merge branch 'deepseek-ai:main' into main - [`f98e5fc`](https://github.com/deepseek-ai/DeepEP/commit/f98e5fc47f7c91f36a5151c98d65c17940f9a609) Merge branch 'deepseek-ai:main' into main ### 📊 Changes **4 files changed** (+68 additions, -6 deletions) <details> <summary>View changed files</summary> 📝 `deep_ep/buffer.py` (+37 -0) 📝 `tests/test_internode.py` (+12 -2) 📝 `tests/test_low_latency.py` (+10 -2) 📝 `tests/utils.py` (+9 -2) </details> ### 📄 Description This PR introduces a new method shuffle_expert_columns to the Buffer class that allows permuting the destination ranks for expert routing between iterations. --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>

bsakaguchi added the

pull-request

label

2026-10-27 21:04:28 +00:00

bsakaguchi referenced this issue

2026-10-27 21:04:57 +00:00

[PR #605] [MERGED] [Public release 26/04] Introducing EPv2: faster EP, and Engram/PP/CP supports #658

bsakaguchi referenced this issue

2026-10-27 21:05:00 +00:00

[PR #612] aws-efa: cap auto-QP at 2 on EFA to avoid 128-slot GIN ring overflow #661

bsakaguchi referenced this issue

2026-10-27 21:05:03 +00:00