[PR #1002] [MERGED] [EP] Fallback impl of Mooncake EP when IBGDA is unavailable #1947

New issue

Closed

opened 2026-10-29 21:31:36 +00:00 by bsakaguchi · 0 comments

bsakaguchi commented

2026-10-29 21:31:36 +00:00

Owner

📋 Pull Request Information

Original PR: https://github.com/kvcache-ai/Mooncake/pull/1002
Author: @UNIDY2002
Created: 11/3/2025
Status: ✅ Merged
Merged: 11/21/2025
Merged by: @ShangmingCai

Base: main ← Head: sunxun/ep-fallback

📝 Commits (10+)

589840e Implement a fallback impl of EP's dispatch & combine when IBGDA is not available
c713ac3 Fix format
5df4405 Fix
9397d21 Fix
8c996a6 Add fault-tolerance support for the fallback path
75b66c5 Merge remote-tracking branch 'origin/main' into sunxun/ep-fallback
902adae Fix
9e9f0c1 Fix
79a2cb7 Exit from __init__ early, if using fallback impl of EP
55ef55b Fix

📊 Changes

6 files changed (+302 additions, -21 deletions)

View changed files

📝 mooncake-ep/include/mooncake_backend.h (+2 -0)
📝 mooncake-ep/include/mooncake_ep_buffer.h (+4 -1)
📝 mooncake-ep/src/mooncake_ep_buffer.cpp (+15 -8)
📝 mooncake-integration/ep/ep_py.cpp (+8 -0)
📝 mooncake-wheel/mooncake/mooncake_ep_buffer.py (+272 -12)
📝 mooncake-wheel/tests/test_mooncake_ep.py (+1 -0)

📄 Description

We provide a fallback implementation of the EP's dispatch & combine, so that Mooncake can run in CI environments where IBGDA is not available.

_{🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.}

## 📋 Pull Request Information **Original PR:** https://github.com/kvcache-ai/Mooncake/pull/1002 **Author:** [@UNIDY2002](https://github.com/UNIDY2002) **Created:** 11/3/2025 **Status:** ✅ Merged **Merged:** 11/21/2025 **Merged by:** [@ShangmingCai](https://github.com/ShangmingCai) **Base:** `main` ← **Head:** `sunxun/ep-fallback` --- ### 📝 Commits (10+) - [`589840e`](https://github.com/kvcache-ai/Mooncake/commit/589840e07ac5cb8946aa2308d0f68dfc15ab4aef) Implement a fallback impl of EP's dispatch & combine when IBGDA is not available - [`c713ac3`](https://github.com/kvcache-ai/Mooncake/commit/c713ac3b7c583ff9fb47864b793d12d480627880) Fix format - [`5df4405`](https://github.com/kvcache-ai/Mooncake/commit/5df4405faad7e2f709b84f52d7422987352d389f) Fix - [`9397d21`](https://github.com/kvcache-ai/Mooncake/commit/9397d21846652ffc00ba131efcac3ec08d1e27d7) Fix - [`8c996a6`](https://github.com/kvcache-ai/Mooncake/commit/8c996a67930725f983da3065973f8f54a2a47d15) Add fault-tolerance support for the fallback path - [`75b66c5`](https://github.com/kvcache-ai/Mooncake/commit/75b66c5dea4f8c0667614a295baa537df4779a68) Merge remote-tracking branch 'origin/main' into sunxun/ep-fallback - [`902adae`](https://github.com/kvcache-ai/Mooncake/commit/902adae346d106ffd3cd5f8844667cf7d8eb7ee9) Fix - [`9e9f0c1`](https://github.com/kvcache-ai/Mooncake/commit/9e9f0c11b5a63926bab0c20a90a0106ab32b17c4) Fix - [`79a2cb7`](https://github.com/kvcache-ai/Mooncake/commit/79a2cb78d2a5da3d4a9ffa4cd0ce73ee52735a09) Exit from `__init__` early, if using fallback impl of EP - [`55ef55b`](https://github.com/kvcache-ai/Mooncake/commit/55ef55bc7710e45b9cbca478e111b1a7a2516cfa) Fix ### 📊 Changes **6 files changed** (+302 additions, -21 deletions) <details> <summary>View changed files</summary> 📝 `mooncake-ep/include/mooncake_backend.h` (+2 -0) 📝 `mooncake-ep/include/mooncake_ep_buffer.h` (+4 -1) 📝 `mooncake-ep/src/mooncake_ep_buffer.cpp` (+15 -8) 📝 `mooncake-integration/ep/ep_py.cpp` (+8 -0) 📝 `mooncake-wheel/mooncake/mooncake_ep_buffer.py` (+272 -12) 📝 `mooncake-wheel/tests/test_mooncake_ep.py` (+1 -0) </details> ### 📄 Description We provide a fallback implementation of the EP's dispatch & combine, so that Mooncake can run in CI environments where IBGDA is not available. --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>

bsakaguchi

2026-10-29 21:31:36 +00:00