[PR #1308] [MERGED] [EP] Use NVLink in EP if possible

No labels

No milestone

No project

No assignees

1 participant

Notifications

Due date

The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference

kvcache-ai/Mooncake#2149

bsakaguchi commented

2026-10-29 21:33:09 +00:00

Owner

📋 Pull Request Information

Original PR: https://github.com/kvcache-ai/Mooncake/pull/1308
Author: @UNIDY2002
Created: 12/30/2025
Status: ✅ Merged
Merged: 12/31/2025
Merged by: @UNIDY2002

Base: main ← Head: sunxun/ep-debug

📝 Commits (6)

6724e2a Use NVLink in EP
19d3c92 Update mooncake-wheel/mooncake/mooncake_ep_buffer.py
3ea7fcc Update mooncake-ep/src/mooncake_ep_buffer.cpp
5c54bce Fix
1bf1751 Fix
29a9553 Fix

📊 Changes

6 files changed (+264 additions, -82 deletions)

View changed files

📝 mooncake-ep/include/mooncake_ep_api.cuh (+7 -5)
📝 mooncake-ep/include/mooncake_ep_buffer.h (+9 -0)
📝 mooncake-ep/src/mooncake_ep_buffer.cpp (+127 -8)
📝 mooncake-ep/src/mooncake_ep_kernel.cu (+72 -32)
📝 mooncake-integration/ep/ep_py.cpp (+3 -0)
📝 mooncake-wheel/mooncake/mooncake_ep_buffer.py (+46 -37)

📄 Description

Description

Part of #1225

Use NVLink in EP if possible.

(Don't consider NPU as EP currently only runs on NVIDIA's hardware.)

No changes to the public APIs.

Type of Change

Types
- Bug fix
- New feature
  - Transfer Engine
  - Mooncake Store
  - Mooncake EP
  - Integration
  - P2P Store
  - Python Wheel
- Breaking change
- CI/CD
- Documentation update
- Other

How Has This Been Tested?

test_mooncake_ep.py should observe higher performance (100~200 GB/s in bandwidth)

Checklist

I have performed a self-review of my own code.
I have updated the documentation.
I have added tests to prove my changes are effective.

_{🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.}

## 📋 Pull Request Information **Original PR:** https://github.com/kvcache-ai/Mooncake/pull/1308 **Author:** [@UNIDY2002](https://github.com/UNIDY2002) **Created:** 12/30/2025 **Status:** ✅ Merged **Merged:** 12/31/2025 **Merged by:** [@UNIDY2002](https://github.com/UNIDY2002) **Base:** `main` ← **Head:** `sunxun/ep-debug` --- ### 📝 Commits (6) - [`6724e2a`](https://github.com/kvcache-ai/Mooncake/commit/6724e2a3ca701eb275be622144ab13e9be17f476) Use NVLink in EP - [`19d3c92`](https://github.com/kvcache-ai/Mooncake/commit/19d3c92f54af0e77b67b7b5eb75b31d1033385f4) Update mooncake-wheel/mooncake/mooncake_ep_buffer.py - [`3ea7fcc`](https://github.com/kvcache-ai/Mooncake/commit/3ea7fcc52bf04a4f259d02ee89f4c96ad91d9a57) Update mooncake-ep/src/mooncake_ep_buffer.cpp - [`5c54bce`](https://github.com/kvcache-ai/Mooncake/commit/5c54bce43d1346e6af4002a29f4037b370322f1c) Fix - [`1bf1751`](https://github.com/kvcache-ai/Mooncake/commit/1bf17517be1643909797089ec26b9779a0403a8d) Fix - [`29a9553`](https://github.com/kvcache-ai/Mooncake/commit/29a9553ec27abf0a81e6cc2f95c9311b8b25d290) Fix ### 📊 Changes **6 files changed** (+264 additions, -82 deletions) <details> <summary>View changed files</summary> 📝 `mooncake-ep/include/mooncake_ep_api.cuh` (+7 -5) 📝 `mooncake-ep/include/mooncake_ep_buffer.h` (+9 -0) 📝 `mooncake-ep/src/mooncake_ep_buffer.cpp` (+127 -8) 📝 `mooncake-ep/src/mooncake_ep_kernel.cu` (+72 -32) 📝 `mooncake-integration/ep/ep_py.cpp` (+3 -0) 📝 `mooncake-wheel/mooncake/mooncake_ep_buffer.py` (+46 -37) </details> ### 📄 Description ## Description  Part of #1225 Use NVLink in EP if possible. (Don't consider NPU as EP currently only runs on NVIDIA's hardware.) No changes to the public APIs. ## Type of Change * Types - [ ] Bug fix - [ ] New feature - [ ] Transfer Engine - [ ] Mooncake Store - [x] Mooncake EP - [ ] Integration - [ ] P2P Store - [ ] Python Wheel - [ ] Breaking change - [ ] CI/CD - [ ] Documentation update - [ ] Other ## How Has This Been Tested?  test_mooncake_ep.py should observe higher performance (100~200 GB/s in bandwidth) ## Checklist - [x] I have performed a self-review of my own code. - [ ] I have updated the documentation. - [ ] I have added tests to prove my changes are effective. --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>

bsakaguchi

closed this issue
added the
pull-request
label

Rows
Columns

[PR #1308] [MERGED] [EP] Use NVLink in EP if possible #2149