[PR #1236] [MERGED] [EP] Implement send/recv

No labels

No milestone

No project

No assignees

1 participant

Notifications

Due date

The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference

kvcache-ai/Mooncake#2094

bsakaguchi commented

2026-10-29 21:32:44 +00:00

Owner

📋 Pull Request Information

Original PR: https://github.com/kvcache-ai/Mooncake/pull/1236
Author: @UNIDY2002
Created: 12/18/2025
Status: ✅ Merged
Merged: 12/22/2025
Merged by: @UNIDY2002

Base: main ← Head: sunxun/send-recv

📝 Commits (10+)

6788db2 Implement send/recv
7aa1cd4 Fix
ae54c99 Fix
dfa19f6 Debug
96d759d Debug [skip ci]
4bd6555 Debug [skip ci]
03a024c Debug
6a4cac6 Update ci.yml
2e0617b Fix
a7ae4f6 Merge remote-tracking branch 'origin/main' into sunxun/send-recv [skip ci]

📊 Changes

5 files changed (+757 additions, -0 deletions)

View changed files

📝 .github/workflows/ci.yml (+1 -0)
📝 mooncake-ep/include/mooncake_backend.h (+48 -0)
📝 mooncake-ep/include/mooncake_worker.cuh (+9 -0)
📝 mooncake-ep/src/mooncake_backend.cpp (+487 -0)
➕ mooncake-wheel/tests/test_mooncake_backend_p2p_cpu.py (+212 -0)

📄 Description

Description

Part of #1225.

This PR adds support for torch.distributed.send / recv, and also supports torch.distributed.batch_isend_irecv.

Type of Change

Types
- Bug fix
- New feature
  - Transfer Engine
  - Mooncake Store
  - Mooncake EP
  - Integration
  - P2P Store
  - Python Wheel
- Breaking change
- CI/CD
- Documentation update
- Other

How Has This Been Tested?

python -m unittest mooncake-wheel.tests.test_mooncake_backend_p2p_cpu

E2E test in SGLang also verifies the correctness.

Checklist

I have performed a self-review of my own code.
I have updated the documentation.
I have added tests to prove my changes are effective.

_{🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.}

## 📋 Pull Request Information **Original PR:** https://github.com/kvcache-ai/Mooncake/pull/1236 **Author:** [@UNIDY2002](https://github.com/UNIDY2002) **Created:** 12/18/2025 **Status:** ✅ Merged **Merged:** 12/22/2025 **Merged by:** [@UNIDY2002](https://github.com/UNIDY2002) **Base:** `main` ← **Head:** `sunxun/send-recv` --- ### 📝 Commits (10+) - [`6788db2`](https://github.com/kvcache-ai/Mooncake/commit/6788db2a1dd05da2d72395b004f040ee035b6a1e) Implement send/recv - [`7aa1cd4`](https://github.com/kvcache-ai/Mooncake/commit/7aa1cd42ab4aba9652ee4dcb7cc254dec41d0f96) Fix - [`ae54c99`](https://github.com/kvcache-ai/Mooncake/commit/ae54c99ed70d85b22180b613b4e3dd317aebc42c) Fix - [`dfa19f6`](https://github.com/kvcache-ai/Mooncake/commit/dfa19f65bd8951698b46beef94dc9a9618109552) Debug - [`96d759d`](https://github.com/kvcache-ai/Mooncake/commit/96d759df6c224b733a482d246d9d62a8f88a04b5) Debug [skip ci] - [`4bd6555`](https://github.com/kvcache-ai/Mooncake/commit/4bd65550afb0cf424fcd536da06dda03cd41746d) Debug [skip ci] - [`03a024c`](https://github.com/kvcache-ai/Mooncake/commit/03a024cd11361f169002b44d55d59ec82525479b) Debug - [`6a4cac6`](https://github.com/kvcache-ai/Mooncake/commit/6a4cac6b04343b6e272be115c09417e4f985de56) Update ci.yml - [`2e0617b`](https://github.com/kvcache-ai/Mooncake/commit/2e0617b22ceeadae63b771ce03cfdbccae6dce08) Fix - [`a7ae4f6`](https://github.com/kvcache-ai/Mooncake/commit/a7ae4f60fc73ac65bf77859e208067d11d2ae345) Merge remote-tracking branch 'origin/main' into sunxun/send-recv [skip ci] ### 📊 Changes **5 files changed** (+757 additions, -0 deletions) <details> <summary>View changed files</summary> 📝 `.github/workflows/ci.yml` (+1 -0) 📝 `mooncake-ep/include/mooncake_backend.h` (+48 -0) 📝 `mooncake-ep/include/mooncake_worker.cuh` (+9 -0) 📝 `mooncake-ep/src/mooncake_backend.cpp` (+487 -0) ➕ `mooncake-wheel/tests/test_mooncake_backend_p2p_cpu.py` (+212 -0) </details> ### 📄 Description ## Description  Part of #1225. This PR adds support for `torch.distributed.send` / `recv`, and also supports `torch.distributed.batch_isend_irecv`. ## Type of Change * Types - [ ] Bug fix - [ ] New feature - [ ] Transfer Engine - [ ] Mooncake Store - [x] Mooncake EP - [ ] Integration - [ ] P2P Store - [ ] Python Wheel - [ ] Breaking change - [ ] CI/CD - [ ] Documentation update - [ ] Other ## How Has This Been Tested?  python -m unittest mooncake-wheel.tests.test_mooncake_backend_p2p_cpu E2E test in SGLang also verifies the correctness. ## Checklist - [ ] I have performed a self-review of my own code. - [ ] I have updated the documentation. - [x] I have added tests to prove my changes are effective. --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>

bsakaguchi

closed this issue
added the
pull-request
label

Rows
Columns

[PR #1236] [MERGED] [EP] Implement send/recv #2094