[PR #1401] [MERGED] Mooncake PG buffer

No labels

No milestone

No project

No assignees

1 participant

Notifications

Due date

The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference

kvcache-ai/Mooncake#2223

bsakaguchi commented

2026-10-29 21:33:47 +00:00

Owner

📋 Pull Request Information

Original PR: https://github.com/kvcache-ai/Mooncake/pull/1401
Author: @ympcMark
Created: 1/19/2026
Status: ✅ Merged
Merged: 1/19/2026
Merged by: @UNIDY2002

Base: main ← Head: mapc-bf

📝 Commits (7)

160e2f4 debug
912981e Merge branch 'main' into mapc-bf
c86d5b6 debug
2b7c560 debug
eb35906 Format
d4a8968 Fix
452f04e Fix [skip ci]

📊 Changes

5 files changed (+76 additions, -56 deletions)

View changed files

📝 mooncake-pg/include/mooncake_backend.h (+1 -0)
📝 mooncake-pg/include/mooncake_worker.cuh (+6 -1)
📝 mooncake-pg/src/mooncake_backend.cpp (+27 -14)
📝 mooncake-pg/src/mooncake_worker.cu (+11 -14)
📝 mooncake-pg/src/mooncake_worker_thread.cpp (+31 -27)

📄 Description

Description

Part of https://github.com/kvcache-ai/Mooncake/issues/1225.

Avoid indexing SegmentDesc::buffers to obtain peer memory locations; transfer them through Torch's rendezvous store instead

Type of Change

Types
- Bug fix
- New feature
  - Transfer Engine
  - Mooncake Store
  - Mooncake EP
  - Integration
  - P2P Store
  - Python Wheel
- Breaking change
- CI/CD
- Documentation update
- Other

How Has This Been Tested?

Checklist

I have performed a self-review of my own code.
I have formatted my own code using ./scripts/code_format.sh before submitting.
I have updated the documentation.
I have added tests to prove my changes are effective.

_{🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.}

## 📋 Pull Request Information **Original PR:** https://github.com/kvcache-ai/Mooncake/pull/1401 **Author:** [@ympcMark](https://github.com/ympcMark) **Created:** 1/19/2026 **Status:** ✅ Merged **Merged:** 1/19/2026 **Merged by:** [@UNIDY2002](https://github.com/UNIDY2002) **Base:** `main` ← **Head:** `mapc-bf` --- ### 📝 Commits (7) - [`160e2f4`](https://github.com/kvcache-ai/Mooncake/commit/160e2f4cc1a5f1755e64b85b2f2df5f2560875ab) debug - [`912981e`](https://github.com/kvcache-ai/Mooncake/commit/912981e3d4281086e25461c8484487fbbdfefdc6) Merge branch 'main' into mapc-bf - [`c86d5b6`](https://github.com/kvcache-ai/Mooncake/commit/c86d5b6c9a9bf0b3f278efa618550df338989e5c) debug - [`2b7c560`](https://github.com/kvcache-ai/Mooncake/commit/2b7c560538d9696154fd4f27568a5e4541c9dcd8) debug - [`eb35906`](https://github.com/kvcache-ai/Mooncake/commit/eb35906497f78042f8c616933727719d961d3c69) Format - [`d4a8968`](https://github.com/kvcache-ai/Mooncake/commit/d4a896863177153941d4384315d3bb112fd34b6a) Fix - [`452f04e`](https://github.com/kvcache-ai/Mooncake/commit/452f04e2bc11021824436902dbce607671593c40) Fix [skip ci] ### 📊 Changes **5 files changed** (+76 additions, -56 deletions) <details> <summary>View changed files</summary> 📝 `mooncake-pg/include/mooncake_backend.h` (+1 -0) 📝 `mooncake-pg/include/mooncake_worker.cuh` (+6 -1) 📝 `mooncake-pg/src/mooncake_backend.cpp` (+27 -14) 📝 `mooncake-pg/src/mooncake_worker.cu` (+11 -14) 📝 `mooncake-pg/src/mooncake_worker_thread.cpp` (+31 -27) </details> ### 📄 Description ## Description Part of https://github.com/kvcache-ai/Mooncake/issues/1225. Avoid indexing SegmentDesc::buffers to obtain peer memory locations; transfer them through Torch's rendezvous store instead ## Type of Change * Types - [ ] Bug fix - [ ] New feature - [ ] Transfer Engine - [ ] Mooncake Store - [ ] Mooncake EP - [ ] Integration - [ ] P2P Store - [ ] Python Wheel - [ ] Breaking change - [ ] CI/CD - [ ] Documentation update - [ ] Other ## How Has This Been Tested?  ## Checklist - [ ] I have performed a self-review of my own code. - [ ] I have formatted my own code using `./scripts/code_format.sh` before submitting. - [ ] I have updated the documentation. - [ ] I have added tests to prove my changes are effective. --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>

bsakaguchi

closed this issue
added the
pull-request
label

Rows
Columns

[PR #1401] [MERGED] Mooncake PG buffer #2223