[PR #114] [CLOSED] [MooncakeStore] Introduce MooncakeStore: A new Distributed Object Store for XpYd PD disaggregation #1334

New issue

Closed

opened 2026-10-29 21:26:29 +00:00 by bsakaguchi · 0 comments

bsakaguchi commented

2026-10-29 21:26:29 +00:00

Owner

📋 Pull Request Information

Original PR: https://github.com/kvcache-ai/Mooncake/pull/114
Author: @stmatengss
Created: 2/20/2025
Status: ❌ Closed

Base: main ← Head: add-mooncake-store-mt

📝 Commits (2)

be43106 [MooncakeStore] Introduce Mooncake v1.0: A new Distributed Object Store for XpYd PD disaggregation
2e67149 [Doc][MooncakeStore] add docs for guide

📊 Changes

81 files changed (+24515 additions, -0 deletions)

View changed files

📝 .gitignore (+13 -0)
📝 CMakeLists.txt (+18 -0)
📝 doc/en/build.md (+1 -0)
➕ doc/en/mooncake-store-preview.md (+553 -0)
📝 doc/zh/build.md (+1 -0)
➕ doc/zh/mooncake-store-preview.md (+569 -0)
➕ doc/zh/mooncake-store.md (+292 -0)
➕ image/mooncake-store-arch.png (+0 -0)
➕ image/mooncake-store-client-get.png (+0 -0)
➕ image/mooncake-store-client-put.png (+0 -0)
➕ image/mooncake-store-dist-arch.png (+0 -0)
➕ image/mooncake-store-preview.png (+0 -0)
➕ image/mooncake-store-simple-arch.jpg (+0 -0)
➕ image/mooncake-store-simple-get.png (+0 -0)
➕ image/mooncake-store-simple-put.png (+0 -0)
➕ mooncake-store/CMakeLists.txt (+21 -0)
➕ mooncake-store/Makefile (+33 -0)
➕ mooncake-store/include/allocation_strategy.h (+89 -0)
➕ mooncake-store/include/allocator.h (+87 -0)
➕ mooncake-store/include/cachelib_memory_allocator/AllocationClass.h (+449 -0)

...and 61 more files

📄 Description

New feature: we implement a distributed object store for vllm xPyD scenarios. It follows the design outlined in this document (https://docs.google.com/document/d/1Ab6TMW1E2CdHJJyCrpJnLhgmE2b_6leH5MVP9k72sjw/edit?tab=t.0#heading=h.611v2r4aqubz). This PR is compatible with our proposal in the VLLM community (https://github.com/vllm-project/vllm/pull/12957).

CC list: @james0zan @ShangmingCai @alogfans @doujiang24

_{🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.}

## 📋 Pull Request Information **Original PR:** https://github.com/kvcache-ai/Mooncake/pull/114 **Author:** [@stmatengss](https://github.com/stmatengss) **Created:** 2/20/2025 **Status:** ❌ Closed **Base:** `main` ← **Head:** `add-mooncake-store-mt` --- ### 📝 Commits (2) - [`be43106`](https://github.com/kvcache-ai/Mooncake/commit/be43106f5e1d2135a6810a7986efcc61b32c521b) [MooncakeStore] Introduce Mooncake v1.0: A new Distributed Object Store for XpYd PD disaggregation - [`2e67149`](https://github.com/kvcache-ai/Mooncake/commit/2e671490b6f12fbd28df8c89ca9634ad16649e33) [Doc][MooncakeStore] add docs for guide ### 📊 Changes **81 files changed** (+24515 additions, -0 deletions) <details> <summary>View changed files</summary> 📝 `.gitignore` (+13 -0) 📝 `CMakeLists.txt` (+18 -0) 📝 `doc/en/build.md` (+1 -0) ➕ `doc/en/mooncake-store-preview.md` (+553 -0) 📝 `doc/zh/build.md` (+1 -0) ➕ `doc/zh/mooncake-store-preview.md` (+569 -0) ➕ `doc/zh/mooncake-store.md` (+292 -0) ➕ `image/mooncake-store-arch.png` (+0 -0) ➕ `image/mooncake-store-client-get.png` (+0 -0) ➕ `image/mooncake-store-client-put.png` (+0 -0) ➕ `image/mooncake-store-dist-arch.png` (+0 -0) ➕ `image/mooncake-store-preview.png` (+0 -0) ➕ `image/mooncake-store-simple-arch.jpg` (+0 -0) ➕ `image/mooncake-store-simple-get.png` (+0 -0) ➕ `image/mooncake-store-simple-put.png` (+0 -0) ➕ `mooncake-store/CMakeLists.txt` (+21 -0) ➕ `mooncake-store/Makefile` (+33 -0) ➕ `mooncake-store/include/allocation_strategy.h` (+89 -0) ➕ `mooncake-store/include/allocator.h` (+87 -0) ➕ `mooncake-store/include/cachelib_memory_allocator/AllocationClass.h` (+449 -0) _...and 61 more files_ </details> ### 📄 Description New feature: we implement a distributed object store for vllm xPyD scenarios. It follows the design outlined in this document (https://docs.google.com/document/d/1Ab6TMW1E2CdHJJyCrpJnLhgmE2b_6leH5MVP9k72sjw/edit?tab=t.0#heading=h.611v2r4aqubz). This PR is compatible with our proposal in the VLLM community (https://github.com/vllm-project/vllm/pull/12957). CC list: @james0zan @ShangmingCai @alogfans @doujiang24 --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>

bsakaguchi

2026-10-29 21:26:29 +00:00