[PR #126] [MERGED] [MooncakeStore] Introduce MooncakeStore: A new Distributed Object Store for XpYd PD disaggregation #1343

New issue

Closed

opened 2026-10-29 21:26:35 +00:00 by bsakaguchi · 0 comments

bsakaguchi commented

2026-10-29 21:26:35 +00:00

Owner

📋 Pull Request Information

Original PR: https://github.com/kvcache-ai/Mooncake/pull/126
Author: @alogfans
Created: 3/3/2025
Status: ✅ Merged
Merged: 3/7/2025
Merged by: @stmatengss

Base: main ← Head: add-mooncake-store

📝 Commits (7)

943c3b6 Squashed commit of the following:
1c12cf6 add docs for guide
7760ff2 Squashed commit of the following:
ab45c7b Merge branch 'kvcache-ai:main' into add-mooncake-store
3a0b3bd doc: add mooncake store python API
123971f [DOC] fix open source date
3f09eff Merge branch 'main' into add-mooncake-store

📊 Changes

89 files changed (+25715 additions, -5 deletions)

View changed files

📝 .gitignore (+13 -0)
📝 CMakeLists.txt (+20 -0)
📝 README.md (+9 -3)
📝 doc/en/build.md (+1 -0)
➕ doc/en/mooncake-store-preview.md (+580 -0)
➕ doc/en/vllm-benchmark-results-v1.md (+22 -0)
📝 doc/zh/build.md (+1 -0)
➕ doc/zh/mooncake-store-preview.md (+592 -0)
➕ doc/zh/mooncake-store.md (+292 -0)
📝 image/components.png (+0 -0)
➕ image/mooncake-store-arch.png (+0 -0)
➕ image/mooncake-store-client-get.png (+0 -0)
➕ image/mooncake-store-client-put.png (+0 -0)
➕ image/mooncake-store-dist-arch.png (+0 -0)
➕ image/mooncake-store-preview.png (+0 -0)
➕ image/mooncake-store-simple-arch.jpg (+0 -0)
➕ image/mooncake-store-simple-get.png (+0 -0)
➕ image/mooncake-store-simple-put.png (+0 -0)
📝 mooncake-integration/CMakeLists.txt (+18 -2)
➕ mooncake-integration/vllm/distributed_object_store.cpp (+353 -0)

...and 69 more files

📄 Description

New feature: we implement a distributed object store for vllm xPyD scenarios. It follows the design outlined in this document (https://docs.google.com/document/d/1Ab6TMW1E2CdHJJyCrpJnLhgmE2b_6leH5MVP9k72sjw/edit?tab=t.0#heading=h.611v2r4aqubz). This PR is compatible with our proposal in the VLLM community (https://github.com/vllm-project/vllm/pull/12957).

This is the refine of #114.

CC list: @james0zan @ShangmingCai @alogfans @doujiang24 @stmatengss

_{🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.}

## 📋 Pull Request Information **Original PR:** https://github.com/kvcache-ai/Mooncake/pull/126 **Author:** [@alogfans](https://github.com/alogfans) **Created:** 3/3/2025 **Status:** ✅ Merged **Merged:** 3/7/2025 **Merged by:** [@stmatengss](https://github.com/stmatengss) **Base:** `main` ← **Head:** `add-mooncake-store` --- ### 📝 Commits (7) - [`943c3b6`](https://github.com/kvcache-ai/Mooncake/commit/943c3b6bedb3ef0309560cc16dcf31506b1b479c) Squashed commit of the following: - [`1c12cf6`](https://github.com/kvcache-ai/Mooncake/commit/1c12cf6c0694bcc9adb06de0952e8b47b311f069) add docs for guide - [`7760ff2`](https://github.com/kvcache-ai/Mooncake/commit/7760ff26ae2fa6bf250a4d3d5ae82e61874c8efa) Squashed commit of the following: - [`ab45c7b`](https://github.com/kvcache-ai/Mooncake/commit/ab45c7bb5d7771e7d175e2579ac6a1d41c1325bb) Merge branch 'kvcache-ai:main' into add-mooncake-store - [`3a0b3bd`](https://github.com/kvcache-ai/Mooncake/commit/3a0b3bd49c66e102e9775813e1ad165de6f46f58) doc: add mooncake store python API - [`123971f`](https://github.com/kvcache-ai/Mooncake/commit/123971f80ed9c2dee9bb25b55ab363bb0009d4b9) [DOC] fix open source date - [`3f09eff`](https://github.com/kvcache-ai/Mooncake/commit/3f09effc5e0dce666cdba2870baac4393da1d6af) Merge branch 'main' into add-mooncake-store ### 📊 Changes **89 files changed** (+25715 additions, -5 deletions) <details> <summary>View changed files</summary> 📝 `.gitignore` (+13 -0) 📝 `CMakeLists.txt` (+20 -0) 📝 `README.md` (+9 -3) 📝 `doc/en/build.md` (+1 -0) ➕ `doc/en/mooncake-store-preview.md` (+580 -0) ➕ `doc/en/vllm-benchmark-results-v1.md` (+22 -0) 📝 `doc/zh/build.md` (+1 -0) ➕ `doc/zh/mooncake-store-preview.md` (+592 -0) ➕ `doc/zh/mooncake-store.md` (+292 -0) 📝 `image/components.png` (+0 -0) ➕ `image/mooncake-store-arch.png` (+0 -0) ➕ `image/mooncake-store-client-get.png` (+0 -0) ➕ `image/mooncake-store-client-put.png` (+0 -0) ➕ `image/mooncake-store-dist-arch.png` (+0 -0) ➕ `image/mooncake-store-preview.png` (+0 -0) ➕ `image/mooncake-store-simple-arch.jpg` (+0 -0) ➕ `image/mooncake-store-simple-get.png` (+0 -0) ➕ `image/mooncake-store-simple-put.png` (+0 -0) 📝 `mooncake-integration/CMakeLists.txt` (+18 -2) ➕ `mooncake-integration/vllm/distributed_object_store.cpp` (+353 -0) _...and 69 more files_ </details> ### 📄 Description New feature: we implement a distributed object store for vllm xPyD scenarios. It follows the design outlined in this document (https://docs.google.com/document/d/1Ab6TMW1E2CdHJJyCrpJnLhgmE2b_6leH5MVP9k72sjw/edit?tab=t.0#heading=h.611v2r4aqubz). This PR is compatible with our proposal in the VLLM community (https://github.com/vllm-project/vllm/pull/12957). This is the refine of #114. CC list: @james0zan @ShangmingCai @alogfans @doujiang24 @stmatengss --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>

bsakaguchi

2026-10-29 21:26:35 +00:00