[PR #670] [MERGED] [TransferEngine] feat: Support CXL shared memory, and provide simple unit tests. #1736

New issue

Closed

opened 2026-10-29 21:29:55 +00:00 by bsakaguchi · 0 comments

bsakaguchi commented

2026-10-29 21:29:55 +00:00

Owner

📋 Pull Request Information

Original PR: https://github.com/kvcache-ai/Mooncake/pull/670
Author: @hemist
Created: 7/25/2025
Status: ✅ Merged
Merged: 8/1/2025
Merged by: @stmatengss

Base: main ← Head: cxl-engine-pr

📝 Commits (10+)

b667c53 [TransgerEngine] Add cxl transport test
248a21a [Transfer Engine] Add cxl transfer support
06ed115 [TransferEngine] Update the way of obtaining the size of CXL memory from daxctl to env variable && fix some bugs.
af3ad8a [CXL transport] refactor code & add test
cba1648 Merge branch 'kvcache-ai:main' into cxl-engine-pr
1bddc52 Merge pull request #1 from stmatengss/cxl-engine-pr
988bb8c [TransferEngine] fix: modify the parameters of submitTransferTask() to match the base class 'Transport'.
fa85d8b [TransferEngine] fix: update etcd address
09be1e8 [TransferEngine] fix: unit tests error caused by cxl_transport
71fe1bc Update mooncake-common/common.cmake

📊 Changes

10 files changed (+632 additions, -37 deletions)

View changed files

📝 mooncake-common/common.cmake (+5 -0)
📝 mooncake-transfer-engine/include/transfer_metadata.h (+4 -0)
📝 mooncake-transfer-engine/include/transport/cxl_transport/cxl_transport.h (+27 -16)
📝 mooncake-transfer-engine/include/transport/transport.h (+1 -3)
📝 mooncake-transfer-engine/src/multi_transport.cpp (+8 -0)
📝 mooncake-transfer-engine/src/transfer_engine.cpp (+11 -0)
📝 mooncake-transfer-engine/src/transfer_metadata.cpp (+33 -2)
📝 mooncake-transfer-engine/src/transport/cxl_transport/cxl_transport.cpp (+292 -16)
📝 mooncake-transfer-engine/tests/CMakeLists.txt (+6 -0)
➕ mooncake-transfer-engine/tests/cxl_transport_test.cpp (+245 -0)

📄 Description

This PR providesd a transfer-engine framework based on CXL shared memory. In the current implementation, submitTransfer used memcpy() for data transfer. Future work may switch to DSA to avoid CPU cache flushes.

_{🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.}

## 📋 Pull Request Information **Original PR:** https://github.com/kvcache-ai/Mooncake/pull/670 **Author:** [@hemist](https://github.com/hemist) **Created:** 7/25/2025 **Status:** ✅ Merged **Merged:** 8/1/2025 **Merged by:** [@stmatengss](https://github.com/stmatengss) **Base:** `main` ← **Head:** `cxl-engine-pr` --- ### 📝 Commits (10+) - [`b667c53`](https://github.com/kvcache-ai/Mooncake/commit/b667c53b9f51f1f61acf03470431ca28abf25f2f) [TransgerEngine] Add cxl transport test - [`248a21a`](https://github.com/kvcache-ai/Mooncake/commit/248a21ab853a01defc7f6f074efc7fc93ffe8551) [Transfer Engine] Add cxl transfer support - [`06ed115`](https://github.com/kvcache-ai/Mooncake/commit/06ed11504a9e07363a9b53877dd0484363c1026e) [TransferEngine] Update the way of obtaining the size of CXL memory from daxctl to env variable && fix some bugs. - [`af3ad8a`](https://github.com/kvcache-ai/Mooncake/commit/af3ad8a6b890267c7371e021bb17d3d4d1108340) [CXL transport] refactor code & add test - [`cba1648`](https://github.com/kvcache-ai/Mooncake/commit/cba1648df7af1dcef24dfda8a1881286d57c9de3) Merge branch 'kvcache-ai:main' into cxl-engine-pr - [`1bddc52`](https://github.com/kvcache-ai/Mooncake/commit/1bddc520aea11b698cc9c3c20f76022e487ea450) Merge pull request #1 from stmatengss/cxl-engine-pr - [`988bb8c`](https://github.com/kvcache-ai/Mooncake/commit/988bb8ce4680a6ba99e759bb91035b75fcf64064) [TransferEngine] fix: modify the parameters of submitTransferTask() to match the base class 'Transport'. - [`fa85d8b`](https://github.com/kvcache-ai/Mooncake/commit/fa85d8b5c74639fb849922cc1263cab5a3a64914) [TransferEngine] fix: update etcd address - [`09be1e8`](https://github.com/kvcache-ai/Mooncake/commit/09be1e845b283b704a1889909fccb5e8156e8d35) [TransferEngine] fix: unit tests error caused by cxl_transport - [`71fe1bc`](https://github.com/kvcache-ai/Mooncake/commit/71fe1bc49abf9b62088f04af7774b54ed4f46047) Update mooncake-common/common.cmake ### 📊 Changes **10 files changed** (+632 additions, -37 deletions) <details> <summary>View changed files</summary> 📝 `mooncake-common/common.cmake` (+5 -0) 📝 `mooncake-transfer-engine/include/transfer_metadata.h` (+4 -0) 📝 `mooncake-transfer-engine/include/transport/cxl_transport/cxl_transport.h` (+27 -16) 📝 `mooncake-transfer-engine/include/transport/transport.h` (+1 -3) 📝 `mooncake-transfer-engine/src/multi_transport.cpp` (+8 -0) 📝 `mooncake-transfer-engine/src/transfer_engine.cpp` (+11 -0) 📝 `mooncake-transfer-engine/src/transfer_metadata.cpp` (+33 -2) 📝 `mooncake-transfer-engine/src/transport/cxl_transport/cxl_transport.cpp` (+292 -16) 📝 `mooncake-transfer-engine/tests/CMakeLists.txt` (+6 -0) ➕ `mooncake-transfer-engine/tests/cxl_transport_test.cpp` (+245 -0) </details> ### 📄 Description This PR providesd a transfer-engine framework based on CXL shared memory. In the current implementation, `submitTransfer` used `memcpy()` for data transfer. Future work may switch to DSA to avoid CPU cache flushes. --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>

bsakaguchi

2026-10-29 21:29:55 +00:00