[GH-ISSUE #799] [Feature Request]: Zero copy for get_tensor Mooncake store Python API #244

New issue

Closed

opened 2026-10-29 21:11:27 +00:00 by bsakaguchi · 2 comments

bsakaguchi commented

2026-10-29 21:11:27 +00:00

Owner

Originally created by @jerrychenhf on GitHub (Sep 2, 2025).
Original GitHub issue: https://github.com/kvcache-ai/Mooncake/issues/799

Describe your feature request

The current get_tensor implementation first get data to local buffer and then copy the data buffer to a newly allocated buffer. And then created a pytorch tensor using the new buffer.

The copy can be avoided by directly allocating the buffer with desired size and register the buffer for transfer engine. And get the data directly into the allocated buffer.

Before submitting a new issue...

Make sure you already searched for relevant issues and read the documentation

Originally created by @jerrychenhf on GitHub (Sep 2, 2025). Original GitHub issue: https://github.com/kvcache-ai/Mooncake/issues/799 ### Describe your feature request The current get_tensor implementation first get data to local buffer and then copy the data buffer to a newly allocated buffer. And then created a pytorch tensor using the new buffer. The copy can be avoided by directly allocating the buffer with desired size and register the buffer for transfer engine. And get the data directly into the allocated buffer. ### Before submitting a new issue... - [ ] Make sure you already searched for relevant issues and read the [documentation](https://kvcache-ai.github.io/Mooncake/)

bsakaguchi

2026-10-29 21:11:27 +00:00

closed this issue
added the
stale

auto-closed
labels

bsakaguchi commented

2026-10-29 21:11:28 +00:00

Author

Owner

@github-actions[bot] commented on GitHub (Jun 27, 2026):

This issue has had no activity for 90 days and will be closed in 7 days if there is no further activity. Please comment or react if it should stay open.

@github-actions[bot] commented on GitHub (Jun 27, 2026): This issue has had no activity for 90 days and will be closed in 7 days if there is no further activity. Please comment or react if it should stay open.

bsakaguchi commented

2026-10-29 21:11:28 +00:00

Author

Owner

@github-actions[bot] commented on GitHub (Jul 5, 2026):

Closing due to 3 months of inactivity. If this is still relevant, please comment and we can reopen.

@github-actions[bot] commented on GitHub (Jul 5, 2026): Closing due to 3 months of inactivity. If this is still relevant, please comment and we can reopen.

bsakaguchi referenced this issue

2026-10-29 21:27:19 +00:00

[PR #244] [MERGED] [Feature] support auto-detect topo for both GPUs and CPUs #1424

bsakaguchi referenced this issue

2026-10-29 21:27:23 +00:00

[PR #258] [MERGED] [TransferEngine] bugfix: fix regression in #244 #1431