kvcache-ai/Mooncake

Fork 0

mirror of https://github.com/kvcache-ai/Mooncake.git synced 2026-11-05 01:17:55 +00:00

[GH-ISSUE #680] [Usage]: Questions about transfer engine #219

New issue

Closed

opened 2026-10-29 21:11:03 +00:00 by bsakaguchi · 6 comments

bsakaguchi commented

2026-10-29 21:11:03 +00:00

Owner

Originally created by @ptbxzrt on GitHub (Jul 28, 2025).
Original GitHub issue: https://github.com/kvcache-ai/Mooncake/issues/680

Describe your usage question

Appreciate your great work!!

I have a question. Suppose my initiator registers a buffer in VRAM and the underlying transport uses TCP. Is this approach feasible? I feel that TCP cannot directly transfer data from VRAM, but it seems that the source code does not handle this situation. Could you please clarify? Thank you so much!

Before submitting a new issue...

Make sure you already searched for relevant issues and read the documentation

Originally created by @ptbxzrt on GitHub (Jul 28, 2025). Original GitHub issue: https://github.com/kvcache-ai/Mooncake/issues/680 ### Describe your usage question Appreciate your great work!! I have a question. Suppose my initiator registers a buffer in VRAM and the underlying transport uses TCP. Is this approach feasible? I feel that TCP cannot directly transfer data from VRAM, but it seems that the source code does not handle this situation. Could you please clarify? Thank you so much! ### Before submitting a new issue... - [x] Make sure you already searched for relevant issues and read the [documentation](https://kvcache-ai.github.io/Mooncake/)

bsakaguchi

2026-10-29 21:11:03 +00:00

closed this issue
added the
stale

auto-closed
labels

bsakaguchi commented

2026-10-29 21:11:04 +00:00

Author

Owner

@stmatengss commented on GitHub (Jul 28, 2025):

Hi, we will merge this PR to support VRAM-to-VRAM transfer via TCP. I think it can satisfy your requirements. https://github.com/kvcache-ai/Mooncake/pull/609

@stmatengss commented on GitHub (Jul 28, 2025): Hi, we will merge this PR to support VRAM-to-VRAM transfer via TCP. I think it can satisfy your requirements. https://github.com/kvcache-ai/Mooncake/pull/609

bsakaguchi commented

2026-10-29 21:11:04 +00:00

Author

Owner

@ptbxzrt commented on GitHub (Jul 28, 2025):

Hi, we will merge this PR to support VRAM-to-VRAM transfer via TCP. I think it can satisfy your requirements. #609

Thanks! How about VRAM-to-DRAM and DRAM-to-VRAM, will these two features be supported in the future, or are they already supported?

@ptbxzrt commented on GitHub (Jul 28, 2025): > Hi, we will merge this PR to support VRAM-to-VRAM transfer via TCP. I think it can satisfy your requirements. [#609](https://github.com/kvcache-ai/Mooncake/pull/609) Thanks! How about VRAM-to-DRAM and DRAM-to-VRAM, will these two features be supported in the future, or are they already supported?

bsakaguchi commented

2026-10-29 21:11:04 +00:00

Author

Owner

@stmatengss commented on GitHub (Jul 28, 2025):

Hi, we will merge this PR to support VRAM-to-VRAM transfer via TCP. I think it can satisfy your requirements. #609

Thanks! How about VRAM-to-DRAM and DRAM-to-VRAM, will these two features be supported in the future, or are they already supported?

Please verify VRAM-to-DRAM and DRAM-to-VRAM functionality with GDDR support. If it's not working, feel free to submit a PR!

@stmatengss commented on GitHub (Jul 28, 2025): > > Hi, we will merge this PR to support VRAM-to-VRAM transfer via TCP. I think it can satisfy your requirements. [#609](https://github.com/kvcache-ai/Mooncake/pull/609) > > Thanks! How about VRAM-to-DRAM and DRAM-to-VRAM, will these two features be supported in the future, or are they already supported? Please verify VRAM-to-DRAM and DRAM-to-VRAM functionality with GDDR support. If it's not working, feel free to submit a PR!

bsakaguchi commented

2026-10-29 21:11:04 +00:00

Author

Owner

@ZhenshengWu commented on GitHub (Jul 28, 2025):

@ptbxzrt Please verify this PR https://github.com/kvcache-ai/Mooncake/pull/609 and share the test results with us.

@ZhenshengWu commented on GitHub (Jul 28, 2025): @ptbxzrt Please verify this PR https://github.com/kvcache-ai/Mooncake/pull/609 and share the test results with us.

bsakaguchi commented

2026-10-29 21:11:04 +00:00

Author

Owner

@github-actions[bot] commented on GitHub (Jun 29, 2026):

This issue has had no activity for 90 days and will be closed in 7 days if there is no further activity. Please comment or react if it should stay open.

@github-actions[bot] commented on GitHub (Jun 29, 2026): This issue has had no activity for 90 days and will be closed in 7 days if there is no further activity. Please comment or react if it should stay open.

bsakaguchi commented

2026-10-29 21:11:04 +00:00

Author

Owner

@github-actions[bot] commented on GitHub (Jul 7, 2026):

Closing due to 3 months of inactivity. If this is still relevant, please comment and we can reopen.

@github-actions[bot] commented on GitHub (Jul 7, 2026): Closing due to 3 months of inactivity. If this is still relevant, please comment and we can reopen.

bsakaguchi referenced this issue

2026-10-29 21:27:08 +00:00

[PR #219] [CLOSED] [MooncakeAdaptor] New tensor interface #1403