[GH-ISSUE #2] Inquiry Regarding Prefix Caching in the vllm Baseline #2

New issue

Closed

opened 2026-10-29 21:07:42 +00:00 by bsakaguchi · 3 comments

bsakaguchi commented

2026-10-29 21:07:42 +00:00

Owner

Originally created by @Lin-Qingyang-Alec on GitHub (Jul 27, 2024).
Original GitHub issue: https://github.com/kvcache-ai/Mooncake/issues/2

I hope this message finds you well. I recently read your technical report, and I found it very insightful. Thank you for sharing your work!

While reviewing the experimental details, I noticed some aspects related to the baseline were not entirely clear. Specifically, you mentioned using the vllm service as a baseline for Mooncake. I observed that Mooncake utilizes prefix caching technology, and I noticed that vllm has a startup parameter: --enable-prefix-caching, which seems to serve a similar purpose.

Could you kindly clarify whether you enabled this feature in the baseline during your experiments?

Thank you for your time, and I appreciate any insights you can provide.

Best regards.

Originally created by @Lin-Qingyang-Alec on GitHub (Jul 27, 2024). Original GitHub issue: https://github.com/kvcache-ai/Mooncake/issues/2 I hope this message finds you well. I recently read your technical report, and I found it very insightful. Thank you for sharing your work! While reviewing the experimental details, I noticed some aspects related to the baseline were not entirely clear. Specifically, you mentioned using the vllm service as a baseline for Mooncake. I observed that Mooncake utilizes prefix caching technology, and I noticed that vllm has a startup parameter: --enable-prefix-caching, which seems to serve a similar purpose. Could you kindly clarify whether you enabled this feature in the baseline during your experiments? Thank you for your time, and I appreciate any insights you can provide. Best regards.

bsakaguchi

2026-10-29 21:07:42 +00:00

closed this issue
added the
stale

auto-closed
labels

bsakaguchi commented

2026-10-29 21:07:43 +00:00

Author

Owner

@james0zan commented on GitHub (Aug 1, 2024):

The support of prefix cache in vLLM is later than our experiment thus we do not compare with it.

@james0zan commented on GitHub (Aug 1, 2024): The support of prefix cache in vLLM is later than our experiment thus we do not compare with it.

bsakaguchi commented

2026-10-29 21:07:43 +00:00

Author

Owner

@github-actions[bot] commented on GitHub (Jul 25, 2026):

This issue has had no activity for 90 days and will be closed in 7 days if there is no further activity. Please comment or react if it should stay open.

@github-actions[bot] commented on GitHub (Jul 25, 2026): This issue has had no activity for 90 days and will be closed in 7 days if there is no further activity. Please comment or react if it should stay open.

bsakaguchi commented

2026-10-29 21:07:43 +00:00

Author

Owner

@github-actions[bot] commented on GitHub (Aug 2, 2026):

Closing due to 3 months of inactivity. If this is still relevant, please comment and we can reopen.

@github-actions[bot] commented on GitHub (Aug 2, 2026): Closing due to 3 months of inactivity. If this is still relevant, please comment and we can reopen.

bsakaguchi referenced this issue

2026-10-29 21:16:19 +00:00

[GH-ISSUE #1986] [Bug]: SIGSEGV in MemcpyWorkerPool::workerThread under TCP transport with concurrent put/get #551

bsakaguchi referenced this issue

2026-10-29 21:17:01 +00:00

[GH-ISSUE #2185] [Usage]: Could the client reconnect to new master when it restarts? #599

bsakaguchi referenced this issue

2026-10-29 21:17:35 +00:00

[GH-ISSUE #2440] [Bug]: Execute mooncake+hixl, final destruction phase core #646

bsakaguchi referenced this issue

2026-10-29 21:19:34 +00:00

[GH-ISSUE #3066] [Bug]: Silent data corruption risk on Linux 5.15 when using io_uring offload due to broken short-read validation logic #789