kvcache-ai/Mooncake

Fork 0

mirror of https://github.com/kvcache-ai/Mooncake.git synced 2026-11-05 01:17:55 +00:00

[GH-ISSUE #242] How to use http backend with vllm #98

New issue

Closed

opened 2026-10-29 21:09:16 +00:00 by bsakaguchi · 6 comments

bsakaguchi commented

2026-10-29 21:09:16 +00:00

Owner

Originally created by @cyber-pioneer on GitHub (Apr 14, 2025).
Original GitHub issue: https://github.com/kvcache-ai/Mooncake/issues/242

In the instruction, there is only metadata_server example about etcd backend but no case about http backend.
https://github.com/kvcache-ai/Mooncake/blob/main/doc/en/vllm-integration-v1.md

Originally created by @cyber-pioneer on GitHub (Apr 14, 2025). Original GitHub issue: https://github.com/kvcache-ai/Mooncake/issues/242 In the instruction, there is only metadata_server example about etcd backend but no case about **http backend**. https://github.com/kvcache-ai/Mooncake/blob/main/doc/en/vllm-integration-v1.md <img width="1060" alt="Image" src="https://github.com/user-attachments/assets/ec53ac30-2f75-4069-8c47-64821a3e5b5b" />

bsakaguchi

2026-10-29 21:09:16 +00:00

closed this issue
added the
stale

auto-closed
labels

bsakaguchi commented

2026-10-29 21:09:16 +00:00

Author

Owner

@ShangmingCai commented on GitHub (Apr 14, 2025):

You can refer to the doc.

@ShangmingCai commented on GitHub (Apr 14, 2025): You can refer to the [doc](https://github.com/kvcache-ai/Mooncake/blob/main/doc/en/transfer-engine.md).

bsakaguchi commented

2026-10-29 21:09:17 +00:00

Author

Owner

@xiaguan commented on GitHub (Apr 14, 2025):

Perhaps we could include an executable like mooncake_http_metadata in the Python package?

@xiaguan commented on GitHub (Apr 14, 2025): Perhaps we could include an executable like `mooncake_http_metadata` in the Python package?

bsakaguchi commented

2026-10-29 21:09:17 +00:00

Author

Owner

@ShangmingCai commented on GitHub (Apr 14, 2025):

Perhaps we could include an executable like mooncake_http_metadata in the Python package?

Yes, it is achievable. Something like python -m mooncake.metadata_server --port xxx

@ShangmingCai commented on GitHub (Apr 14, 2025): > Perhaps we could include an executable like `mooncake_http_metadata` in the Python package? Yes, it is achievable. Something like `python -m mooncake.metadata_server --port xxx`

bsakaguchi commented

2026-10-29 21:09:17 +00:00

Author

Owner

@stmatengss commented on GitHub (Apr 14, 2025):

#245 Here is an implementation of python http metadata server in SGLang. I think we can add it to the wheel package.

@stmatengss commented on GitHub (Apr 14, 2025): #245 Here is an implementation of python http metadata server in SGLang. I think we can add it to the wheel package.

bsakaguchi commented

2026-10-29 21:09:17 +00:00

Author

Owner

@github-actions[bot] commented on GitHub (Jul 18, 2026):

This issue has had no activity for 90 days and will be closed in 7 days if there is no further activity. Please comment or react if it should stay open.

@github-actions[bot] commented on GitHub (Jul 18, 2026): This issue has had no activity for 90 days and will be closed in 7 days if there is no further activity. Please comment or react if it should stay open.

bsakaguchi commented

2026-10-29 21:09:17 +00:00

Author

Owner

@github-actions[bot] commented on GitHub (Jul 25, 2026):

Closing due to 3 months of inactivity. If this is still relevant, please comment and we can reopen.

@github-actions[bot] commented on GitHub (Jul 25, 2026): Closing due to 3 months of inactivity. If this is still relevant, please comment and we can reopen.