mirror of
https://github.com/kvcache-ai/Mooncake.git
synced 2026-11-05 01:17:55 +00:00
[GH-ISSUE #207] How to make a whole mooncake wheel package after make -j? #91
Labels
No labels
ascend
auto-closed
bug
bug
CI/Build
Common
documentation
enhancement
feature request
good first issue
help wanted
high priority
MetaX
nightly-failure
pull-request
PyTorch Backend
question
RFC
Roadmap
stale
Store
Tests
Transfer Engine
No milestone
No project
No assignees
1 participant
Notifications
Due date
No due date set.
Dependencies
No dependencies set.
Reference
kvcache-ai/Mooncake#91
Loading…
Add table
Add a link
Reference in a new issue
No description provided.
Delete branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Originally created by @Huixxi on GitHub (Apr 3, 2025).
Original GitHub issue: https://github.com/kvcache-ai/Mooncake/issues/207
I tried
python setup.py bdist_wheelwithin Mooncake/mooncake-wheel folder but it seems can not work.@stmatengss commented on GitHub (Apr 3, 2025):
Hi, you can produce a wheel package according to the procedures in https://github.com/kvcache-ai/Mooncake/blob/main/.github/workflows/release.yaml. BTW, we provide a whl package in the release page (https://github.com/kvcache-ai/Mooncake/releases/download/v0.3.0-alpha/mooncake_transfer_engine-0.3.0a0-cp310-cp310-manylinux2014_x86_64.whl). But, you should make sure the server is running Ubuntu 22.04 and python 3.10)
@Huixxi commented on GitHub (Apr 14, 2025):
Does mooncake+vllm still need etcd metadata server and a master server now?
@stmatengss commented on GitHub (Apr 16, 2025):
You now have flexible connection options! Choose between using a metadata server or establishing direct handshake connections. Experience these new features in our latest update.
@Huixxi commented on GitHub (Apr 17, 2025):
Hi~ I see mooncake+vllm supports dynamic adding instance into a running server(even though I met some hang problem and seems doesn't work that stable https://github.com/kvcache-ai/Mooncake/blob/main/doc/en/vllm-integration-v1.md#run-example). But what I want more to ask is whether it supports dynamic remove instances from a running server?