[GH-ISSUE #1005] [Usage]: Is there any tool which can benchmark Mooncake + vLLM under PD disaggregation scenario with multi users and multi turns workload? #332

Closed
opened 2026-10-29 21:12:52 +00:00 by bsakaguchi · 2 comments
Owner

Originally created by @Wenwen-Chen on GitHub (Nov 3, 2025).
Original GitHub issue: https://github.com/kvcache-ai/Mooncake/issues/1005

Describe your usage question

Mooncake provided benchmarks/disagg_benchmarks/disagg_performance_benchmark.sh which can benchmark Mooncake + vLLM.
However, it only supports multi users and single turn.
Is there and tool can benchmark Mooncake + vLLM under PD disaggregation scenario with multi users and multi turns?
Or Mooncake has any plan to provide this kind of tool?

Before submitting a new issue...

  • Make sure you already searched for relevant issues and read the documentation
Originally created by @Wenwen-Chen on GitHub (Nov 3, 2025). Original GitHub issue: https://github.com/kvcache-ai/Mooncake/issues/1005 ### Describe your usage question Mooncake provided benchmarks/disagg_benchmarks/disagg_performance_benchmark.sh which can benchmark Mooncake + vLLM. However, it only supports multi users and single turn. Is there and tool can benchmark Mooncake + vLLM under PD disaggregation scenario with multi users and multi turns? Or Mooncake has any plan to provide this kind of tool? ### Before submitting a new issue... - [x] Make sure you already searched for relevant issues and read the [documentation](https://kvcache-ai.github.io/Mooncake/)
bsakaguchi 2026-10-29 21:12:52 +00:00
Author
Owner

@github-actions[bot] commented on GitHub (Jun 19, 2026):

This issue has had no activity for 90 days and will be closed in 7 days if there is no further activity. Please comment or react if it should stay open.

<!-- gh-comment-id:4748523264 --> @github-actions[bot] commented on GitHub (Jun 19, 2026): This issue has had no activity for 90 days and will be closed in 7 days if there is no further activity. Please comment or react if it should stay open.
Author
Owner

@github-actions[bot] commented on GitHub (Jun 26, 2026):

Closing due to 3 months of inactivity. If this is still relevant, please comment and we can reopen.

<!-- gh-comment-id:4806401459 --> @github-actions[bot] commented on GitHub (Jun 26, 2026): Closing due to 3 months of inactivity. If this is still relevant, please comment and we can reopen.
Sign in to join this conversation.
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
kvcache-ai/Mooncake#332
No description provided.