[GH-ISSUE #484] [Doc] Confused for sglang benchmark document #168

New issue

Closed

opened 2026-10-29 21:10:24 +00:00 by bsakaguchi · 3 comments

bsakaguchi commented

2026-10-29 21:10:24 +00:00

Owner

Originally created by @beaulian on GitHub (Jun 13, 2025).
Original GitHub issue: https://github.com/kvcache-ai/Mooncake/issues/484

Hi, I'm confused for the document "By comparing the performance of a 1P1D configuration with that of two regular (non-disaggregated) instances", what is the meaning of "two regular instances"? Launch two sglang instance with TP=1? How to benchmark two regular instances?

Originally created by @beaulian on GitHub (Jun 13, 2025). Original GitHub issue: https://github.com/kvcache-ai/Mooncake/issues/484 Hi, I'm confused for the document "**By comparing the performance of a 1P1D configuration with that of two regular (non-disaggregated) instances**", what is the meaning of "**two regular instances**"? Launch two sglang instance with TP=1? How to benchmark two regular instances?

bsakaguchi

2026-10-29 21:10:24 +00:00

closed this issue
added the
stale

auto-closed
labels

bsakaguchi commented

2026-10-29 21:10:25 +00:00

Author

Owner

@zhaoyongke commented on GitHub (Jun 14, 2025):

Regular instances do the Prefill & Decode work in the same node, no kvcaches transferred between them. They are independent.

@zhaoyongke commented on GitHub (Jun 14, 2025): Regular instances do the Prefill & Decode work in the same node, no kvcaches transferred between them. They are independent.

bsakaguchi commented

2026-10-29 21:10:25 +00:00

Author

Owner

@github-actions[bot] commented on GitHub (Jul 4, 2026):

This issue has had no activity for 90 days and will be closed in 7 days if there is no further activity. Please comment or react if it should stay open.

@github-actions[bot] commented on GitHub (Jul 4, 2026): This issue has had no activity for 90 days and will be closed in 7 days if there is no further activity. Please comment or react if it should stay open.

bsakaguchi commented

2026-10-29 21:10:25 +00:00

Author

Owner

@github-actions[bot] commented on GitHub (Jul 12, 2026):

Closing due to 3 months of inactivity. If this is still relevant, please comment and we can reopen.

@github-actions[bot] commented on GitHub (Jul 12, 2026): Closing due to 3 months of inactivity. If this is still relevant, please comment and we can reopen.

bsakaguchi referenced this issue

2026-10-29 21:26:49 +00:00

[PR #169] [MERGED] [TransferEngine] fix typos for cancel status in transfer engine #1368