[GH-ISSUE #678] web UI : Multiple conversations cannot be run simultaneously #493

New issue

Closed

opened 2026-10-29 14:40:28 +00:00 by bsakaguchi · 1 comment

bsakaguchi commented

2026-10-29 14:40:28 +00:00

Owner

Originally created by @jinsidong on GitHub (Feb 26, 2025).
Original GitHub issue: https://github.com/kvcache-ai/ktransformers/issues/678

When using Open WebUI to integrate with the KTransformers API, I encountered an issue where multiple conversations cannot be run simultaneously.
For example, the model's response to User A is displayed in User B's window. Is this expected behavior?

Additionally, if I use KTransformers' WebUI, does it support multiple concurrent sessions, or is KTransformers designed to only support single-user interactions?

thanks a lot lot ~~~

Originally created by @jinsidong on GitHub (Feb 26, 2025). Original GitHub issue: https://github.com/kvcache-ai/ktransformers/issues/678 When using Open WebUI to integrate with the KTransformers API, I encountered an issue where multiple conversations cannot be run simultaneously. For example, the model's response to User A is displayed in User B's window. Is this expected behavior? Additionally, if I use KTransformers' WebUI, does it support multiple concurrent sessions, or is KTransformers designed to only support single-user interactions? thanks a lot lot ~~~

bsakaguchi closed this issue

2026-10-29 14:40:29 +00:00

bsakaguchi commented

2026-10-29 14:40:29 +00:00

Author

Owner

@Azure-Tang commented on GitHub (Feb 27, 2025):

The KT only supports single batch for now, so it not support multiple concurrent sessions. We may add this support in the future.

@Azure-Tang commented on GitHub (Feb 27, 2025): The KT only supports single batch for now, so it not support multiple concurrent sessions. We may add this support in the future.