[GH-ISSUE #31] using docker start api server can't set max_new_tokens #18

New issue

Closed

opened 2026-10-29 14:32:41 +00:00 by bsakaguchi · 2 comments

bsakaguchi commented

2026-10-29 14:32:41 +00:00

Owner

Originally created by @goldenquant on GitHub (Aug 12, 2024).
Original GitHub issue: https://github.com/kvcache-ai/ktransformers/issues/31

using docker start api server can't set max_new_tokens

Originally created by @goldenquant on GitHub (Aug 12, 2024). Original GitHub issue: https://github.com/kvcache-ai/ktransformers/issues/31 using docker start api server can't set max_new_tokens

bsakaguchi

2026-10-29 14:32:41 +00:00

closed this issue
added the
stale
label

bsakaguchi commented

2026-10-29 14:32:42 +00:00

Author

Owner

@UnicornChan commented on GitHub (Aug 15, 2024):

In the past few days, we have been focusing on enhancing support for native Windows, multiple GPUs. About making improvements to the server and Docker. These updates will be released in the next version.

@UnicornChan commented on GitHub (Aug 15, 2024): In the past few days, we have been focusing on enhancing support for native Windows, multiple GPUs. About making improvements to the server and Docker. These updates will be released in the next version.

bsakaguchi commented

2026-10-29 14:32:42 +00:00

Author

Owner

@ErvinXie commented on GitHub (Dec 11, 2025):

This issue has been automatically closed due to inactivity for 60 days.

If you believe this issue is still relevant, please feel free to reopen it with additional information or context.

Thank you for your contribution to KTransformers!

此 issue 因超过 60 天无活动而被自动关闭。

如果您认为此问题仍然存在，请随时重新打开并提供更多信息或上下文。

感谢您对 KTransformers 的贡献！

@ErvinXie commented on GitHub (Dec 11, 2025): This issue has been automatically closed due to inactivity for 60 days. If you believe this issue is still relevant, please feel free to reopen it with additional information or context. Thank you for your contribution to KTransformers! --- 此 issue 因超过 60 天无活动而被自动关闭。如果您认为此问题仍然存在，请随时重新打开并提供更多信息或上下文。感谢您对 KTransformers 的贡献！

bsakaguchi referenced this issue

2026-10-29 14:45:29 +00:00

[GH-ISSUE #1269] [Question] benchmark with evalscope failed #859

bsakaguchi referenced this issue

2026-10-29 14:45:38 +00:00

[GH-ISSUE #1286] [Bug] inference_context.v_cache[0][i] IndexError: list index out of range #871

bsakaguchi referenced this issue

2026-10-29 14:45:39 +00:00

[GH-ISSUE #1288] [Bug] #876

bsakaguchi referenced this issue

2026-10-29 14:51:23 +00:00

[PR #18] [MERGED] update docker.md to support docker pull image #1317