kvcache-ai/ktransformers

Fork 0

mirror of https://github.com/kvcache-ai/ktransformers.git synced 2026-11-05 01:07:28 +00:00

[GH-ISSUE #243] How to create optimize_rule for DeepSeek-R1-Q4_K_M #147

New issue

Closed

opened 2026-10-29 14:34:58 +00:00 by bsakaguchi · 6 comments

bsakaguchi commented

2026-10-29 14:34:58 +00:00

Owner

Originally created by @kerlion on GitHub (Feb 14, 2025).
Original GitHub issue: https://github.com/kvcache-ai/ktransformers/issues/243

I want to test DeepSeek-R1-Q4_K_M as a web service, but it seems that it needs a optimize_rule; but ktransformers only has 2 LLM Qwen2 and Deepseek-R2.
I want to know how to create an optimize_rule for DeepSeek-R1-Q4_K_M, or who can share a file?

Originally created by @kerlion on GitHub (Feb 14, 2025). Original GitHub issue: https://github.com/kvcache-ai/ktransformers/issues/243 I want to test DeepSeek-R1-Q4_K_M as a web service, but it seems that it needs a optimize_rule; but ktransformers only has 2 LLM Qwen2 and Deepseek-R2. I want to know how to create an optimize_rule for DeepSeek-R1-Q4_K_M, or who can share a file?

bsakaguchi

2026-10-29 14:34:58 +00:00

closed this issue
added the
stale
label

bsakaguchi commented

2026-10-29 14:34:58 +00:00

Author

Owner

@huang-hf commented on GitHub (Feb 14, 2025):

any update here？

@huang-hf commented on GitHub (Feb 14, 2025): any update here？

bsakaguchi commented

2026-10-29 14:34:59 +00:00

Author

Owner

@jhscut commented on GitHub (Feb 14, 2025):

I also need it, could you please share it with me

@jhscut commented on GitHub (Feb 14, 2025): I also need it, could you please share it with me

bsakaguchi commented

2026-10-29 14:34:59 +00:00

Author

Owner

@reason211 commented on GitHub (Feb 14, 2025):

I also need it, could you please share it with me

@reason211 commented on GitHub (Feb 14, 2025): I also need it, could you please share it with me

bsakaguchi commented

2026-10-29 14:34:59 +00:00

Author

Owner

@kissint8 commented on GitHub (Feb 14, 2025):

also need it, I'll watch this issue.

@kissint8 commented on GitHub (Feb 14, 2025): also need it, I'll watch this issue.

bsakaguchi commented

2026-10-29 14:34:59 +00:00

Author

Owner

@YoungITer commented on GitHub (Feb 16, 2025):

I also need it

@YoungITer commented on GitHub (Feb 16, 2025): I also need it

bsakaguchi commented

2026-10-29 14:34:59 +00:00

Author

Owner

@ErvinXie commented on GitHub (Dec 11, 2025):

This issue has been automatically closed due to inactivity for 60 days.

If you believe this issue is still relevant, please feel free to reopen it with additional information or context.

Thank you for your contribution to KTransformers!

此 issue 因超过 60 天无活动而被自动关闭。

如果您认为此问题仍然存在，请随时重新打开并提供更多信息或上下文。

感谢您对 KTransformers 的贡献！

@ErvinXie commented on GitHub (Dec 11, 2025): This issue has been automatically closed due to inactivity for 60 days. If you believe this issue is still relevant, please feel free to reopen it with additional information or context. Thank you for your contribution to KTransformers! --- 此 issue 因超过 60 天无活动而被自动关闭。如果您认为此问题仍然存在，请随时重新打开并提供更多信息或上下文。感谢您对 KTransformers 的贡献！

bsakaguchi referenced this issue

2026-10-29 14:35:58 +00:00

[GH-ISSUE #335] windows下运行报错 #216