[GH-ISSUE #218] 增加R1使用多gpu的配置例子 #133

New issue

Closed

opened 2026-10-29 14:34:45 +00:00 by bsakaguchi · 4 comments

bsakaguchi commented

2026-10-29 14:34:45 +00:00

Owner

Originally created by @historyliao on GitHub (Feb 13, 2025).
Original GitHub issue: https://github.com/kvcache-ai/ktransformers/issues/218

目前只提供了V3的多gpu配置yaml例子，没有R1的。是否直接把V3替换成R1就可以使用？
另外，这种配置方法使用门槛太高了，使用方根本不知道有哪些module。

Originally created by @historyliao on GitHub (Feb 13, 2025). Original GitHub issue: https://github.com/kvcache-ai/ktransformers/issues/218 目前只提供了V3的多gpu配置yaml例子，没有R1的。是否直接把V3替换成R1就可以使用？另外，这种配置方法使用门槛太高了，使用方根本不知道有哪些module。

bsakaguchi

2026-10-29 14:34:45 +00:00

closed this issue
added the
stale
label

bsakaguchi commented

2026-10-29 14:34:46 +00:00

Author

Owner

@jhscut commented on GitHub (Feb 14, 2025):

R1的配置文件你有吗？可以分享下吗

@jhscut commented on GitHub (Feb 14, 2025): R1的配置文件你有吗？可以分享下吗

bsakaguchi commented

2026-10-29 14:34:46 +00:00

Author

Owner

@Radohead commented on GitHub (Feb 15, 2025):

r1架构与v3一致，所以用的同一个配置yaml吧

@Radohead commented on GitHub (Feb 15, 2025): r1架构与v3一致，所以用的同一个配置yaml吧

bsakaguchi commented

2026-10-29 14:34:46 +00:00

Author

Owner

@IYUYI commented on GitHub (Feb 19, 2025):

R1模型使用V3配置文件可行，命令如下
python -m ktransformers.local_chat --model_path /data/modelscope/deepseek-ai/DeepSeek-R1-Q4_K_M --gguf_path /data/modelscope/deepseek-ai/DeepSeek-R1-Q4_K_M/DeepSeek-R1-Q4_K_M --optimize_rule_path ktransformers/optimize/optimize_rules/DeepSeek-V3-Chat-multi-gpu-8.yaml --cpu_infer 96 --max_new_tokens 1000 --force_think true --host 127.0.0.1 --port 8888 --web true

@IYUYI commented on GitHub (Feb 19, 2025): R1模型使用V3配置文件可行，命令如下 python -m ktransformers.local_chat --model_path /data/modelscope/deepseek-ai/DeepSeek-R1-Q4_K_M --gguf_path /data/modelscope/deepseek-ai/DeepSeek-R1-Q4_K_M/DeepSeek-R1-Q4_K_M --optimize_rule_path ktransformers/optimize/optimize_rules/DeepSeek-V3-Chat-multi-gpu-8.yaml --cpu_infer 96 --max_new_tokens 1000 --force_think true --host 127.0.0.1 --port 8888 --web true

bsakaguchi commented

2026-10-29 14:34:47 +00:00

Author

Owner

@ErvinXie commented on GitHub (Dec 11, 2025):

This issue has been automatically closed due to inactivity for 60 days.

If you believe this issue is still relevant, please feel free to reopen it with additional information or context.

Thank you for your contribution to KTransformers!

此 issue 因超过 60 天无活动而被自动关闭。

如果您认为此问题仍然存在，请随时重新打开并提供更多信息或上下文。

感谢您对 KTransformers 的贡献！

@ErvinXie commented on GitHub (Dec 11, 2025): This issue has been automatically closed due to inactivity for 60 days. If you believe this issue is still relevant, please feel free to reopen it with additional information or context. Thank you for your contribution to KTransformers! --- 此 issue 因超过 60 天无活动而被自动关闭。如果您认为此问题仍然存在，请随时重新打开并提供更多信息或上下文。感谢您对 KTransformers 的贡献！