[GH-ISSUE #620] cpu_infer 和config.yaml 里的cpu_infer 哪个优先级别高? cmd 里设置为infer-cpu=65 ,实际只有10 core被调用 #459

Closed
opened 2026-10-29 14:39:59 +00:00 by bsakaguchi · 2 comments
Owner

Originally created by @montagetao on GitHub (Feb 23, 2025).
Original GitHub issue: https://github.com/kvcache-ai/ktransformers/issues/620

as title

Originally created by @montagetao on GitHub (Feb 23, 2025). Original GitHub issue: https://github.com/kvcache-ai/ktransformers/issues/620 as title
Author
Owner

@ubergarm commented on GitHub (Feb 23, 2025):

配置文件 config.yaml 我也没太搞明白,所以干脆不用它。我习惯把所有参数都直接写在命令行里,这样更清晰。你可以参考这份
ktransformers 构建与运行指南,里面有完整的命令行示例(包括如
何明确使用 --cpu_infer),应该能解决你的疑问。


The config.yaml confuses me too, I don't use it. I pass everything on the command line to make it clear. Please take a look at this ktransformers build and running guide for a full command example including how to use --cpu_infer with no doubts.

<!-- gh-comment-id:2677015985 --> @ubergarm commented on GitHub (Feb 23, 2025): 配置文件 `config.yaml` 我也没太搞明白,所以干脆不用它。我习惯把所有参数都直接写在命令行里,这样更清晰。你可以参考这份 [ktransformers 构建与运行指南](https://github.com/ubergarm/r1-ktransformers-guide/blob/main/README.zh.md),里面有完整的命令行示例(包括如 何明确使用 `--cpu_infer`),应该能解决你的疑问。 --- The config.yaml confuses me too, I don't use it. I pass everything on the command line to make it clear. Please take a look at this [ktransformers build and running guide](https://github.com/ubergarm/r1-ktransformers-guide/blob/main/README.zh.md) for a full command example including how to use `--cpu_infer` with no doubts.
Author
Owner

@montagetao commented on GitHub (Feb 23, 2025):

配置文件 config.yaml 我也没太搞明白,所以干脆不用它。我习惯把所有参数都直接写在命令行里,这样更清晰。你可以参考这份 ktransformers 构建与运行指南,里面有完整的命令行示例(包括如 何明确使用 --cpu_infer),应该能解决你的疑问。

The config.yaml confuses me too, I don't use it. I pass everything on the command line to make it clear. Please take a look at this ktransformers build and running guide for a full command example including how to use --cpu_infer with no dou

谢谢你的回复,应该是我的命令的参数写错了,kt 使用了confi.yaml里的配置,--cpu_infer在config.yaml默认配置10

<!-- gh-comment-id:2677166938 --> @montagetao commented on GitHub (Feb 23, 2025): > 配置文件 `config.yaml` 我也没太搞明白,所以干脆不用它。我习惯把所有参数都直接写在命令行里,这样更清晰。你可以参考这份 [ktransformers 构建与运行指南](https://github.com/ubergarm/r1-ktransformers-guide/blob/main/README.zh.md),里面有完整的命令行示例(包括如 何明确使用 `--cpu_infer`),应该能解决你的疑问。 > > The config.yaml confuses me too, I don't use it. I pass everything on the command line to make it clear. Please take a look at this [ktransformers build and running guide](https://github.com/ubergarm/r1-ktransformers-guide/blob/main/README.zh.md) for a full command example including how to use `--cpu_infer` with no dou 谢谢你的回复,应该是我的命令的参数写错了,kt 使用了confi.yaml里的配置,--cpu_infer在config.yaml默认配置10
Sign in to join this conversation.
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
kvcache-ai/ktransformers#459
No description provided.