mirror of
https://github.com/kvcache-ai/ktransformers.git
synced 2026-11-05 01:07:28 +00:00
[GH-ISSUE #620] cpu_infer 和config.yaml 里的cpu_infer 哪个优先级别高? cmd 里设置为infer-cpu=65 ,实际只有10 core被调用 #459
Labels
No milestone
No project
No assignees
1 participant
Notifications
Due date
No due date set.
Dependencies
No dependencies set.
Reference
kvcache-ai/ktransformers#459
Loading…
Add table
Add a link
Reference in a new issue
No description provided.
Delete branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Originally created by @montagetao on GitHub (Feb 23, 2025).
Original GitHub issue: https://github.com/kvcache-ai/ktransformers/issues/620
as title
@ubergarm commented on GitHub (Feb 23, 2025):
配置文件
config.yaml我也没太搞明白,所以干脆不用它。我习惯把所有参数都直接写在命令行里,这样更清晰。你可以参考这份ktransformers 构建与运行指南,里面有完整的命令行示例(包括如
何明确使用
--cpu_infer),应该能解决你的疑问。The config.yaml confuses me too, I don't use it. I pass everything on the command line to make it clear. Please take a look at this ktransformers build and running guide for a full command example including how to use
--cpu_inferwith no doubts.@montagetao commented on GitHub (Feb 23, 2025):
谢谢你的回复,应该是我的命令的参数写错了,kt 使用了confi.yaml里的配置,--cpu_infer在config.yaml默认配置10