mirror of
https://github.com/kvcache-ai/ktransformers.git
synced 2026-11-05 01:07:28 +00:00
[GH-ISSUE #844] 硬件配置和实际运行效果的信息收集 #607
Labels
No milestone
No project
No assignees
1 participant
Notifications
Due date
No due date set.
Dependencies
No dependencies set.
Reference
kvcache-ai/ktransformers#607
Loading…
Add table
Add a link
Reference in a new issue
No description provided.
Delete branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Originally created by @wait0423 on GitHub (Mar 8, 2025).
Original GitHub issue: https://github.com/kvcache-ai/ktransformers/issues/844
通过大家已经搭建起来的环境进行配置和性能参考,麻烦各位跑起来的大佬分享下自己的配置和性能信息,按照模板填写即可,谢谢!
运行环境
具体使用的模型版本(Q4KM、Q8KM等):
CPU型号(单、双路及核心线程数):
内存参数(单根容量、实际运行频率、内存数量、实际通道数):
GPU型号(备注显存大小):
运行时
CPU占用率:
GPU占用率:
内存容量占用率:
实际使用内存带宽:
实际推理速度:
@Azure-Tang commented on GitHub (Mar 8, 2025):
我们已经在做类似的配置收集并分享出来了;配置的收集详情可以见官方群里分享的链接https://swcil84qspu.feishu.cn/wiki/ZlhBwiSyEiZWyMkMdtDcpNyLnlf