mirror of
https://github.com/kvcache-ai/ktransformers.git
synced 2026-11-05 01:07:28 +00:00
[GH-ISSUE #894] merge_safetensor_gguf.py #644
Labels
No milestone
No project
No assignees
1 participant
Notifications
Due date
No due date set.
Dependencies
No dependencies set.
Reference
kvcache-ai/ktransformers#644
Loading…
Add table
Add a link
Reference in a new issue
No description provided.
Delete branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Originally created by @113514089 on GitHub (Mar 14, 2025).
Original GitHub issue: https://github.com/kvcache-ai/ktransformers/issues/894
Originally assigned to: @Azure-Tang on GitHub.
raise ValueError("No tensors to save")
ValueError: No tensors to save
造成这个有几种原因，帮忙分析下。
Namespace(safetensor_path='./deepseekr1fp8/q4km', gguf_path='./deepseekr1q4guff', output_path='./kt')
Traceback (most recent call last):
File "/ktransformers/merge_tensors/merge_safetensor_gguf.py", line 214, in
main()
File "/ktransformers/merge_tensors/merge_safetensor_gguf.py", line 209, in main
write_combined_tensor(target_tensor_map, output_path, gguf_loader)
File "/ktransformers/merge_tensors/merge_safetensor_gguf.py", line 121, in write_combined_tensor
@Azure-Tang commented on GitHub (Mar 15, 2025):
safetensor_path 应该传你下载的原精度fp8的safetensor的路径，您这传的是q4km的gguf
@113514089 commented on GitHub (Mar 17, 2025):
明白了，谢谢。