mirror of
https://github.com/deepseek-ai/DeepSeek-Coder.git
synced 2026-11-05 00:57:19 +00:00
[GH-ISSUE #179] 6.7B模型量化失败，但是33B模型能够正常量化 #155
Labels
No labels
documentation
ENV
pull-request
research question
WIP
No milestone
No project
No assignees
1 participant
Notifications
Due date
No due date set.
Dependencies
No dependencies set.
Reference
deepseek-ai/DeepSeek-Coder#155
Loading…
Add table
Add a link
Reference in a new issue
No description provided.
Delete branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Originally created by @Soulscb on GitHub (Aug 30, 2024).
Original GitHub issue: https://github.com/deepseek-ai/DeepSeek-Coder/issues/179
你好，目前我正在量化deepseek-coder-6.7B，但是量化到97%会报错，然而我量化33B是正常的，量化采用awq，aotuawq = 0.2.6
，并且 group_size=128，GEMM，请问你们是如何量化的？