mirror of
https://github.com/deepseek-ai/DeepSeek-VL2.git
synced 2026-11-05 01:07:23 +00:00
[GH-ISSUE #31] AttributeError: 'QuantLinear' object has no attribute 'weight' #25
Labels
No labels
pull-request
No milestone
No project
No assignees
1 participant
Notifications
Due date
No due date set.
Dependencies
No dependencies set.
Reference
deepseek-ai/DeepSeek-VL2#25
Loading…
Add table
Add a link
Reference in a new issue
No description provided.
Delete branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Originally created by @n1ck-guo on GitHub (Jan 6, 2025).
Original GitHub issue: https://github.com/deepseek-ai/DeepSeek-VL2/issues/31
The commit
faf18023introduce a bug for quantized deepseek-vl2 model.AttributeError: 'QuantLinear' object has no attribute 'weight'.
It point to modeling_deepseek.py Line 888.
Old version does not have any problem.
test model address: https://huggingface.co/OPEA/deepseek-vl2-int4-sym-gptq-inc
@dprokhorov17 commented on GitHub (Jan 9, 2025):
Hey @n1ck-guo , I've already faced the same issue. Check out this one: https://huggingface.co/OPEA/deepseek-vl2-int4-sym-gptq-inc/discussions/3
@n1ck-guo commented on GitHub (Jan 10, 2025):
We uploaded the OPEA/deepseek-vl2-int4-sym-gptq-inc model and found this problem. We hope DeepSeek-VL2 could solve this in the future version so that we do not have to use the specific version for quantized model.