[GH-ISSUE #13] GPTQ模型量化 #10

Closed
opened 2026-10-26 21:01:36 +00:00 by bsakaguchi · 1 comment
Owner

Originally created by @315930399 on GitHub (Dec 4, 2023).
Original GitHub issue: https://github.com/deepseek-ai/DeepSeek-LLM/issues/13

请问可以提供一下量化后的模型吗?感谢!

Originally created by @315930399 on GitHub (Dec 4, 2023). Original GitHub issue: https://github.com/deepseek-ai/DeepSeek-LLM/issues/13 请问可以提供一下量化后的模型吗?感谢!
Author
Owner

@luofuli commented on GitHub (Dec 4, 2023):

@315930399
https://huggingface.co/TheBloke/deepseek-llm-7B-base-GPTQ

<!-- gh-comment-id:1838173509 --> @luofuli commented on GitHub (Dec 4, 2023): @315930399 https://huggingface.co/TheBloke/deepseek-llm-7B-base-GPTQ
Sign in to join this conversation.
No labels
bug
pull-request
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
deepseek-ai/DeepSeek-LLM#10
No description provided.