[GH-ISSUE #25] 有无计划发布量化后的版本 #17

New issue

Open

opened 2026-10-26 21:02:16 +00:00 by bsakaguchi · 2 comments

bsakaguchi commented

2026-10-26 21:02:16 +00:00

Owner

Originally created by @yonghanzhuce on GitHub (Nov 10, 2023).
Original GitHub issue: https://github.com/deepseek-ai/DeepSeek-Coder/issues/25

想问一下有无计划发布int4，或int8量化后的模型

Originally created by @yonghanzhuce on GitHub (Nov 10, 2023). Original GitHub issue: https://github.com/deepseek-ai/DeepSeek-Coder/issues/25 想问一下有无计划发布int4，或int8量化后的模型

bsakaguchi commented

2026-10-26 21:02:17 +00:00

Author

Owner

@guoday commented on GitHub (Nov 22, 2023):

已有社区开源了量化后的模型：https://huggingface.co/TheBloke/deepseek-coder-33B-instruct-GPTQ

@guoday commented on GitHub (Nov 22, 2023): 已有社区开源了量化后的模型：https://huggingface.co/TheBloke/deepseek-coder-33B-instruct-GPTQ

bsakaguchi commented

2026-10-26 21:02:17 +00:00

Author

Owner

@shuaizai88 commented on GitHub (Jan 17, 2024):

我的p40 显卡只支持fp32和int8 。。量化版本能支持用int8跑吗?

@shuaizai88 commented on GitHub (Jan 17, 2024): 我的p40 显卡只支持fp32和int8 。。量化版本能支持用int8跑吗?