[GH-ISSUE #566] 请问下ktransformers是否支持跑蒸馏模型啊 #415

New issue

Closed

opened 2026-10-29 14:39:21 +00:00 by bsakaguchi · 4 comments

bsakaguchi commented

2026-10-29 14:39:21 +00:00

Owner

Originally created by @xzd20132443 on GitHub (Feb 21, 2025).
Original GitHub issue: https://github.com/kvcache-ai/ktransformers/issues/566

本地想跑70B的蒸馏模型，但是跑不起来，有大佬可以指点下吗

Originally created by @xzd20132443 on GitHub (Feb 21, 2025). Original GitHub issue: https://github.com/kvcache-ai/ktransformers/issues/566 本地想跑70B的蒸馏模型，但是跑不起来，有大佬可以指点下吗 ![Image](https://github.com/user-attachments/assets/0d0890c8-a9ce-4b42-a9bb-27110bc38883)

bsakaguchi

2026-10-29 14:39:21 +00:00

closed this issue
added the
stale
label

bsakaguchi commented

2026-10-29 14:39:22 +00:00

Author

Owner

@wjtxt commented on GitHub (Feb 21, 2025):

网络访问失败，检查网络可用性或者调整镜像配置试试

@wjtxt commented on GitHub (Feb 21, 2025): ![Image](https://github.com/user-attachments/assets/b8a86681-208f-4a6d-be23-cb3a4200552b) 网络访问失败，检查网络可用性或者调整镜像配置试试

bsakaguchi commented

2026-10-29 14:39:22 +00:00

Author

Owner

@ArSrNa commented on GitHub (Feb 23, 2025):

不支持，用1.5B，14B的均失败，但图中的问题不是因为模型，是下载的时候网络访问出错了

@ArSrNa commented on GitHub (Feb 23, 2025): 不支持，用1.5B，14B的均失败，但图中的问题不是因为模型，是下载的时候网络访问出错了

bsakaguchi commented

2026-10-29 14:39:23 +00:00

Author

Owner

@Mr-CaoMei commented on GitHub (Feb 25, 2025):

请问现在适配蒸馏模型了嘛，也想部署跑下

@Mr-CaoMei commented on GitHub (Feb 25, 2025): 请问现在适配蒸馏模型了嘛，也想部署跑下

bsakaguchi commented

2026-10-29 14:39:23 +00:00

Author

Owner

@ErvinXie commented on GitHub (Dec 11, 2025):

This issue has been automatically closed due to inactivity for 60 days.

If you believe this issue is still relevant, please feel free to reopen it with additional information or context.

Thank you for your contribution to KTransformers!

此 issue 因超过 60 天无活动而被自动关闭。

如果您认为此问题仍然存在，请随时重新打开并提供更多信息或上下文。

感谢您对 KTransformers 的贡献！

@ErvinXie commented on GitHub (Dec 11, 2025): This issue has been automatically closed due to inactivity for 60 days. If you believe this issue is still relevant, please feel free to reopen it with additional information or context. Thank you for your contribution to KTransformers! --- 此 issue 因超过 60 天无活动而被自动关闭。如果您认为此问题仍然存在，请随时重新打开并提供更多信息或上下文。感谢您对 KTransformers 的贡献！