[GH-ISSUE #1541] 70b #1028

New issue

Open

opened 2026-10-29 14:47:37 +00:00 by bsakaguchi · 0 comments

bsakaguchi commented

2026-10-29 14:47:37 +00:00

Owner

Originally created by @kmnnmk212-source on GitHub (Nov 2, 2025).
Original GitHub issue: https://github.com/kvcache-ai/ktransformers/issues/1541

Checklist

1. If the issue you raised is not a feature but a question, please raise a discussion at https://github.com/kvcache-ai/ktransformers/discussions. Otherwise, it will be closed.
2. To help the community, I will use Chinese/English or attach an Chinese/English translation if using another language. Non-English/Chinese content without translation may be closed.

Motivation

Can small models be supported?

32b
70b

??????????

Originally created by @kmnnmk212-source on GitHub (Nov 2, 2025). Original GitHub issue: https://github.com/kvcache-ai/ktransformers/issues/1541 ### Checklist - [ ] 1. If the issue you raised is not a feature but a question, please raise a discussion at https://github.com/kvcache-ai/ktransformers/discussions. Otherwise, it will be closed. - [ ] 2. To help the community, I will use Chinese/English or attach an Chinese/English translation if using another language. Non-English/Chinese content without translation may be closed. ### Motivation Can small models be supported? 32b 70b ### Related resources ??????????