[GH-ISSUE #65] Would you support glm4-chat-1m #32

New issue

Closed

opened 2026-10-29 14:32:50 +00:00 by bsakaguchi · 2 comments

bsakaguchi commented

2026-10-29 14:32:50 +00:00

Owner

Originally created by @choyakawa on GitHub (Aug 29, 2024).
Original GitHub issue: https://github.com/kvcache-ai/ktransformers/issues/65

I have some concerns about this. Based on my experience, GGUF with llama.cpp seems to work differently from transformers, whereas GGML with chatglm.cpp behaves the same as transformers. I haven't yet identified the exact differences. Therefore, an optimization for long-context handling with transformers would be very helpful.

Originally created by @choyakawa on GitHub (Aug 29, 2024). Original GitHub issue: https://github.com/kvcache-ai/ktransformers/issues/65 I have some concerns about this. Based on my experience, GGUF with llama.cpp seems to work differently from transformers, whereas GGML with [chatglm.cpp](https://github.com/li-plus/chatglm.cpp) behaves the same as transformers. I haven't yet identified the exact differences. Therefore, an optimization for long-context handling with transformers would be very helpful.

bsakaguchi

2026-10-29 14:32:50 +00:00

closed this issue
added the
stale
label

bsakaguchi commented

2026-10-29 14:32:51 +00:00

Author

Owner

@qiyuxinlin commented on GitHub (Aug 30, 2024):

Thank you for following our work! we will take some time to evaluate how to incorporate glm4-chat-1m into our framework

@qiyuxinlin commented on GitHub (Aug 30, 2024): Thank you for following our work! we will take some time to evaluate how to incorporate glm4-chat-1m into our framework

bsakaguchi commented

2026-10-29 14:32:51 +00:00

Author

Owner

@ErvinXie commented on GitHub (Dec 11, 2025):

This issue has been automatically closed due to inactivity for 60 days.

If you believe this issue is still relevant, please feel free to reopen it with additional information or context.

Thank you for your contribution to KTransformers!

此 issue 因超过 60 天无活动而被自动关闭。

如果您认为此问题仍然存在，请随时重新打开并提供更多信息或上下文。

感谢您对 KTransformers 的贡献！

@ErvinXie commented on GitHub (Dec 11, 2025): This issue has been automatically closed due to inactivity for 60 days. If you believe this issue is still relevant, please feel free to reopen it with additional information or context. Thank you for your contribution to KTransformers! --- 此 issue 因超过 60 天无活动而被自动关闭。如果您认为此问题仍然存在，请随时重新打开并提供更多信息或上下文。感谢您对 KTransformers 的贡献！

bsakaguchi referenced this issue

2026-10-29 14:45:29 +00:00

[GH-ISSUE #1269] [Question] benchmark with evalscope failed #859

bsakaguchi referenced this issue

2026-10-29 14:45:38 +00:00

[GH-ISSUE #1286] [Bug] inference_context.v_cache[0][i] IndexError: list index out of range #871

bsakaguchi referenced this issue

2026-10-29 14:45:39 +00:00

[GH-ISSUE #1288] [Bug] #876