Issues - kvcache-ai/ktransformers - Forgejo: Beyond coding. We Forge.

kvcache-ai/ktransformers

mirror of https://github.com/kvcache-ai/ktransformers.git synced 2026-11-05 01:07:28 +00:00

Search syntax

`assignee:<username>`	Filter by assigned user
`author:<username>`	Filter by the author
`is:all`	All
`is:closed`	Closed
`is:open`	Open
`mentions:<username>`	Filter by mentioned user
`modified:[>\|<]<date>`	Filter by last modified date
`review:<username>`	Filter by user who reviewed
`sort:<by>:[asc\|desc]`	Sort by: `created\|comments\|updated\|deadline`

New issue

[GH-ISSUE #1762] dockerfile里面的whl被移除了，无法部署docker

#1112 opened 2026-10-29 14:48:41 +00:00 by bsakaguchi 1 / 1

[GH-ISSUE #1761] 以原精度运行M2.1时占用内存异常，达到366G

#1111 opened 2026-10-29 14:48:41 +00:00 by bsakaguchi 1 / 1

[GH-ISSUE #1758] GLM-4.6V MOE_INT8

#1109 opened 2026-10-29 14:48:39 +00:00 by bsakaguchi 1 / 1

[GH-ISSUE #1741] GLM-4.7 Server starts but errors out at inferencing

#1101 opened 2026-10-29 14:48:33 +00:00 by bsakaguchi 1 / 1

[GH-ISSUE #1730] Performance Query: Is ~9.5 tokens/s normal for Kimi-K2-Thinking-Native on Xeon 6960P (MRDIMM 8800) + RTX 6000 Blackwell?

#1096 opened 2026-10-29 14:48:28 +00:00 by bsakaguchi 1 / 1

[GH-ISSUE #1714] Cannot find any model weights /workspace/sglang/python/sglang/srt/model_loader/loader.py

#1094 opened 2026-10-29 14:48:25 +00:00 by bsakaguchi 1 / 1

[GH-ISSUE #1705] W4A16 GPU model doesn't work [Qwen3-30B-A3B]

#1088 opened 2026-10-29 14:48:22 +00:00 by bsakaguchi 1 / 1

[GH-ISSUE #1694] amx.py: Segmentation Fault in AMX loading process with GLM 4.6 using hybrid inference

#1086 opened 2026-10-29 14:48:20 +00:00 by bsakaguchi 1 / 1

[GH-ISSUE #1690] 【ERROR】Install Ktransformers for AscendNPU

#1081 opened 2026-10-29 14:48:18 +00:00 by bsakaguchi 1 / 1

[GH-ISSUE #1681] How to use 2 16G GPUs to run kt-kernel 0.4.x

#1078 opened 2026-10-29 14:48:17 +00:00 by bsakaguchi 1 / 1

[GH-ISSUE #1655] GGUF format is not working with Deepseek-R1, GLM-4.5-AIR and GPT-OSS

#1068 opened 2026-10-29 14:48:10 +00:00 by bsakaguchi 1 / 1

[GH-ISSUE #1658] ktransformers cannot be used in SGLang

#1067 opened 2026-10-29 14:48:10 +00:00 by bsakaguchi 1 / 1

[GH-ISSUE #1651] kt-kernel 0.4.2 Kimi-K2 Thinking: torch.OutOfMemoryError: CUDA out of memory.

#1063 opened 2026-10-29 14:48:07 +00:00 by bsakaguchi 1 / 1

[GH-ISSUE #1650] DeepSeekV3.2 乱码

#1062 opened 2026-10-29 14:48:05 +00:00 by bsakaguchi 1 / 1

[GH-ISSUE #1649] Error what(): no weight source with GLM 4.6-INT8

#1061 opened 2026-10-29 14:48:05 +00:00 by bsakaguchi 1 / 1

[GH-ISSUE #1645] LLaMA‑Factory sft只能使用amx指令集吗？

#1060 opened 2026-10-29 14:48:05 +00:00 by bsakaguchi 1 / 1

[GH-ISSUE #1633] inter GPU Docker拉取报错

#1054 opened 2026-10-29 14:48:02 +00:00 by bsakaguchi 1 / 1

[GH-ISSUE #1618] [GLM-4.6 + KT-Kernel] TypeError in unquant.create_weights: w13_weight_n is None when enabling kt_ep_wrapper

#1052 opened 2026-10-29 14:47:59 +00:00 by bsakaguchi

[GH-ISSUE #729] [BUG]Ktransformer Docker镜像0.2.1/0.2.2部署Deepseek-r1671B Q4_K_M，OpenAI SDK访问出现 shape mismatch

#532 opened 2026-10-29 14:40:55 +00:00 by bsakaguchi

[GH-ISSUE #718] [BUG] Multiple GPUs report errors during conversations

#526 opened 2026-10-29 14:40:51 +00:00 by bsakaguchi