[PR #24] [CLOSED] Windows #1318

New issue

Closed

opened 2026-10-29 14:51:24 +00:00 by bsakaguchi · 0 comments

bsakaguchi commented

2026-10-29 14:51:24 +00:00

Owner

📋 Pull Request Information

Original PR: https://github.com/kvcache-ai/ktransformers/pull/24
Author: @Atream
Created: 8/6/2024
Status: ❌ Closed

Base: main ← Head: windows

📝 Commits (5)

4e8bdc1 all compile can pass, but cpuinfer_ext can't init correctly
e1a7cf0 Fix bugs about vector reserve on windows
d3e65e2 windows can run deepseek v2, but not human language
70a633e fix bug
2c055ff windows pip install

📊 Changes

34 files changed (+285 additions, -111 deletions)

View changed files

➕ ktransformers/experts_test.py (+32 -0)
📝 ktransformers/ktransformers_ext/CMakeLists.txt (+10 -4)
📝 ktransformers/ktransformers_ext/cpu_backend/cpuinfer.h (+1 -0)
📝 ktransformers/ktransformers_ext/cpu_backend/task_queue.h (+39 -1)
📝 ktransformers/ktransformers_ext/cuda/gptq_marlin/gptq_marlin.cu (+54 -19)
📝 ktransformers/ktransformers_ext/cuda/setup.py (+3 -2)
📝 ktransformers/ktransformers_ext/operators/llamafile/mlp.cpp (+5 -5)
📝 ktransformers/ktransformers_ext/operators/llamafile/moe.cpp (+18 -18)
📝 ktransformers/ktransformers_ext/operators/llamafile/moe.h (+1 -1)
📝 ktransformers/local_chat.py (+1 -1)
📝 ktransformers/models/custom_cache.py (+3 -2)
📝 ktransformers/operators/experts.py (+10 -3)
📝 ktransformers/optimize/optimize_rules/DeepSeek-V2-Chat.yaml (+1 -1)
📝 ktransformers/util/custom_gguf.py (+62 -20)
📝 ktransformers/util/utils.py (+8 -7)
📝 setup.py (+4 -0)
📝 third_party/llamafile/iqk_mul_mat.inc (+4 -3)
📝 third_party/llamafile/iqk_mul_mat_amd_avx2.cpp (+1 -1)
📝 third_party/llamafile/iqk_mul_mat_amd_zen4.cpp (+1 -1)
📝 third_party/llamafile/sgemm.cpp (+12 -7)

...and 14 more files

📄 Description

support native windows

_{🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.}

## 📋 Pull Request Information **Original PR:** https://github.com/kvcache-ai/ktransformers/pull/24 **Author:** [@Atream](https://github.com/Atream) **Created:** 8/6/2024 **Status:** ❌ Closed **Base:** `main` ← **Head:** `windows` --- ### 📝 Commits (5) - [`4e8bdc1`](https://github.com/kvcache-ai/ktransformers/commit/4e8bdc152b5b2d6b93ac93b16a9246c0d0a37957) all compile can pass, but cpuinfer_ext can't init correctly - [`e1a7cf0`](https://github.com/kvcache-ai/ktransformers/commit/e1a7cf0e438a0ff47fe6dba8134c5d9f6a30e3ad) Fix bugs about vector reserve on windows - [`d3e65e2`](https://github.com/kvcache-ai/ktransformers/commit/d3e65e2c9cc1c87e0bb7bc3828f8544825cea32c) windows can run deepseek v2, but not human language - [`70a633e`](https://github.com/kvcache-ai/ktransformers/commit/70a633e35d79adbdfd6fbdc2431d7192406b01b3) fix bug - [`2c055ff`](https://github.com/kvcache-ai/ktransformers/commit/2c055ff7ba17a757667dcccfb204042bd4f0620d) windows pip install ### 📊 Changes **34 files changed** (+285 additions, -111 deletions) <details> <summary>View changed files</summary> ➕ `ktransformers/experts_test.py` (+32 -0) 📝 `ktransformers/ktransformers_ext/CMakeLists.txt` (+10 -4) 📝 `ktransformers/ktransformers_ext/cpu_backend/cpuinfer.h` (+1 -0) 📝 `ktransformers/ktransformers_ext/cpu_backend/task_queue.h` (+39 -1) 📝 `ktransformers/ktransformers_ext/cuda/gptq_marlin/gptq_marlin.cu` (+54 -19) 📝 `ktransformers/ktransformers_ext/cuda/setup.py` (+3 -2) 📝 `ktransformers/ktransformers_ext/operators/llamafile/mlp.cpp` (+5 -5) 📝 `ktransformers/ktransformers_ext/operators/llamafile/moe.cpp` (+18 -18) 📝 `ktransformers/ktransformers_ext/operators/llamafile/moe.h` (+1 -1) 📝 `ktransformers/local_chat.py` (+1 -1) 📝 `ktransformers/models/custom_cache.py` (+3 -2) 📝 `ktransformers/operators/experts.py` (+10 -3) 📝 `ktransformers/optimize/optimize_rules/DeepSeek-V2-Chat.yaml` (+1 -1) 📝 `ktransformers/util/custom_gguf.py` (+62 -20) 📝 `ktransformers/util/utils.py` (+8 -7) 📝 `setup.py` (+4 -0) 📝 `third_party/llamafile/iqk_mul_mat.inc` (+4 -3) 📝 `third_party/llamafile/iqk_mul_mat_amd_avx2.cpp` (+1 -1) 📝 `third_party/llamafile/iqk_mul_mat_amd_zen4.cpp` (+1 -1) 📝 `third_party/llamafile/sgemm.cpp` (+12 -7) _...and 14 more files_ </details> ### 📄 Description support native windows --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>

bsakaguchi

2026-10-29 14:51:24 +00:00