[PR #17] [MERGED] Feature support multi instruct and docker building #1315

Closed
opened 2026-10-29 14:51:22 +00:00 by bsakaguchi · 0 comments
Owner

📋 Pull Request Information

Original PR: https://github.com/kvcache-ai/ktransformers/pull/17
Author: @UnicornChan
Created: 8/1/2024
Status: ✅ Merged
Merged: 8/1/2024
Merged by: @UnicornChan

Base: main ← Head: feature-support-multi-instruct


📝 Commits (2)

  • 112cb3c [feature] support python 310 and multi instruction
  • 86ba133 [feature] add support for building docker image

📊 Changes

9 files changed (+272 additions, -25 deletions)

View changed files

➕ Dockerfile (+34 -0)
📝 README.md (+18 -16)
➕ doc/en/Docker.md (+27 -0)
📝 doc/en/deepseek-v2-injection.md (+5 -1)
📝 ktransformers/__init__.py (+1 -1)
📝 ktransformers/ktransformers_ext/CMakeLists.txt (+45 -1)
➕ ktransformers/ktransformers_ext/cmake/FindSIMD.cmake (+100 -0)
📝 pyproject.toml (+3 -2)
📝 setup.py (+39 -4)

📄 Description

  1. support multiple cpu architecture pre compiled wheel package
  2. pre compile wheel package support multiple TORCH_CUDA_ARCH_LIST as "8.0;8.6;8.7;8.9"
  3. test and support python 3.10
  4. add a dockerfile to build docker image
  5. update README.md to support docker (In Progress: upload docker image)
  6. update version to 0.1.1

🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.

## 📋 Pull Request Information **Original PR:** https://github.com/kvcache-ai/ktransformers/pull/17 **Author:** [@UnicornChan](https://github.com/UnicornChan) **Created:** 8/1/2024 **Status:** ✅ Merged **Merged:** 8/1/2024 **Merged by:** [@UnicornChan](https://github.com/UnicornChan) **Base:** `main` ← **Head:** `feature-support-multi-instruct` --- ### 📝 Commits (2) - [`112cb3c`](https://github.com/kvcache-ai/ktransformers/commit/112cb3c962f9b20e6e265e87ed60051ad7e4ac20) [feature] support python 310 and multi instruction - [`86ba133`](https://github.com/kvcache-ai/ktransformers/commit/86ba1336a9e21339c2bc1b47548b39ec0cb7d324) [feature] add support for building docker image ### 📊 Changes **9 files changed** (+272 additions, -25 deletions) <details> <summary>View changed files</summary> ➕ `Dockerfile` (+34 -0) 📝 `README.md` (+18 -16) ➕ `doc/en/Docker.md` (+27 -0) 📝 `doc/en/deepseek-v2-injection.md` (+5 -1) 📝 `ktransformers/__init__.py` (+1 -1) 📝 `ktransformers/ktransformers_ext/CMakeLists.txt` (+45 -1) ➕ `ktransformers/ktransformers_ext/cmake/FindSIMD.cmake` (+100 -0) 📝 `pyproject.toml` (+3 -2) 📝 `setup.py` (+39 -4) </details> ### 📄 Description 1. support multiple cpu architecture pre compiled wheel package 2. pre compile wheel package support multiple TORCH_CUDA_ARCH_LIST as "8.0;8.6;8.7;8.9" 3. test and support python 3.10 4. add a dockerfile to build docker image 5. update README.md to support docker (In Progress: upload docker image) 6. update version to 0.1.1 --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>
bsakaguchi 2026-10-29 14:51:22 +00:00
Sign in to join this conversation.
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
kvcache-ai/ktransformers#1315
No description provided.