[PR #839] [MERGED] fix flashinfer precision #1496

New issue

Closed

opened 2026-10-29 14:52:56 +00:00 by bsakaguchi · 0 comments

bsakaguchi commented

2026-10-29 14:52:56 +00:00

Owner

📋 Pull Request Information

Original PR: https://github.com/kvcache-ai/ktransformers/pull/839
Author: @Atream
Created: 3/7/2025
Status: ✅ Merged
Merged: 3/7/2025
Merged by: @Atream

Base: main ← Head: fix-precision-flashinfer

📝 Commits (1)

d453c32 fix flashinfer precision

📊 Changes

5 files changed (+148 additions, -58 deletions)

View changed files

📝 ktransformers/operators/attention.py (+1 -1)
📝 ktransformers/operators/flashinfer_wrapper.py (+143 -54)
📝 ktransformers/server/backend/interfaces/transformers.py (+1 -1)
📝 ktransformers/tests/humaneval/eval_api.py (+2 -1)
📝 ktransformers/util/utils.py (+1 -1)

📄 Description

fix flashinfer precision, human eval 89.6

_{🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.}

## 📋 Pull Request Information **Original PR:** https://github.com/kvcache-ai/ktransformers/pull/839 **Author:** [@Atream](https://github.com/Atream) **Created:** 3/7/2025 **Status:** ✅ Merged **Merged:** 3/7/2025 **Merged by:** [@Atream](https://github.com/Atream) **Base:** `main` ← **Head:** `fix-precision-flashinfer` --- ### 📝 Commits (1) - [`d453c32`](https://github.com/kvcache-ai/ktransformers/commit/d453c320f1aae2173a26abb6a9e0cedaf5915ae9) fix flashinfer precision ### 📊 Changes **5 files changed** (+148 additions, -58 deletions) <details> <summary>View changed files</summary> 📝 `ktransformers/operators/attention.py` (+1 -1) 📝 `ktransformers/operators/flashinfer_wrapper.py` (+143 -54) 📝 `ktransformers/server/backend/interfaces/transformers.py` (+1 -1) 📝 `ktransformers/tests/humaneval/eval_api.py` (+2 -1) 📝 `ktransformers/util/utils.py` (+1 -1) </details> ### 📄 Description fix flashinfer precision, human eval 89.6 --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>

bsakaguchi

2026-10-29 14:52:56 +00:00