[PR #791] [MERGED] ⚡ add humaneval support #1482

New issue

Closed

opened 2026-10-29 14:52:48 +00:00 by bsakaguchi · 0 comments

bsakaguchi commented

2026-10-29 14:52:48 +00:00

Owner

📋 Pull Request Information

Original PR: https://github.com/kvcache-ai/ktransformers/pull/791
Author: @KMSorSMS
Created: 3/4/2025
Status: ✅ Merged
Merged: 3/5/2025
Merged by: @Atream

Base: develop-0.2.3 ← Head: develop-0.2.3

📝 Commits (1)

dc10480 ⚡ add humaneval support

📊 Changes

7 files changed (+130 additions, -4 deletions)

View changed files

📝 Makefile (+7 -0)
➕ ktransformers/tests/.gitignore (+1 -0)
➕ ktransformers/tests/humaneval/eval_api.py (+89 -0)
➕ ktransformers/tests/humaneval/evaluation.py (+15 -0)
➕ ktransformers/tests/humaneval/prompts.py (+14 -0)
📝 ktransformers/tests/mmlu_pro_test.py (+2 -2)
📝 ktransformers/tests/mmlu_test.py (+2 -2)

📄 Description

No description provided

_{🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.}

## 📋 Pull Request Information **Original PR:** https://github.com/kvcache-ai/ktransformers/pull/791 **Author:** [@KMSorSMS](https://github.com/KMSorSMS) **Created:** 3/4/2025 **Status:** ✅ Merged **Merged:** 3/5/2025 **Merged by:** [@Atream](https://github.com/Atream) **Base:** `develop-0.2.3` ← **Head:** `develop-0.2.3` --- ### 📝 Commits (1) - [`dc10480`](https://github.com/kvcache-ai/ktransformers/commit/dc10480ef606f8af752b110a8a5c3d487cf1738c) :zap: add humaneval support ### 📊 Changes **7 files changed** (+130 additions, -4 deletions) <details> <summary>View changed files</summary> 📝 `Makefile` (+7 -0) ➕ `ktransformers/tests/.gitignore` (+1 -0) ➕ `ktransformers/tests/humaneval/eval_api.py` (+89 -0) ➕ `ktransformers/tests/humaneval/evaluation.py` (+15 -0) ➕ `ktransformers/tests/humaneval/prompts.py` (+14 -0) 📝 `ktransformers/tests/mmlu_pro_test.py` (+2 -2) 📝 `ktransformers/tests/mmlu_test.py` (+2 -2) </details> ### 📄 Description _No description provided_ --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>

bsakaguchi

2026-10-29 14:52:48 +00:00