[PR #943] [MERGED] fix benchmark params for human eval benchmark #1524

New issue

Closed

opened 2026-10-29 14:53:12 +00:00 by bsakaguchi · 0 comments

bsakaguchi commented

2026-10-29 14:53:12 +00:00

Owner

📋 Pull Request Information

Original PR: https://github.com/kvcache-ai/ktransformers/pull/943
Author: @SkqLiao
Created: 3/20/2025
Status: ✅ Merged
Merged: 3/20/2025
Merged by: @SkqLiao

Base: main ← Head: main

📝 Commits (2)

8cc4df9 use DeepSeek V3 instead of R1 for benchmarking
6d4626a fix params

📊 Changes

1 file changed (+126 additions, -30 deletions)

View changed files

📝 ktransformers/tests/score.py (+126 -30)

📄 Description

No description provided

_{🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.}

## 📋 Pull Request Information **Original PR:** https://github.com/kvcache-ai/ktransformers/pull/943 **Author:** [@SkqLiao](https://github.com/SkqLiao) **Created:** 3/20/2025 **Status:** ✅ Merged **Merged:** 3/20/2025 **Merged by:** [@SkqLiao](https://github.com/SkqLiao) **Base:** `main` ← **Head:** `main` --- ### 📝 Commits (2) - [`8cc4df9`](https://github.com/kvcache-ai/ktransformers/commit/8cc4df980e153e5d057dda452bee2a651683360c) use DeepSeek V3 instead of R1 for benchmarking - [`6d4626a`](https://github.com/kvcache-ai/ktransformers/commit/6d4626a5d9bf130d844781a9ef93754d348f04ff) fix params ### 📊 Changes **1 file changed** (+126 additions, -30 deletions) <details> <summary>View changed files</summary> 📝 `ktransformers/tests/score.py` (+126 -30) </details> ### 📄 Description _No description provided_ --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>

bsakaguchi

2026-10-29 14:53:12 +00:00