[PR #682] fix: Fix typos in HumanEval evaluation code #289

New issue

Open

opened 2026-10-26 21:05:28 +00:00 by bsakaguchi · 0 comments

bsakaguchi commented

2026-10-26 21:05:28 +00:00

Owner

📋 Pull Request Information

Original PR: https://github.com/deepseek-ai/DeepSeek-Coder/pull/682
Author: @yurekami
Created: 12/25/2025
Status: 🔄 Open

Base: main ← Head: fix/typos-in-humaneval

📝 Commits (1)

0f29253 fix: Fix typos in HumanEval evaluation code

📊 Changes

2 files changed (+8 additions, -8 deletions)

View changed files

📝 Evaluation/HumanEval/eval_instruct.py (+6 -6)
📝 Evaluation/HumanEval/utils/utils.py (+2 -2)

📄 Description

Summary

Fixes several typos in the HumanEval evaluation code that could cause confusion.

Changes

`Evaluation/HumanEval/utils/utils.py`

Renamed languge_settings → language_settings (variable name typo)

`Evaluation/HumanEval/eval_instruct.py`

Updated import to use corrected language_settings name
Renamed function parameter languge → language in build_deepseekcoder_instruction()
Fixed error message typo: "Not fond" → "Not found"
Fixed argparse help text typo: "langauge" → "language"

Diff Summary

-languge_settings = {
+language_settings = {

-def build_deepseekcoder_instruction(languge: str, question: str):
+def build_deepseekcoder_instruction(language: str, question: str):

-'''.strip().format(languge.lower(), question.strip())
+'''.strip().format(language.lower(), question.strip())

-from utils.utils import extract_generation_code, languge_settings
+from utils.utils import extract_generation_code, language_settings

-    prompt = build_deepseekcoder_instruction(languge_settings[lang]['full_name'], ...)
+    prompt = build_deepseekcoder_instruction(language_settings[lang]['full_name'], ...)

-    assert os.path.exists(args.output_path), "Not fond output file: {}"
+    assert os.path.exists(args.output_path), "Not found output file: {}"

-    parser.add_argument('--language', type=str, help="langauge")
+    parser.add_argument('--language', type=str, help="language")

Test plan

Verify Python syntax is valid
Run HumanEval evaluation to verify no regressions

🤖 Generated with Claude Code

_{🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.}

## 📋 Pull Request Information **Original PR:** https://github.com/deepseek-ai/DeepSeek-Coder/pull/682 **Author:** [@yurekami](https://github.com/yurekami) **Created:** 12/25/2025 **Status:** 🔄 Open **Base:** `main` ← **Head:** `fix/typos-in-humaneval` --- ### 📝 Commits (1) - [`0f29253`](https://github.com/deepseek-ai/DeepSeek-Coder/commit/0f29253019dc5642b1a2ea4ee5ca35f5b1aecfcc) fix: Fix typos in HumanEval evaluation code ### 📊 Changes **2 files changed** (+8 additions, -8 deletions) <details> <summary>View changed files</summary> 📝 `Evaluation/HumanEval/eval_instruct.py` (+6 -6) 📝 `Evaluation/HumanEval/utils/utils.py` (+2 -2) </details> ### 📄 Description ## Summary Fixes several typos in the HumanEval evaluation code that could cause confusion. ## Changes ### `Evaluation/HumanEval/utils/utils.py` - Renamed `languge_settings` → `language_settings` (variable name typo) ### `Evaluation/HumanEval/eval_instruct.py` - Updated import to use corrected `language_settings` name - Renamed function parameter `languge` → `language` in `build_deepseekcoder_instruction()` - Fixed error message typo: "Not fond" → "Not found" - Fixed argparse help text typo: "langauge" → "language" ## Diff Summary ```diff -languge_settings = { +language_settings = { -def build_deepseekcoder_instruction(languge: str, question: str): +def build_deepseekcoder_instruction(language: str, question: str): -'''.strip().format(languge.lower(), question.strip()) +'''.strip().format(language.lower(), question.strip()) -from utils.utils import extract_generation_code, languge_settings +from utils.utils import extract_generation_code, language_settings - prompt = build_deepseekcoder_instruction(languge_settings[lang]['full_name'], ...) + prompt = build_deepseekcoder_instruction(language_settings[lang]['full_name'], ...) - assert os.path.exists(args.output_path), "Not fond output file: {}" + assert os.path.exists(args.output_path), "Not found output file: {}" - parser.add_argument('--language', type=str, help="langauge") + parser.add_argument('--language', type=str, help="language") ``` ## Test plan - [x] Verify Python syntax is valid - [ ] Run HumanEval evaluation to verify no regressions 🤖 Generated with [Claude Code](https://claude.com/claude-code) --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>

bsakaguchi added the

pull-request

label

2026-10-26 21:05:28 +00:00