[GH-ISSUE #46] Humaneval, use base model or instruct finetuned model? #30

Open
opened 2026-10-26 21:01:51 +00:00 by bsakaguchi · 1 comment
Owner

Originally created by @jasonzliang on GitHub (Mar 28, 2024).
Original GitHub issue: https://github.com/deepseek-ai/DeepSeek-LLM/issues/46

Which one would you recommend to use to get the best possible performance?

Originally created by @jasonzliang on GitHub (Mar 28, 2024). Original GitHub issue: https://github.com/deepseek-ai/DeepSeek-LLM/issues/46 Which one would you recommend to use to get the best possible performance?
Author
Owner

@DeepSeekPH commented on GitHub (Apr 2, 2024):

The finetuned model yields better Humaneval results.

<!-- gh-comment-id:2030948989 --> @DeepSeekPH commented on GitHub (Apr 2, 2024): The finetuned model yields better Humaneval results.
Sign in to join this conversation.
No labels
bug
pull-request
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
deepseek-ai/DeepSeek-LLM#30
No description provided.