[GH-ISSUE #42] Scaling laws data #27

New issue

Open

opened 2026-10-26 21:01:49 +00:00 by bsakaguchi · 1 comment

bsakaguchi commented

2026-10-26 21:01:49 +00:00

Owner

Originally created by @borgr on GitHub (Feb 29, 2024).
Original GitHub issue: https://github.com/deepseek-ai/DeepSeek-LLM/issues/42

I am researching scaling laws across models and architectures among other things and was wondering if you could share the logs\training losses\val eval of the models you have ran for the scaling law experiments in DeepSeek LLM. If you have other similar losses or results it would also be interesting. It might not be super well curated, anything can be helpful.
Thanks

Originally created by @borgr on GitHub (Feb 29, 2024). Original GitHub issue: https://github.com/deepseek-ai/DeepSeek-LLM/issues/42 I am researching scaling laws across models and architectures among other things and was wondering if you could share the logs\training losses\val eval of the models you have ran for the scaling law experiments in DeepSeek LLM. If you have other similar losses or results it would also be interesting. It might not be super well curated, anything can be helpful. Thanks

bsakaguchi commented

2026-10-26 21:01:50 +00:00

Author

Owner

@borgr commented on GitHub (Feb 29, 2024):

Also the model losses from the figure, are they available somewhere?

@borgr commented on GitHub (Feb 29, 2024): Also the model losses from the figure, are they available somewhere?

bsakaguchi referenced this issue

2026-10-26 21:02:35 +00:00

[PR #27] [MERGED] Update README.md #92