ai-toolkit/optimizers at e72b59a8e90c6e220ef2748017fb09648a7337a9 - ai-toolkit - Public git mirror

ostris/ai-toolkit

mirror of https://github.com/ostris/ai-toolkit.git synced 2026-02-05 04:59:56 +00:00

Files

History

Jaret Burkett e72b59a8e9 Added experimental 8bit version of prodigy with stochastic rounding and stochastic gradient accumulation. Still testing.

2024-10-29 14:28:28 -06:00

..

prodigy_8bit.py

Added experimental 8bit version of prodigy with stochastic rounding and stochastic gradient accumulation. Still testing.

2024-10-29 14:28:28 -06:00