ostris/ai-toolkit
1
0
Fork 0
mirror of https://github.com/ostris/ai-toolkit.git synced 2026-03-10 21:19:49 +00:00
Code Issues Packages Projects Releases Wiki Activity
773 Commits 10 Branches 0 Tags
b717586ee2285428d0905a2b1df7cbc6c4d684c3
Commit Graph

2 Commits

Author SHA1 Message Date
Jaret Burkett
58f9d01c2b Added adafactor implementation that handles stochastic rounding of update and accumulation 2024-10-30 05:25:57 -06:00
Jaret Burkett
e72b59a8e9 Added experimental 8bit version of prodigy with stochastic rounding and stochastic gradient accumulation. Still testing. 2024-10-29 14:28:28 -06:00