Jaret Burkett 025ee3dd3d Added ability for adafactor to fully fine tune quantized model.

2024-10-30 16:38:07 -06:00

..

adafactor.py

Added ability for adafactor to fully fine tune quantized model.

2024-10-30 16:38:07 -06:00

optimizer_utils.py

Added ability for adafactor to fully fine tune quantized model.

2024-10-30 16:38:07 -06:00

prodigy_8bit.py

Added adafactor implementation that handles stochastic rounding of update and accumulation

2024-10-30 05:25:57 -06:00