Jaret Burkett 92ce93140e Adjustments to defaults for automagic

2024-11-29 10:28:06 -07:00

..

adafactor.py

Added support for full finetuning flux with randomized param activation. Examples coming soon

2024-11-21 13:05:32 -07:00

adam8bit.py

Various bug fixes and optimizations for quantized training. Added untested custom adam8bit optimizer. Did some work on LoRM (dont use)

2024-11-20 09:16:55 -07:00

automagic.py

Adjustments to defaults for automagic

2024-11-29 10:28:06 -07:00

optimizer_utils.py

Fixed saving and displaying for automagic

2024-11-29 08:00:22 -07:00

prodigy_8bit.py

Added adafactor implementation that handles stochastic rounding of update and accumulation

2024-10-30 05:25:57 -06:00