5 Commits

Author	SHA1	Message	Date
Jaret Burkett	989ebfaa11	Added a basic torch profiler that can be used in config during development to find some obvious issues.	2025-06-17 13:03:39 -06:00
Jaret Burkett	f213996aa5	Fixed saving and displaying for automagic	2024-11-29 08:00:22 -07:00
Jaret Burkett	894374b2e9	Various bug fixes and optimizations for quantized training. Added untested custom adam8bit optimizer. Did some work on LoRM (dont use)	2024-11-20 09:16:55 -07:00
Jaret Burkett	025ee3dd3d	Added ability for adafactor to fully fine tune quantized model.	2024-10-30 16:38:07 -06:00
Jaret Burkett	58f9d01c2b	Added adafactor implementation that handles stochastic rounding of update and accumulation	2024-10-30 05:25:57 -06:00