10 Commits

Author	SHA1	Message	Date
Jaret Burkett	833c833f28	WIP on SAFE encoder. Work on fp16 training improvements. Various other tweaks and improvements	2024-05-27 10:50:24 -06:00
Jaret Burkett	68b7e159bc	Bug Fixes	2024-05-17 08:41:20 -06:00
Jaret Burkett	5a45c709cd	Work on ipadapters and custom adapters	2024-05-13 06:37:54 -06:00
Jaret Burkett	7284aab7c0	Added specialized scaler training to ip adapters	2024-04-05 08:17:09 -06:00
Jaret Burkett	016687bda1	Adapter work. Bug fixes. Auto adjust LR when resuming optimizer.	2024-03-17 10:21:47 -06:00
Jaret Burkett	b01e8d889a	Added stochastic rounding to adafactor. ILora adjustments	2024-03-05 07:07:09 -07:00
Jaret Burkett	1325613583	rework ilora	2024-02-29 07:55:52 -07:00
Jaret Burkett	e074058faa	Work on additional image embedding methods. Finalized zipper resampler. It works amazing	2024-02-10 09:00:05 -07:00
Jaret Burkett	e18e0cb5f8	Added comparitive loss when training clip encoder. Allow selecting clip layer. on ip adapter. Improvements to prior prediction	2024-02-05 07:40:03 -07:00
Jaret Burkett	92b9c71d44	Many bug fixes. Ip adapter bug fixes. Added noise to unconditional, it works better. added an ilora adapter for 1 shotting LoRAs	2024-01-28 08:20:03 -07:00