7 Commits

Author	SHA1	Message	Date
Jaret Burkett	7284aab7c0	Added specialized scaler training to ip adapters	2024-04-05 08:17:09 -06:00
Jaret Burkett	016687bda1	Adapter work. Bug fixes. Auto adjust LR when resuming optimizer.	2024-03-17 10:21:47 -06:00
Jaret Burkett	b01e8d889a	Added stochastic rounding to adafactor. ILora adjustments	2024-03-05 07:07:09 -07:00
Jaret Burkett	1325613583	rework ilora	2024-02-29 07:55:52 -07:00
Jaret Burkett	e074058faa	Work on additional image embedding methods. Finalized zipper resampler. It works amazing	2024-02-10 09:00:05 -07:00
Jaret Burkett	e18e0cb5f8	Added comparitive loss when training clip encoder. Allow selecting clip layer. on ip adapter. Improvements to prior prediction	2024-02-05 07:40:03 -07:00
Jaret Burkett	92b9c71d44	Many bug fixes. Ip adapter bug fixes. Added noise to unconditional, it works better. added an ilora adapter for 1 shotting LoRAs	2024-01-28 08:20:03 -07:00