13 Commits

Author	SHA1	Message	Date
Jaret Burkett	34bfeba229	Massive speed increase. Added latent caching both to disk and to memory	2023-09-10 08:54:49 -06:00
Jaret Burkett	be804c9cf5	Save embeddings as their trigger to match auto and comfy style loading. Also, FINALLY found why gradients were wonkey and fixed it. The root problem is dropping out of network state before backward pass.	2023-09-09 12:02:07 -06:00
Jaret Burkett	408c50ead1	actually got gradient checkpointing working, again, again, maybe	2023-09-09 11:27:42 -06:00
Jaret Burkett	b01ab5d375	FINALLY fixed gradient checkpointing issue. Big batches baby.	2023-09-08 15:21:46 -06:00
Jaret Burkett	ce4f9fe02a	Bug fixes and improvements to token injection	2023-09-08 06:10:59 -06:00
Jaret Burkett	3feb663a51	Switched to new bucket system that matched sdxl trained buckets. Fixed requirements. Updated embeddings to work with sdxl. Added method to train lora with an embedding at the trigger. Still testing but works amazingly well from what I can see	2023-09-07 13:06:18 -06:00
Jaret Burkett	a4c3507a62	Added LoCON from LyCORIS	2023-09-04 08:48:07 -06:00
Jaret Burkett	33267e117c	Reworked bucket loader to scale buckets to pixels amounts not just minimum size. Makes the network more consistant	2023-08-30 14:52:12 -06:00
Jaret Burkett	714854ee86	Hude rework to move the batch to a DTO to make it far more modular to the future ui	2023-08-29 10:22:19 -06:00
Jaret Burkett	a008d9e63b	Fixed issue with loadin models after resume function added. Added additional flush if not training text encoder to clear out vram before grad accum	2023-08-28 17:56:30 -06:00
Jaret Burkett	c446f768ea	Huge memory optimizations, many big fixes	2023-08-27 17:48:02 -06:00
Jaret Burkett	3367ab6b2c	Moved SD batch processing to a shared method and added it for use in slider training. Still testing if it affects quality over sampling	2023-08-26 08:55:00 -06:00
Jaret Burkett	7157c316af	Added support for training lora, dreambooth, and fine tuning. Still need testing and docs	2023-08-23 15:37:00 -06:00