Commit Graph

21 Commits

Author SHA1 Message Date
Jaret Burkett
8105c05c12 Added bucketting capabilities to dataloader. Finally have full planned capability. noice 2023-08-26 16:36:32 -06:00
Jaret Burkett
3367ab6b2c Moved SD batch processing to a shared method and added it for use in slider training. Still testing if it affects quality over sampling 2023-08-26 08:55:00 -06:00
Jaret Burkett
7157c316af Added support for training lora, dreambooth, and fine tuning. Still need testing and docs 2023-08-23 15:37:00 -06:00
Jaret Burkett
d298240cec Tied in ant tested TI script 2023-08-23 13:26:28 -06:00
Jaret Burkett
2e6c55c720 WIP creating textual inversion training script 2023-08-22 21:02:38 -06:00
Jaret Burkett
36ba08d3fa Added a converter back to ldm from diffusers for sdxl. Can finally get to training it properly 2023-08-21 16:22:01 -06:00
Jaret Burkett
e8667f856f Fix issue with there being an extra . on gene 2023-08-20 15:54:38 -06:00
Jaret Burkett
b77b9acc0b Added base for ultimate slider. WIP 2023-08-19 15:35:24 -06:00
Jaret Burkett
c6675e2801 Added shuffeling to prompts 2023-08-19 07:57:30 -06:00
Jaret Burkett
90eedb78bf Added multiplier jitter, min_snr, ability to choose sdxl encoders to use, shuffle generator, and other fun 2023-08-19 05:54:22 -06:00
Jaret Burkett
8c90fa86c6 Complete reqork of how slider training works and optimized it to hell. Can run entire algorythm in 1 batch now with less VRAM consumption than a quarter of it used to take 2023-08-05 18:46:08 -06:00
Jaret Burkett
66c6f0f6f7 Big refactor of SD runner and added image generator 2023-08-03 14:51:25 -06:00
Jaret Burkett
1a25b275c8 Did some work on SD rescaler. Need to run a long test on it eventually. 2023-08-02 07:59:27 -06:00
Jaret Burkett
2bf3e529ce Set gradient checkpointing on unet enabled by default. Help out immensly with sdxl backprop spikes 2023-08-01 15:43:27 -06:00
Jaret Burkett
8b8d53888d Added Model rescale and prepared a release upgrade 2023-08-01 13:49:54 -06:00
Jaret Burkett
c7640b0865 WIP diffusers pipeline is weird. Starting to hate sdxl 2023-07-27 17:35:24 -06:00
Jaret Burkett
d3ad195b51 Added rescaling, locon, sdxl, all kinds of stuff. sdxl is still weird 2023-07-26 16:19:50 -06:00
Jaret Burkett
cb70c03273 SDXL should be working, but I broke something where it is not converging. 2023-07-25 13:50:59 -06:00
Jaret Burkett
7032717294 Added ability to just erase or enhance concepts from a model 2023-07-24 17:33:45 -06:00
Jaret Burkett
61dd818608 Added anchors to regulate the lora 2023-07-24 14:59:16 -06:00
Jaret Burkett
390192c6a1 Moved the base SD training process to a parent class so we can do some more creative stuff without copy pasta 2023-07-24 11:29:39 -06:00