Jaret Burkett
|
34bfeba229
|
Massive speed increase. Added latent caching both to disk and to memory
|
2023-09-10 08:54:49 -06:00 |
|
Jaret Burkett
|
3feb663a51
|
Switched to new bucket system that matched sdxl trained buckets. Fixed requirements. Updated embeddings to work with sdxl. Added method to train lora with an embedding at the trigger. Still testing but works amazingly well from what I can see
|
2023-09-07 13:06:18 -06:00 |
|
Jaret Burkett
|
a4c3507a62
|
Added LoCON from LyCORIS
|
2023-09-04 08:48:07 -06:00 |
|
Jaret Burkett
|
22ed539321
|
Allow special args for schedulers
|
2023-09-03 20:38:44 -06:00 |
|
Jaret Burkett
|
2a40937b4f
|
reworked samplers. Trying to find what is wrong with diffusers sampling is sdxl
|
2023-09-03 07:56:09 -06:00 |
|
Jaret Burkett
|
836fee47a6
|
Fixed some mismatched weights by adjusting tolerance. The mismatch ironically made the models better lol
|
2023-08-29 15:20:03 -06:00 |
|
Jaret Burkett
|
14ff51ceb4
|
fixed issues with converting and saving models. Cleaned keys. Improved testing for cycle load saving.
|
2023-08-29 12:31:19 -06:00 |
|
Jaret Burkett
|
714854ee86
|
Hude rework to move the batch to a DTO to make it far more modular to the future ui
|
2023-08-29 10:22:19 -06:00 |
|
Jaret Burkett
|
e866c75638
|
Built base interfaces for a DTO to handle batch infomation transports for the dataloader
|
2023-08-28 12:43:31 -06:00 |
|
Jaret Burkett
|
9b164a8688
|
Fixed issue with bucket dataloader corpping in too much. Added normalization capabilities to LoRA modules. Testing effects, but should prevent them from burning and also make them more compatable with stacking many LoRAs
|
2023-08-27 09:40:01 -06:00 |
|
Jaret Burkett
|
8105c05c12
|
Added bucketting capabilities to dataloader. Finally have full planned capability. noice
|
2023-08-26 16:36:32 -06:00 |
|
Jaret Burkett
|
3367ab6b2c
|
Moved SD batch processing to a shared method and added it for use in slider training. Still testing if it affects quality over sampling
|
2023-08-26 08:55:00 -06:00 |
|
Jaret Burkett
|
7157c316af
|
Added support for training lora, dreambooth, and fine tuning. Still need testing and docs
|
2023-08-23 15:37:00 -06:00 |
|
Jaret Burkett
|
d298240cec
|
Tied in ant tested TI script
|
2023-08-23 13:26:28 -06:00 |
|
Jaret Burkett
|
2e6c55c720
|
WIP creating textual inversion training script
|
2023-08-22 21:02:38 -06:00 |
|
Jaret Burkett
|
36ba08d3fa
|
Added a converter back to ldm from diffusers for sdxl. Can finally get to training it properly
|
2023-08-21 16:22:01 -06:00 |
|
Jaret Burkett
|
e8667f856f
|
Fix issue with there being an extra . on gene
|
2023-08-20 15:54:38 -06:00 |
|
Jaret Burkett
|
b77b9acc0b
|
Added base for ultimate slider. WIP
|
2023-08-19 15:35:24 -06:00 |
|
Jaret Burkett
|
c6675e2801
|
Added shuffeling to prompts
|
2023-08-19 07:57:30 -06:00 |
|
Jaret Burkett
|
90eedb78bf
|
Added multiplier jitter, min_snr, ability to choose sdxl encoders to use, shuffle generator, and other fun
|
2023-08-19 05:54:22 -06:00 |
|
Jaret Burkett
|
8c90fa86c6
|
Complete reqork of how slider training works and optimized it to hell. Can run entire algorythm in 1 batch now with less VRAM consumption than a quarter of it used to take
|
2023-08-05 18:46:08 -06:00 |
|
Jaret Burkett
|
66c6f0f6f7
|
Big refactor of SD runner and added image generator
|
2023-08-03 14:51:25 -06:00 |
|
Jaret Burkett
|
1a25b275c8
|
Did some work on SD rescaler. Need to run a long test on it eventually.
|
2023-08-02 07:59:27 -06:00 |
|
Jaret Burkett
|
2bf3e529ce
|
Set gradient checkpointing on unet enabled by default. Help out immensly with sdxl backprop spikes
|
2023-08-01 15:43:27 -06:00 |
|
Jaret Burkett
|
8b8d53888d
|
Added Model rescale and prepared a release upgrade
|
2023-08-01 13:49:54 -06:00 |
|
Jaret Burkett
|
c7640b0865
|
WIP diffusers pipeline is weird. Starting to hate sdxl
|
2023-07-27 17:35:24 -06:00 |
|
Jaret Burkett
|
d3ad195b51
|
Added rescaling, locon, sdxl, all kinds of stuff. sdxl is still weird
|
2023-07-26 16:19:50 -06:00 |
|
Jaret Burkett
|
cb70c03273
|
SDXL should be working, but I broke something where it is not converging.
|
2023-07-25 13:50:59 -06:00 |
|
Jaret Burkett
|
7032717294
|
Added ability to just erase or enhance concepts from a model
|
2023-07-24 17:33:45 -06:00 |
|
Jaret Burkett
|
61dd818608
|
Added anchors to regulate the lora
|
2023-07-24 14:59:16 -06:00 |
|
Jaret Burkett
|
390192c6a1
|
Moved the base SD training process to a parent class so we can do some more creative stuff without copy pasta
|
2023-07-24 11:29:39 -06:00 |
|