Jaret Burkett
|
1d3de678aa
|
fixed bug with trigger word embedding. Allow control images to load from the dataloader or legacy way
|
2023-10-09 06:21:49 -06:00 |
|
Jaret Burkett
|
c5d49ba661
|
Allow adapter image to be cropped to match bucket cropping
|
2023-09-25 10:38:54 -06:00 |
|
Jaret Burkett
|
e5153d87c9
|
Fixed issues with dataloader bucketing. Allow using standard base image for t2i adapters.
|
2023-09-24 05:19:57 -06:00 |
|
Jaret Burkett
|
830e87cb87
|
Added IP adapter training. Not functioning correctly yet
|
2023-09-24 02:39:43 -06:00 |
|
Jaret Burkett
|
61badf85a7
|
t2i training working from what I can tell at least
|
2023-09-17 15:56:43 -06:00 |
|
Jaret Burkett
|
27f343fc08
|
Added base setup for training t2i adapters. Currently untested, saw something else shiny i wanted to finish sirst. Added content_or_style to the training config. It defaults to balanced, which is standard uniform time step sampling. If style or content is passed, it will use cubic sampling for timesteps to favor timesteps that are beneficial for training them. for style, favor later timesteps. For content, favor earlier timesteps.
|
2023-09-16 08:30:38 -06:00 |
|
Jaret Burkett
|
569d7464d5
|
implemented device placement preset system more places. Vastly improved speed on setting network multiplier and activating network. Fixed timing issues on progress bar
|
2023-09-14 08:31:54 -06:00 |
|
Jaret Burkett
|
34bfeba229
|
Massive speed increase. Added latent caching both to disk and to memory
|
2023-09-10 08:54:49 -06:00 |
|
Jaret Burkett
|
be804c9cf5
|
Save embeddings as their trigger to match auto and comfy style loading. Also, FINALLY found why gradients were wonkey and fixed it. The root problem is dropping out of network state before backward pass.
|
2023-09-09 12:02:07 -06:00 |
|
Jaret Burkett
|
408c50ead1
|
actually got gradient checkpointing working, again, again, maybe
|
2023-09-09 11:27:42 -06:00 |
|
Jaret Burkett
|
b01ab5d375
|
FINALLY fixed gradient checkpointing issue. Big batches baby.
|
2023-09-08 15:21:46 -06:00 |
|
Jaret Burkett
|
ce4f9fe02a
|
Bug fixes and improvements to token injection
|
2023-09-08 06:10:59 -06:00 |
|
Jaret Burkett
|
3feb663a51
|
Switched to new bucket system that matched sdxl trained buckets. Fixed requirements. Updated embeddings to work with sdxl. Added method to train lora with an embedding at the trigger. Still testing but works amazingly well from what I can see
|
2023-09-07 13:06:18 -06:00 |
|
Jaret Burkett
|
a4c3507a62
|
Added LoCON from LyCORIS
|
2023-09-04 08:48:07 -06:00 |
|
Jaret Burkett
|
33267e117c
|
Reworked bucket loader to scale buckets to pixels amounts not just minimum size. Makes the network more consistant
|
2023-08-30 14:52:12 -06:00 |
|
Jaret Burkett
|
714854ee86
|
Hude rework to move the batch to a DTO to make it far more modular to the future ui
|
2023-08-29 10:22:19 -06:00 |
|
Jaret Burkett
|
a008d9e63b
|
Fixed issue with loadin models after resume function added. Added additional flush if not training text encoder to clear out vram before grad accum
|
2023-08-28 17:56:30 -06:00 |
|
Jaret Burkett
|
c446f768ea
|
Huge memory optimizations, many big fixes
|
2023-08-27 17:48:02 -06:00 |
|
Jaret Burkett
|
3367ab6b2c
|
Moved SD batch processing to a shared method and added it for use in slider training. Still testing if it affects quality over sampling
|
2023-08-26 08:55:00 -06:00 |
|
Jaret Burkett
|
7157c316af
|
Added support for training lora, dreambooth, and fine tuning. Still need testing and docs
|
2023-08-23 15:37:00 -06:00 |
|