Jaret Burkett
|
48a9bac22d
|
Added doffusers schedulers
|
2023-10-29 12:39:50 -06:00 |
|
Jaret Burkett
|
298001439a
|
Added gradient accumulation finally
|
2023-10-28 13:14:29 -06:00 |
|
Jaret Burkett
|
6f3e0d5af2
|
Improved lorm extraction and training
|
2023-10-28 08:21:59 -06:00 |
|
Jaret Burkett
|
0a79ac9604
|
Added lorm. WIP
|
2023-10-26 18:23:51 -06:00 |
|
Jaret Burkett
|
9636194c09
|
Added fuyu captioning
|
2023-10-25 14:14:53 -06:00 |
|
Jaret Burkett
|
d742792ee4
|
Fixed issue with not loading short prompt
|
2023-10-24 16:19:32 -06:00 |
|
Jaret Burkett
|
002279cec3
|
Allow short and long caption combinations like form the new captioning system. Merge the network into the model before inference and reextract when done. Doubles inference speed on locon models during inference. allow splitting a batch into individual components and run them through alone. Basicallt gradient accumulation with single batch size.
|
2023-10-24 16:02:07 -06:00 |
|
Jaret Burkett
|
73c8b50975
|
Added ability to use adagrad from transformers
|
2023-10-24 11:16:01 -06:00 |
|
Jaret Burkett
|
34eb563d55
|
Added dataset tagging and management tools using llava
|
2023-10-24 10:11:47 -06:00 |
|
Jaret Burkett
|
dc36bbb3c8
|
Added long prompts to general training
|
2023-10-23 08:12:58 -06:00 |
|
Jaret Burkett
|
9905a1e205
|
Fixes and longer prompts
|
2023-10-22 08:57:37 -06:00 |
|
Jaret Burkett
|
0e9fc42816
|
Allow for inverted masked prior
|
2023-10-21 06:50:17 -06:00 |
|
Jaret Burkett
|
d46112a354
|
Fixes for aug pipeline
|
2023-10-20 13:24:07 -06:00 |
|
Jaret Burkett
|
07bf7bd7de
|
Allow augmentations and targeting different loss types fron the config file
|
2023-10-18 03:04:57 -06:00 |
|
Jaret Burkett
|
da6302ada8
|
added a method to apply multipliers to noise and latents prior to combining
|
2023-10-17 06:09:16 -06:00 |
|
Jaret Burkett
|
a05459afaf
|
Fixed issue with adapters that only had 1 input channel. Added ability to set the percentage chance of adapter matching
|
2023-10-15 15:13:35 -06:00 |
|
Jaret Burkett
|
b1a22d0b3e
|
hardened reading prompts from json
|
2023-10-15 07:20:33 -06:00 |
|
Jaret Burkett
|
7909b50d24
|
Added adapter assistance to SD training
|
2023-10-14 08:44:53 -06:00 |
|
Jaret Burkett
|
38e441a29c
|
allow flipping for point of interesting autocropping. allow num repeats. Fixed some bugs with new free u
|
2023-10-12 21:02:47 -06:00 |
|
Jaret Burkett
|
4e3b2c2569
|
Allow for alpha to be used as a mask
|
2023-10-10 17:08:59 -06:00 |
|
Jaret Burkett
|
239addba51
|
Fixed memory leak when cachine latents to disk
|
2023-10-10 13:31:47 -06:00 |
|
Jaret Burkett
|
63ceffae24
|
Massive speed increases and ram optimizations
|
2023-10-10 06:07:55 -06:00 |
|
Jaret Burkett
|
f4c90bb589
|
Added config to set the min value of a mask
|
2023-10-09 15:47:54 -06:00 |
|
Jaret Burkett
|
bb1d3793e3
|
Added ability to add masks to dataloader and sd trainer to adjust weight of image
|
2023-10-09 11:21:00 -06:00 |
|
Jaret Burkett
|
1d3de678aa
|
fixed bug with trigger word embedding. Allow control images to load from the dataloader or legacy way
|
2023-10-09 06:21:49 -06:00 |
|
Jaret Burkett
|
b1cfafa0c6
|
always prompt both even when training only one encoder
|
2023-10-07 11:23:09 -06:00 |
|
Jaret Burkett
|
cac8754399
|
Allow for training loras on onle one text encoder for sdxl
|
2023-10-06 08:11:56 -06:00 |
|
Jaret Burkett
|
f73402473b
|
Bug fixes. Added some functionality to help with private extensions
|
2023-10-05 07:09:34 -06:00 |
|
Jaret Burkett
|
579650eaf8
|
Fixed big issue with bucketing dataloader and added random cripping to a point of interest
|
2023-10-02 18:31:08 -06:00 |
|
Jaret Burkett
|
320e109c5f
|
Allow loading from a json detail file for captions
|
2023-10-02 13:25:09 -06:00 |
|
Jaret Burkett
|
560251a24f
|
fixed issue with down block residuals when doing slider cfg on sdxl with t2i adapter assisted training
|
2023-10-01 07:32:48 -06:00 |
|
Jaret Burkett
|
085787b799
|
Allow loading auxillery images from dataloader
|
2023-09-30 07:28:23 -06:00 |
|
Jaret Burkett
|
8d9450ad7c
|
Compatability fixes
|
2023-09-29 14:07:37 -06:00 |
|
Jaret Burkett
|
8509da60cb
|
Added a way to add a t2i adapter guided slider training for more consitant images
|
2023-09-28 14:08:56 -06:00 |
|
Jaret Burkett
|
c5d49ba661
|
Allow adapter image to be cropped to match bucket cropping
|
2023-09-25 10:38:54 -06:00 |
|
Jaret Burkett
|
76c764af49
|
Fixed issues with adapter and disabled telementry for now
|
2023-09-24 12:51:29 -06:00 |
|
Jaret Burkett
|
abf7cd221d
|
allow setting adapter weight in prompts
|
2023-09-24 06:51:54 -06:00 |
|
Jaret Burkett
|
e5153d87c9
|
Fixed issues with dataloader bucketing. Allow using standard base image for t2i adapters.
|
2023-09-24 05:19:57 -06:00 |
|
Jaret Burkett
|
830e87cb87
|
Added IP adapter training. Not functioning correctly yet
|
2023-09-24 02:39:43 -06:00 |
|
Jaret Burkett
|
19255cdc7c
|
Bugfixes. Added small augmentations to dataloader. Will switch to abluminations soon though. Added ability to adjust step count on start to override what is in the file
|
2023-09-20 05:30:10 -06:00 |
|
Jaret Burkett
|
0f105690cc
|
Added some further extendability for plugins
|
2023-09-19 05:41:44 -06:00 |
|
Jaret Burkett
|
61badf85a7
|
t2i training working from what I can tell at least
|
2023-09-17 15:56:43 -06:00 |
|
Jaret Burkett
|
181f237a7b
|
added flipping x and y for dataset loader
|
2023-09-17 08:42:54 -06:00 |
|
Jaret Burkett
|
c698837241
|
Fixes to esrgan trainer. Moved logic for sd prompt embeddings out of diffusers pipeline so I can manipulate it
|
2023-09-16 17:41:07 -06:00 |
|
Jaret Burkett
|
27f343fc08
|
Added base setup for training t2i adapters. Currently untested, saw something else shiny i wanted to finish sirst. Added content_or_style to the training config. It defaults to balanced, which is standard uniform time step sampling. If style or content is passed, it will use cubic sampling for timesteps to favor timesteps that are beneficial for training them. for style, favor later timesteps. For content, favor earlier timesteps.
|
2023-09-16 08:30:38 -06:00 |
|
Jaret Burkett
|
17e4fe40d7
|
Prevent lycoris network moduels if not training that part of network. Skew timesteps to favor later steps. It performs better
|
2023-09-14 15:13:24 -06:00 |
|
Jaret Burkett
|
569d7464d5
|
implemented device placement preset system more places. Vastly improved speed on setting network multiplier and activating network. Fixed timing issues on progress bar
|
2023-09-14 08:31:54 -06:00 |
|
Jaret Burkett
|
4e945917df
|
added dropout to LoRA networks
|
2023-09-13 15:23:07 -06:00 |
|
Jaret Burkett
|
ae70200d3c
|
Bug fixes, speed improvements, compatability adjustments withdiffusers updates
|
2023-09-13 07:03:53 -06:00 |
|
Jaret Burkett
|
d8d1e6fd1e
|
big fixes
|
2023-09-12 18:48:39 -06:00 |
|