Jaret Burkett
|
eebd3c8212
|
Initial training script for photomaker training. Needs a little more work.
|
2024-01-15 18:46:26 -07:00 |
|
Jaret Burkett
|
5276975fb0
|
Added additional config options for custom plugins I needed
|
2024-01-15 08:31:09 -07:00 |
|
Jaret Burkett
|
290393f7ae
|
Imporvements to ip weight adaptation. Bug fixes. Added masking to direct guidance loss. Allow importing a file for random triggers. Handle bas meta images with improper sizing.
|
2024-01-11 12:22:16 -07:00 |
|
Jaret Burkett
|
645b27f97a
|
Bug fixes with ip adapter training. Made a clip pre processor that can be trained with ip adapter to help augment the clip input to squeeze in more detail from a larget input. moved clip processing to the dataloader for speed.
|
2024-01-04 12:59:38 -07:00 |
|
Jaret Burkett
|
65c08b09c3
|
Added ability to do cfg during training. Various bug fixes
|
2024-01-02 11:29:57 -07:00 |
|
Jaret Burkett
|
afc231efc1
|
Added reference adapters, many bug fixes, more ip adapter work and customizability
|
2024-01-01 17:15:53 -07:00 |
|
Jaret Burkett
|
bafacf3b65
|
Initial commit
|
2023-12-29 13:07:35 -07:00 |
|
Jaret Burkett
|
0892dec4a5
|
Fixed some new bugs i added. woops
|
2023-12-28 14:03:42 -07:00 |
|
Jaret Burkett
|
eeee4a1620
|
Created a size agnostic feature encoder (SAFE) model to be trained in replace of CLIP for ip adapters. It is mostly conv layers so will hopefully be able to handle facial features better than clip can. Also bug fixes
|
2023-12-28 12:20:27 -07:00 |
|
Jaret Burkett
|
05ae95ca89
|
Added a clip vision adapter trainer. Only works for sd15 for now
|
2023-12-24 13:26:04 -07:00 |
|
Jaret Burkett
|
0f8daa5612
|
Bug fixes, work on maing IP adapters more customizable.
|
2023-12-24 08:32:39 -07:00 |
|
Jaret Burkett
|
7703e3a15e
|
Fixes for sdxl ip adapter training. Bug fixes
|
2023-12-21 11:15:58 -07:00 |
|
Jaret Burkett
|
0f597f453e
|
Switched ip adapter dataloader to clip_image paths so the control paths can be used for training assistant adapters while training ip adapters
|
2023-12-20 10:32:24 -07:00 |
|
Jaret Burkett
|
dfb64b5957
|
Allow ip adapters to be much more variable in their creation
|
2023-12-20 06:18:33 -07:00 |
|
Jaret Burkett
|
82098e5d6e
|
Added more functionality for ip adapters
|
2023-12-19 09:54:56 -07:00 |
|
Jaret Burkett
|
b653906715
|
Fixed ip adapter training. Works now
|
2023-12-17 08:22:59 -07:00 |
|
Jaret Burkett
|
39870411d8
|
More guidance work. Improved LoRA module resolver for unet. Added vega mappings and LoRA training for it. Various other bigfixes and changes
|
2023-12-15 06:02:10 -07:00 |
|
Jaret Burkett
|
eaa0fb6253
|
Tons of bug fixes and improvements to special training. Fixed slider training.
|
2023-12-09 16:38:10 -07:00 |
|
Jaret Burkett
|
92cb5ae096
|
Reworked targeted guidance algo
|
2023-12-01 06:30:52 -07:00 |
|
Jaret Burkett
|
bd2bce9b92
|
Switched to trailing timestep spacing to make timesteps for consistant across schedulers. Honed in on targeted guidance. It is finally perfect. (I think)
|
2023-11-29 14:32:48 -07:00 |
|
Jaret Burkett
|
7624241032
|
More fixes for noise schedules and fixed targeted guidance inverted masked prior
|
2023-11-29 10:13:31 -07:00 |
|
Jaret Burkett
|
792a5e37e2
|
Numerous fixes for time sampling. Still not perfect
|
2023-11-28 07:34:43 -07:00 |
|
Jaret Burkett
|
d7e55b6ad4
|
Bug fixes, negative prompting during training, hardened catching
|
2023-11-24 07:25:11 -07:00 |
|
Jaret Burkett
|
4f9cdd916a
|
added prompt dropout to happen indempendently on each TE
|
2023-11-14 05:26:51 -07:00 |
|
Jaret Burkett
|
7782caa468
|
Varous bug fixes. Finalized targeted guidance algo
|
2023-11-10 12:18:08 -07:00 |
|
Jaret Burkett
|
fa6d91ba76
|
Diffirential guidance working, but I may have a better way
|
2023-11-09 06:09:36 -07:00 |
|
Jaret Burkett
|
1ee62562a4
|
diffirential guidance is WORKING (from what I can tell)
|
2023-11-07 19:24:12 -07:00 |
|
Jaret Burkett
|
93ea955d7c
|
Added refiner fine tuning. Works, but needs some polish.
|
2023-11-05 17:15:03 -07:00 |
|
Jaret Burkett
|
8a9e8f708f
|
Added base for using guidance during training. Still not working right.
|
2023-11-05 04:03:32 -07:00 |
|
Jaret Burkett
|
ceaf1d9454
|
Various bug fixes, wip stuff, and tweaks
|
2023-11-02 18:19:20 -06:00 |
|
Jaret Burkett
|
7d707b2fe6
|
Added masking to slider training. Something is still weird though
|
2023-11-01 14:51:29 -06:00 |
|
Jaret Burkett
|
a899ec91c8
|
Added some split prompting started code, adamw8bit, replacements improving, learnable snr gos. A lot of good stuff.
|
2023-11-01 06:52:21 -06:00 |
|
Jaret Burkett
|
436a09430e
|
Added flat snr gamma vs min. Fixes timestep timing
|
2023-10-29 15:41:55 -06:00 |
|
Jaret Burkett
|
298001439a
|
Added gradient accumulation finally
|
2023-10-28 13:14:29 -06:00 |
|
Jaret Burkett
|
6f3e0d5af2
|
Improved lorm extraction and training
|
2023-10-28 08:21:59 -06:00 |
|
Jaret Burkett
|
002279cec3
|
Allow short and long caption combinations like form the new captioning system. Merge the network into the model before inference and reextract when done. Doubles inference speed on locon models during inference. allow splitting a batch into individual components and run them through alone. Basicallt gradient accumulation with single batch size.
|
2023-10-24 16:02:07 -06:00 |
|
Jaret Burkett
|
34eb563d55
|
Added dataset tagging and management tools using llava
|
2023-10-24 10:11:47 -06:00 |
|
Jaret Burkett
|
dc36bbb3c8
|
Added long prompts to general training
|
2023-10-23 08:12:58 -06:00 |
|
Jaret Burkett
|
9905a1e205
|
Fixes and longer prompts
|
2023-10-22 08:57:37 -06:00 |
|
Jaret Burkett
|
0e9fc42816
|
Allow for inverted masked prior
|
2023-10-21 06:50:17 -06:00 |
|
Jaret Burkett
|
d46112a354
|
Fixes for aug pipeline
|
2023-10-20 13:24:07 -06:00 |
|
Jaret Burkett
|
07bf7bd7de
|
Allow augmentations and targeting different loss types fron the config file
|
2023-10-18 03:04:57 -06:00 |
|
Jaret Burkett
|
a05459afaf
|
Fixed issue with adapters that only had 1 input channel. Added ability to set the percentage chance of adapter matching
|
2023-10-15 15:13:35 -06:00 |
|
Jaret Burkett
|
7909b50d24
|
Added adapter assistance to SD training
|
2023-10-14 08:44:53 -06:00 |
|
Jaret Burkett
|
63ceffae24
|
Massive speed increases and ram optimizations
|
2023-10-10 06:07:55 -06:00 |
|
Jaret Burkett
|
bb1d3793e3
|
Added ability to add masks to dataloader and sd trainer to adjust weight of image
|
2023-10-09 11:21:00 -06:00 |
|
Jaret Burkett
|
1d3de678aa
|
fixed bug with trigger word embedding. Allow control images to load from the dataloader or legacy way
|
2023-10-09 06:21:49 -06:00 |
|
Jaret Burkett
|
c5d49ba661
|
Allow adapter image to be cropped to match bucket cropping
|
2023-09-25 10:38:54 -06:00 |
|
Jaret Burkett
|
e5153d87c9
|
Fixed issues with dataloader bucketing. Allow using standard base image for t2i adapters.
|
2023-09-24 05:19:57 -06:00 |
|
Jaret Burkett
|
830e87cb87
|
Added IP adapter training. Not functioning correctly yet
|
2023-09-24 02:39:43 -06:00 |
|