Jaret Burkett
|
68b7e159bc
|
Bug Fixes
|
2024-05-17 08:41:20 -06:00 |
|
Jaret Burkett
|
5a45c709cd
|
Work on ipadapters and custom adapters
|
2024-05-13 06:37:54 -06:00 |
|
Jaret Burkett
|
10e1ecf1e8
|
Added single value adapter training
|
2024-04-28 06:04:47 -06:00 |
|
Jaret Burkett
|
b96913d73c
|
Improvements to dataloader
|
2024-04-27 09:28:28 -06:00 |
|
Jaret Burkett
|
5da3613e0b
|
Bug fixes and minor features
|
2024-04-25 06:14:31 -06:00 |
|
Jaret Burkett
|
5a70b7f38d
|
Added pixart sigma support, but it wont work until i address breaking changes with lora code in diffusers so it can be upgraded.
|
2024-04-20 10:46:56 -06:00 |
|
Jaret Burkett
|
377b81ee3e
|
Adjustments to guidance
|
2024-04-19 15:00:35 -06:00 |
|
Jaret Burkett
|
2d0a1be59d
|
Bug fixes
|
2024-04-16 03:48:13 -06:00 |
|
Jaret Burkett
|
7284aab7c0
|
Added specialized scaler training to ip adapters
|
2024-04-05 08:17:09 -06:00 |
|
Jaret Burkett
|
427847ac4c
|
Small tweaks and fixes for specialized ip adapter training
|
2024-03-26 11:35:26 -06:00 |
|
Jaret Burkett
|
9c1cc9641e
|
Added keep tokens to keep so many tokens in a prompt when dropping
|
2024-03-18 13:18:25 -06:00 |
|
Jaret Burkett
|
89f4bcad2e
|
Lock diffusers to 0.26.3 until I can figure out why future versions break LoRA code
|
2024-03-18 10:17:55 -06:00 |
|
Jaret Burkett
|
016687bda1
|
Adapter work. Bug fixes. Auto adjust LR when resuming optimizer.
|
2024-03-17 10:21:47 -06:00 |
|
Jaret Burkett
|
72de68d8aa
|
WIP on clip vision encoder
|
2024-03-13 07:24:08 -06:00 |
|
Jaret Burkett
|
d87b49882c
|
Work on embedding adapters
|
2024-03-11 15:18:42 -06:00 |
|
Jaret Burkett
|
f415bac7b5
|
Merge branch 'main' of github.com:ostris/ai-toolkit
|
2024-03-06 09:32:38 -07:00 |
|
Jaret Burkett
|
f1cb87fe9e
|
fixed bug the kept learning rates the same
|
2024-03-06 09:23:32 -07:00 |
|
Jaret Burkett
|
8f9cd823d1
|
Create LICENSE
|
2024-03-06 07:54:55 -07:00 |
|
Jaret Burkett
|
b01e8d889a
|
Added stochastic rounding to adafactor. ILora adjustments
|
2024-03-05 07:07:09 -07:00 |
|
Jaret Burkett
|
1325613583
|
rework ilora
|
2024-02-29 07:55:52 -07:00 |
|
Jaret Burkett
|
337945de9a
|
Added this not that guidance. Added ability to replace prompts.
|
2024-02-28 20:10:14 -07:00 |
|
Jaret Burkett
|
561914d8e6
|
Removed old code for fixing multistep sampler that is no longer needed
|
2024-02-25 11:53:35 -07:00 |
|
Jaret Burkett
|
b0a0f28191
|
Bug fixes
|
2024-02-25 08:28:29 -07:00 |
|
Jaret Burkett
|
f965a1299f
|
Fixed Dora implementation. Still highly experimental
|
2024-02-24 10:26:01 -07:00 |
|
Jaret Burkett
|
1bd94f0f01
|
Added early DoRA support, but will change shortly. Dont use right now.
|
2024-02-23 05:55:41 -07:00 |
|
Jaret Burkett
|
9ffa8c3711
|
Fixed issue when there is no adapter
|
2024-02-22 02:59:59 -07:00 |
|
Jaret Burkett
|
b68c3ef734
|
Added te aug adapter
|
2024-02-21 21:30:26 -07:00 |
|
Jaret Burkett
|
49c41e6a5f
|
Bug fixes. allow for random negative prompts
|
2024-02-21 04:51:52 -07:00 |
|
Jaret Burkett
|
2478554c95
|
Bug fixes. Added IP adapter training for Pixart
|
2024-02-17 10:06:57 -07:00 |
|
Jaret Burkett
|
93b52932c1
|
Added training for pixart-a
|
2024-02-13 16:00:04 -07:00 |
|
Jaret Burkett
|
4ec4025cbb
|
Added adapter modules for text encoders and direct vision
|
2024-02-12 08:46:18 -07:00 |
|
Jaret Burkett
|
e074058faa
|
Work on additional image embedding methods. Finalized zipper resampler. It works amazing
|
2024-02-10 09:00:05 -07:00 |
|
Jaret Burkett
|
a8481c1670
|
randomly adjust scale of unconditional noise on ip adapters if training with cfg
|
2024-02-06 03:44:54 -07:00 |
|
Jaret Burkett
|
e18e0cb5f8
|
Added comparitive loss when training clip encoder. Allow selecting clip layer. on ip adapter. Improvements to prior prediction
|
2024-02-05 07:40:03 -07:00 |
|
Jaret Burkett
|
177c7130ec
|
improved correction of pred norm by targeting the prior
|
2024-02-01 06:31:04 -07:00 |
|
Jaret Burkett
|
1ae1017748
|
Bug fixes. added ability to use l1 loss. varous other tests and improvements
|
2024-01-31 06:30:54 -07:00 |
|
Jaret Burkett
|
92b9c71d44
|
Many bug fixes. Ip adapter bug fixes. Added noise to unconditional, it works better. added an ilora adapter for 1 shotting LoRAs
|
2024-01-28 08:20:03 -07:00 |
|
Jaret Burkett
|
f17ad8d794
|
various bug fixes. Created an contextual alpha mask module to calculate alpha mask
|
2024-01-18 16:34:27 -07:00 |
|
Jaret Burkett
|
86c70a2a1f
|
Added an experimental clip fusion model that is showing promise for embedding concepts
|
2024-01-17 13:13:04 -07:00 |
|
Jaret Burkett
|
655533d4c7
|
More work on custom adapter
|
2024-01-16 17:41:26 -07:00 |
|
Jaret Burkett
|
eebd3c8212
|
Initial training script for photomaker training. Needs a little more work.
|
2024-01-15 18:46:26 -07:00 |
|
Jaret Burkett
|
5276975fb0
|
Added additional config options for custom plugins I needed
|
2024-01-15 08:31:09 -07:00 |
|
Jaret Burkett
|
e190fbaeb8
|
Prepwork for ilora
|
2024-01-12 06:41:15 -07:00 |
|
Jaret Burkett
|
290393f7ae
|
Imporvements to ip weight adaptation. Bug fixes. Added masking to direct guidance loss. Allow importing a file for random triggers. Handle bas meta images with improper sizing.
|
2024-01-11 12:22:16 -07:00 |
|
Jaret Burkett
|
b2a54c8f36
|
Added siglip support
|
2024-01-09 20:52:21 -07:00 |
|
Jaret Burkett
|
b767d29b3c
|
Adjustments to the clip preprocessor. Allow merging in new weights for ip adapters so you can change the arcitecture while maintaining as much data as possible
|
2024-01-06 11:56:53 -07:00 |
|
Jaret Burkett
|
645b27f97a
|
Bug fixes with ip adapter training. Made a clip pre processor that can be trained with ip adapter to help augment the clip input to squeeze in more detail from a larget input. moved clip processing to the dataloader for speed.
|
2024-01-04 12:59:38 -07:00 |
|
Jaret Burkett
|
65c08b09c3
|
Added ability to do cfg during training. Various bug fixes
|
2024-01-02 11:29:57 -07:00 |
|
Jaret Burkett
|
afc231efc1
|
Added reference adapters, many bug fixes, more ip adapter work and customizability
|
2024-01-01 17:15:53 -07:00 |
|
Jaret Burkett
|
bafacf3b65
|
Initial commit
|
2023-12-29 13:07:35 -07:00 |
|