Jaret Burkett
|
083cefa78c
|
Bugfixes for slider reference
|
2023-09-10 18:36:23 -06:00 |
|
Jaret Burkett
|
b5ec8e4eb1
|
Improve reference slider memory and speed
|
2023-09-10 18:26:44 -06:00 |
|
Jaret Burkett
|
708b07adb7
|
Fixed issue with interleaving when doing cfg
|
2023-09-10 10:26:58 -06:00 |
|
Jaret Burkett
|
a437aed45f
|
bug fix
|
2023-09-10 09:52:14 -06:00 |
|
Jaret Burkett
|
34bfeba229
|
Massive speed increase. Added latent caching both to disk and to memory
|
2023-09-10 08:54:49 -06:00 |
|
Jaret Burkett
|
41a3f63b72
|
allow smaller images in buckets and bucket them
|
2023-09-10 03:43:02 -06:00 |
|
Jaret Burkett
|
626ed2939a
|
bug fixes
|
2023-09-09 15:04:44 -06:00 |
|
Jaret Burkett
|
2128ac1e08
|
fixed issue with embed name, save whole config to dir instead of just process so it can be easily shared. Only make one config, no timesteps
|
2023-09-09 12:24:08 -06:00 |
|
Jaret Burkett
|
be804c9cf5
|
Save embeddings as their trigger to match auto and comfy style loading. Also, FINALLY found why gradients were wonkey and fixed it. The root problem is dropping out of network state before backward pass.
|
2023-09-09 12:02:07 -06:00 |
|
Jaret Burkett
|
408c50ead1
|
actually got gradient checkpointing working, again, again, maybe
|
2023-09-09 11:27:42 -06:00 |
|
Jaret Burkett
|
4ed03a8d92
|
Fixed issue with buckets scaling. again
|
2023-09-08 16:32:14 -06:00 |
|
Jaret Burkett
|
b01ab5d375
|
FINALLY fixed gradient checkpointing issue. Big batches baby.
|
2023-09-08 15:21:46 -06:00 |
|
Jaret Burkett
|
cb91b0d6da
|
Changed model download from HF to fp16
|
2023-09-08 07:57:19 -06:00 |
|
Jaret Burkett
|
ce4f9fe02a
|
Bug fixes and improvements to token injection
|
2023-09-08 06:10:59 -06:00 |
|
Jaret Burkett
|
92a086d5a5
|
Fixed issue with token replacements
|
2023-09-07 13:42:39 -06:00 |
|
Jaret Burkett
|
3feb663a51
|
Switched to new bucket system that matched sdxl trained buckets. Fixed requirements. Updated embeddings to work with sdxl. Added method to train lora with an embedding at the trigger. Still testing but works amazingly well from what I can see
|
2023-09-07 13:06:18 -06:00 |
|
Jaret Burkett
|
436bf0c6a3
|
Added experimental concept replacer, replicate converter, bucket maker, and other goodies
|
2023-09-06 18:50:32 -06:00 |
|
Jaret Burkett
|
f84500159c
|
Fixed issue with lora layer check
|
2023-09-04 14:27:37 -06:00 |
|
Jaret Burkett
|
64a5441832
|
Fully tested and now supporting locon on sdxl. If you have the ram
|
2023-09-04 14:05:10 -06:00 |
|
Jaret Burkett
|
a4c3507a62
|
Added LoCON from LyCORIS
|
2023-09-04 08:48:07 -06:00 |
|
Jaret Burkett
|
fa8fc32c0a
|
Corrected key saving and loading to better match kohya
|
2023-09-04 00:22:34 -06:00 |
|
Jaret Burkett
|
22ed539321
|
Allow special args for schedulers
|
2023-09-03 20:38:44 -06:00 |
|
Jaret Burkett
|
7cd6945082
|
Added my annotator/preprocessor and improved network jitter on reference trainer
|
2023-09-03 16:43:51 -06:00 |
|
Jaret Burkett
|
2a40937b4f
|
reworked samplers. Trying to find what is wrong with diffusers sampling is sdxl
|
2023-09-03 07:56:09 -06:00 |
|
Jaret Burkett
|
4ca819a05e
|
Fixes for dataloader
|
2023-08-31 04:54:10 -06:00 |
|
Jaret Burkett
|
addf024630
|
Fixed issue with omitting square pictures
|
2023-08-30 15:00:22 -06:00 |
|
Jaret Burkett
|
33267e117c
|
Reworked bucket loader to scale buckets to pixels amounts not just minimum size. Makes the network more consistant
|
2023-08-30 14:52:12 -06:00 |
|
Jaret Burkett
|
d401348c2e
|
Make data loader resiliant to bad headers in meta
|
2023-08-29 18:56:06 -06:00 |
|
Jaret Burkett
|
836fee47a6
|
Fixed some mismatched weights by adjusting tolerance. The mismatch ironically made the models better lol
|
2023-08-29 15:20:03 -06:00 |
|
Jaret Burkett
|
14ff51ceb4
|
fixed issues with converting and saving models. Cleaned keys. Improved testing for cycle load saving.
|
2023-08-29 12:31:19 -06:00 |
|
Jaret Burkett
|
714854ee86
|
Hude rework to move the batch to a DTO to make it far more modular to the future ui
|
2023-08-29 10:22:19 -06:00 |
|
Jaret Burkett
|
bd758ff203
|
Cleanup and small bug fixes
|
2023-08-29 05:45:49 -06:00 |
|
Jaret Burkett
|
a008d9e63b
|
Fixed issue with loadin models after resume function added. Added additional flush if not training text encoder to clear out vram before grad accum
|
2023-08-28 17:56:30 -06:00 |
|
Jaret Burkett
|
b79ced3e10
|
Merge branch 'main' into development
|
2023-08-28 16:21:51 -06:00 |
|
Jaret Burkett
|
bee0b6a235
|
Added converters for all stable diffusion models to convert back to ldm format from diffusers.
|
2023-08-28 16:12:32 -06:00 |
|
Jaret Burkett
|
2ecb5cf024
|
Merge branch 'main' into development
|
2023-08-28 14:01:44 -06:00 |
|
Jaret Burkett
|
fab7c2b04a
|
Fixed issue with key mapping from diffusers back to ldm
|
2023-08-28 14:01:26 -06:00 |
|
Jaret Burkett
|
e866c75638
|
Built base interfaces for a DTO to handle batch infomation transports for the dataloader
|
2023-08-28 12:43:31 -06:00 |
|
Jaret Burkett
|
71da78c8af
|
improved normalization for a network with varrying batch network weights
|
2023-08-28 12:42:57 -06:00 |
|
Jaret Burkett
|
c446f768ea
|
Huge memory optimizations, many big fixes
|
2023-08-27 17:48:02 -06:00 |
|
Jaret Burkett
|
cc49786ee9
|
Dataloader bug fixes
|
2023-08-27 14:36:38 -06:00 |
|
Jaret Burkett
|
9b164a8688
|
Fixed issue with bucket dataloader corpping in too much. Added normalization capabilities to LoRA modules. Testing effects, but should prevent them from burning and also make them more compatable with stacking many LoRAs
|
2023-08-27 09:40:01 -06:00 |
|
Jaret Burkett
|
6bd3851058
|
Fixed issue with prompt token replace adding more than one replacement
|
2023-08-26 18:52:23 -06:00 |
|
Jaret Burkett
|
fd338e67bb
|
Fixed bug with dataloader not seperating mulitple datasets
|
2023-08-26 18:07:24 -06:00 |
|
Jaret Burkett
|
8105c05c12
|
Added bucketting capabilities to dataloader. Finally have full planned capability. noice
|
2023-08-26 16:36:32 -06:00 |
|
Jaret Burkett
|
2cb27c3f57
|
Merge branch 'main' of github.com:ostris/ai-toolkit
|
2023-08-26 08:55:09 -06:00 |
|
Jaret Burkett
|
3367ab6b2c
|
Moved SD batch processing to a shared method and added it for use in slider training. Still testing if it affects quality over sampling
|
2023-08-26 08:55:00 -06:00 |
|
Jaret Burkett
|
24f46ea7d6
|
Merge pull request #9 from FoundSol/patch-1
Update README.md
|
2023-08-25 20:05:51 -06:00 |
|
Fundamentum
|
5bef2985b5
|
Update README.md
|
2023-08-25 21:13:24 -03:00 |
|
Jaret Burkett
|
aeaca13d69
|
Fixed issue with shuffeling permutations
|
2023-08-23 22:02:00 -06:00 |
|