Commit Graph

147 Commits

Author SHA1 Message Date
Jaret Burkett
083cefa78c Bugfixes for slider reference 2023-09-10 18:36:23 -06:00
Jaret Burkett
b5ec8e4eb1 Improve reference slider memory and speed 2023-09-10 18:26:44 -06:00
Jaret Burkett
708b07adb7 Fixed issue with interleaving when doing cfg 2023-09-10 10:26:58 -06:00
Jaret Burkett
a437aed45f bug fix 2023-09-10 09:52:14 -06:00
Jaret Burkett
34bfeba229 Massive speed increase. Added latent caching both to disk and to memory 2023-09-10 08:54:49 -06:00
Jaret Burkett
41a3f63b72 allow smaller images in buckets and bucket them 2023-09-10 03:43:02 -06:00
Jaret Burkett
626ed2939a bug fixes 2023-09-09 15:04:44 -06:00
Jaret Burkett
2128ac1e08 fixed issue with embed name, save whole config to dir instead of just process so it can be easily shared. Only make one config, no timesteps 2023-09-09 12:24:08 -06:00
Jaret Burkett
be804c9cf5 Save embeddings as their trigger to match auto and comfy style loading. Also, FINALLY found why gradients were wonkey and fixed it. The root problem is dropping out of network state before backward pass. 2023-09-09 12:02:07 -06:00
Jaret Burkett
408c50ead1 actually got gradient checkpointing working, again, again, maybe 2023-09-09 11:27:42 -06:00
Jaret Burkett
4ed03a8d92 Fixed issue with buckets scaling. again 2023-09-08 16:32:14 -06:00
Jaret Burkett
b01ab5d375 FINALLY fixed gradient checkpointing issue. Big batches baby. 2023-09-08 15:21:46 -06:00
Jaret Burkett
cb91b0d6da Changed model download from HF to fp16 2023-09-08 07:57:19 -06:00
Jaret Burkett
ce4f9fe02a Bug fixes and improvements to token injection 2023-09-08 06:10:59 -06:00
Jaret Burkett
92a086d5a5 Fixed issue with token replacements 2023-09-07 13:42:39 -06:00
Jaret Burkett
3feb663a51 Switched to new bucket system that matched sdxl trained buckets. Fixed requirements. Updated embeddings to work with sdxl. Added method to train lora with an embedding at the trigger. Still testing but works amazingly well from what I can see 2023-09-07 13:06:18 -06:00
Jaret Burkett
436bf0c6a3 Added experimental concept replacer, replicate converter, bucket maker, and other goodies 2023-09-06 18:50:32 -06:00
Jaret Burkett
f84500159c Fixed issue with lora layer check 2023-09-04 14:27:37 -06:00
Jaret Burkett
64a5441832 Fully tested and now supporting locon on sdxl. If you have the ram 2023-09-04 14:05:10 -06:00
Jaret Burkett
a4c3507a62 Added LoCON from LyCORIS 2023-09-04 08:48:07 -06:00
Jaret Burkett
fa8fc32c0a Corrected key saving and loading to better match kohya 2023-09-04 00:22:34 -06:00
Jaret Burkett
22ed539321 Allow special args for schedulers 2023-09-03 20:38:44 -06:00
Jaret Burkett
7cd6945082 Added my annotator/preprocessor and improved network jitter on reference trainer 2023-09-03 16:43:51 -06:00
Jaret Burkett
2a40937b4f reworked samplers. Trying to find what is wrong with diffusers sampling is sdxl 2023-09-03 07:56:09 -06:00
Jaret Burkett
4ca819a05e Fixes for dataloader 2023-08-31 04:54:10 -06:00
Jaret Burkett
addf024630 Fixed issue with omitting square pictures 2023-08-30 15:00:22 -06:00
Jaret Burkett
33267e117c Reworked bucket loader to scale buckets to pixels amounts not just minimum size. Makes the network more consistant 2023-08-30 14:52:12 -06:00
Jaret Burkett
d401348c2e Make data loader resiliant to bad headers in meta 2023-08-29 18:56:06 -06:00
Jaret Burkett
836fee47a6 Fixed some mismatched weights by adjusting tolerance. The mismatch ironically made the models better lol 2023-08-29 15:20:03 -06:00
Jaret Burkett
14ff51ceb4 fixed issues with converting and saving models. Cleaned keys. Improved testing for cycle load saving. 2023-08-29 12:31:19 -06:00
Jaret Burkett
714854ee86 Hude rework to move the batch to a DTO to make it far more modular to the future ui 2023-08-29 10:22:19 -06:00
Jaret Burkett
bd758ff203 Cleanup and small bug fixes 2023-08-29 05:45:49 -06:00
Jaret Burkett
a008d9e63b Fixed issue with loadin models after resume function added. Added additional flush if not training text encoder to clear out vram before grad accum 2023-08-28 17:56:30 -06:00
Jaret Burkett
b79ced3e10 Merge branch 'main' into development 2023-08-28 16:21:51 -06:00
Jaret Burkett
bee0b6a235 Added converters for all stable diffusion models to convert back to ldm format from diffusers. 2023-08-28 16:12:32 -06:00
Jaret Burkett
2ecb5cf024 Merge branch 'main' into development 2023-08-28 14:01:44 -06:00
Jaret Burkett
fab7c2b04a Fixed issue with key mapping from diffusers back to ldm 2023-08-28 14:01:26 -06:00
Jaret Burkett
e866c75638 Built base interfaces for a DTO to handle batch infomation transports for the dataloader 2023-08-28 12:43:31 -06:00
Jaret Burkett
71da78c8af improved normalization for a network with varrying batch network weights 2023-08-28 12:42:57 -06:00
Jaret Burkett
c446f768ea Huge memory optimizations, many big fixes 2023-08-27 17:48:02 -06:00
Jaret Burkett
cc49786ee9 Dataloader bug fixes 2023-08-27 14:36:38 -06:00
Jaret Burkett
9b164a8688 Fixed issue with bucket dataloader corpping in too much. Added normalization capabilities to LoRA modules. Testing effects, but should prevent them from burning and also make them more compatable with stacking many LoRAs 2023-08-27 09:40:01 -06:00
Jaret Burkett
6bd3851058 Fixed issue with prompt token replace adding more than one replacement 2023-08-26 18:52:23 -06:00
Jaret Burkett
fd338e67bb Fixed bug with dataloader not seperating mulitple datasets 2023-08-26 18:07:24 -06:00
Jaret Burkett
8105c05c12 Added bucketting capabilities to dataloader. Finally have full planned capability. noice 2023-08-26 16:36:32 -06:00
Jaret Burkett
2cb27c3f57 Merge branch 'main' of github.com:ostris/ai-toolkit 2023-08-26 08:55:09 -06:00
Jaret Burkett
3367ab6b2c Moved SD batch processing to a shared method and added it for use in slider training. Still testing if it affects quality over sampling 2023-08-26 08:55:00 -06:00
Jaret Burkett
24f46ea7d6 Merge pull request #9 from FoundSol/patch-1
Update README.md
2023-08-25 20:05:51 -06:00
Fundamentum
5bef2985b5 Update README.md 2023-08-25 21:13:24 -03:00
Jaret Burkett
aeaca13d69 Fixed issue with shuffeling permutations 2023-08-23 22:02:00 -06:00