Commit Graph

119 Commits

Author SHA1 Message Date
Jaret Burkett
836fee47a6 Fixed some mismatched weights by adjusting tolerance. The mismatch ironically made the models better lol 2023-08-29 15:20:03 -06:00
Jaret Burkett
14ff51ceb4 fixed issues with converting and saving models. Cleaned keys. Improved testing for cycle load saving. 2023-08-29 12:31:19 -06:00
Jaret Burkett
714854ee86 Hude rework to move the batch to a DTO to make it far more modular to the future ui 2023-08-29 10:22:19 -06:00
Jaret Burkett
bd758ff203 Cleanup and small bug fixes 2023-08-29 05:45:49 -06:00
Jaret Burkett
a008d9e63b Fixed issue with loadin models after resume function added. Added additional flush if not training text encoder to clear out vram before grad accum 2023-08-28 17:56:30 -06:00
Jaret Burkett
b79ced3e10 Merge branch 'main' into development 2023-08-28 16:21:51 -06:00
Jaret Burkett
bee0b6a235 Added converters for all stable diffusion models to convert back to ldm format from diffusers. 2023-08-28 16:12:32 -06:00
Jaret Burkett
2ecb5cf024 Merge branch 'main' into development 2023-08-28 14:01:44 -06:00
Jaret Burkett
fab7c2b04a Fixed issue with key mapping from diffusers back to ldm 2023-08-28 14:01:26 -06:00
Jaret Burkett
e866c75638 Built base interfaces for a DTO to handle batch infomation transports for the dataloader 2023-08-28 12:43:31 -06:00
Jaret Burkett
71da78c8af improved normalization for a network with varrying batch network weights 2023-08-28 12:42:57 -06:00
Jaret Burkett
c446f768ea Huge memory optimizations, many big fixes 2023-08-27 17:48:02 -06:00
Jaret Burkett
cc49786ee9 Dataloader bug fixes 2023-08-27 14:36:38 -06:00
Jaret Burkett
9b164a8688 Fixed issue with bucket dataloader corpping in too much. Added normalization capabilities to LoRA modules. Testing effects, but should prevent them from burning and also make them more compatable with stacking many LoRAs 2023-08-27 09:40:01 -06:00
Jaret Burkett
6bd3851058 Fixed issue with prompt token replace adding more than one replacement 2023-08-26 18:52:23 -06:00
Jaret Burkett
fd338e67bb Fixed bug with dataloader not seperating mulitple datasets 2023-08-26 18:07:24 -06:00
Jaret Burkett
8105c05c12 Added bucketting capabilities to dataloader. Finally have full planned capability. noice 2023-08-26 16:36:32 -06:00
Jaret Burkett
2cb27c3f57 Merge branch 'main' of github.com:ostris/ai-toolkit 2023-08-26 08:55:09 -06:00
Jaret Burkett
3367ab6b2c Moved SD batch processing to a shared method and added it for use in slider training. Still testing if it affects quality over sampling 2023-08-26 08:55:00 -06:00
Jaret Burkett
24f46ea7d6 Merge pull request #9 from FoundSol/patch-1
Update README.md
2023-08-25 20:05:51 -06:00
Fundamentum
5bef2985b5 Update README.md 2023-08-25 21:13:24 -03:00
Jaret Burkett
aeaca13d69 Fixed issue with shuffeling permutations 2023-08-23 22:02:00 -06:00
Jaret Burkett
b408f9f3eb Fixed issue with timestep I broke for sliders 2023-08-23 16:15:30 -06:00
Jaret Burkett
7157c316af Added support for training lora, dreambooth, and fine tuning. Still need testing and docs 2023-08-23 15:37:00 -06:00
Jaret Burkett
e2c547f6c2 Fixed typo 2023-08-23 13:33:48 -06:00
Jaret Burkett
7b770bc305 Merge pull request #7 from ostris/textual_inversion
Textual inversion training
2023-08-23 13:31:37 -06:00
Jaret Burkett
f200cf36c5 Added train example to ti 2023-08-23 13:30:29 -06:00
Jaret Burkett
d298240cec Tied in ant tested TI script 2023-08-23 13:26:28 -06:00
Jaret Burkett
2e6c55c720 WIP creating textual inversion training script 2023-08-22 21:02:38 -06:00
Jaret Burkett
36ba08d3fa Added a converter back to ldm from diffusers for sdxl. Can finally get to training it properly 2023-08-21 16:22:01 -06:00
Jaret Burkett
e8667f856f Fix issue with there being an extra . on gene 2023-08-20 15:54:38 -06:00
Jaret Burkett
bef5551ea5 Ultimate slider training built, still needs tuning 2023-08-19 18:54:34 -06:00
Jaret Burkett
b77b9acc0b Added base for ultimate slider. WIP 2023-08-19 15:35:24 -06:00
Jaret Burkett
c6675e2801 Added shuffeling to prompts 2023-08-19 07:57:30 -06:00
Jaret Burkett
90eedb78bf Added multiplier jitter, min_snr, ability to choose sdxl encoders to use, shuffle generator, and other fun 2023-08-19 05:54:22 -06:00
Jaret Burkett
80e2f4a2a4 Merge branch 'main' of github.com:ostris/ai-toolkit 2023-08-18 11:45:00 -06:00
Jaret Burkett
d51c4ca704 Added ability to use two seperate folders for datasets when doing image reference sliders 2023-08-18 11:44:33 -06:00
Jaret Burkett
c7ec132d5d third times a charm 2023-08-16 20:54:00 -06:00
Jaret Burkett
ed9607e8da Update SliderTraining.ipynb
I should be doing this the right way
2023-08-16 20:49:09 -06:00
Jaret Burkett
d44f8ac508 Update SliderTraining.ipynb
fixed code block
2023-08-16 20:47:56 -06:00
Jaret Burkett
8d09eb44ec Fixed an issue with CFG time embeds on SDXL 2023-08-15 18:02:14 -06:00
Jaret Burkett
55a5fcc7d9 Added method to get specific keys from model 2023-08-15 14:51:04 -06:00
Jaret Burkett
e96874241d Added slider colab to readme 2023-08-13 13:55:38 -06:00
Jaret Burkett
e3be1a1758 Added WIP slider training colab 2023-08-13 13:52:38 -06:00
Jaret Burkett
1a92e97c6d Added missing deps 2023-08-13 13:15:04 -06:00
Jaret Burkett
355c80df07 Added ability to use civit ai url ar model name and built a model downloader and cache manager for it 2023-08-13 13:09:51 -06:00
Jaret Burkett
1487d13191 Moved the run job command 2023-08-13 10:25:56 -06:00
Jaret Burkett
383bad958d Added a way to run as a library by passing job dict 2023-08-13 09:54:39 -06:00
Jaret Burkett
196b693cf0 Worked on reference slider script. It is working well currently. Still going to tune it a bit before a writeup though 2023-08-12 17:59:24 -06:00
Jaret Burkett
fd95e7b60c Merge branch 'main' of github.com:ostris/ai-toolkit 2023-08-12 05:59:58 -06:00