ostris/ai-toolkit
1
0
Fork 0
mirror of https://github.com/ostris/ai-toolkit.git synced 2026-04-23 07:49:24 +00:00
Code Issues Packages Projects Releases Wiki Activity
112 Commits 10 Branches 0 Tags
2ecb5cf024aae6507f6e46c754fee498fdb02d1f
Commit Graph

63 Commits

Author SHA1 Message Date
Jaret Burkett
e866c75638 Built base interfaces for a DTO to handle batch infomation transports for the dataloader 2023-08-28 12:43:31 -06:00
Jaret Burkett
c446f768ea Huge memory optimizations, many big fixes 2023-08-27 17:48:02 -06:00
Jaret Burkett
9b164a8688 Fixed issue with bucket dataloader corpping in too much. Added normalization capabilities to LoRA modules. Testing effects, but should prevent them from burning and also make them more compatable with stacking many LoRAs 2023-08-27 09:40:01 -06:00
Jaret Burkett
6bd3851058 Fixed issue with prompt token replace adding more than one replacement 2023-08-26 18:52:23 -06:00
Jaret Burkett
8105c05c12 Added bucketting capabilities to dataloader. Finally have full planned capability. noice 2023-08-26 16:36:32 -06:00
Jaret Burkett
3367ab6b2c Moved SD batch processing to a shared method and added it for use in slider training. Still testing if it affects quality over sampling 2023-08-26 08:55:00 -06:00
Jaret Burkett
aeaca13d69 Fixed issue with shuffeling permutations 2023-08-23 22:02:00 -06:00
Jaret Burkett
7157c316af Added support for training lora, dreambooth, and fine tuning. Still need testing and docs 2023-08-23 15:37:00 -06:00
Jaret Burkett
d298240cec Tied in ant tested TI script 2023-08-23 13:26:28 -06:00
Jaret Burkett
2e6c55c720 WIP creating textual inversion training script 2023-08-22 21:02:38 -06:00
Jaret Burkett
c6675e2801 Added shuffeling to prompts 2023-08-19 07:57:30 -06:00
Jaret Burkett
90eedb78bf Added multiplier jitter, min_snr, ability to choose sdxl encoders to use, shuffle generator, and other fun 2023-08-19 05:54:22 -06:00
Jaret Burkett
1a7e346b41 Added inbuild plugins and made one for image referenced. WIP 2023-08-10 16:02:44 -06:00
Jaret Burkett
df48f0a843 Moved some of the job config into base process so it will be easier to extend extensions 2023-08-10 12:14:05 -06:00
Jaret Burkett
fbc8a87a05 Reworked the sd rescaler script 2023-08-09 08:57:27 -06:00
Jaret Burkett
bf90740b59 Fixed numerous issues with traing ESRGAN 2023-08-08 20:03:19 -06:00
Jaret Burkett
8bd536df7e Added training for a custom version of ERSGAN arcitecture. Testing training now 2023-08-07 18:04:23 -06:00
Jaret Burkett
8c90fa86c6 Complete reqork of how slider training works and optimized it to hell. Can run entire algorythm in 1 batch now with less VRAM consumption than a quarter of it used to take 2023-08-05 18:46:08 -06:00
Jaret Burkett
7e4e660663 Added extensions and an example extension that merges models 2023-08-04 09:37:24 -06:00
Jaret Burkett
b865ac8b24 Various windows bug fixes 2023-08-04 05:51:58 -06:00
Jaret Burkett
66c6f0f6f7 Big refactor of SD runner and added image generator 2023-08-03 14:51:25 -06:00
Jaret Burkett
1a25b275c8 Did some work on SD rescaler. Need to run a long test on it eventually. 2023-08-02 07:59:27 -06:00
Jaret Burkett
f53fd08690 Fixed issue with rescaled loras only saving af fp32 2023-08-01 14:08:22 -06:00
Jaret Burkett
8b8d53888d Added Model rescale and prepared a release upgrade 2023-08-01 13:49:54 -06:00
Jaret Burkett
c01673f1b5 Added random weight adjuster to prevent overfitting 2023-07-29 19:30:14 -06:00
Jaret Burkett
c35b78f0d4 Added random weight adjuster to prevent overfitting 2023-07-29 17:14:14 -06:00
Jaret Burkett
8ba1b11557 Merge branch 'sdxl' into WIP 
# Conflicts:
#	jobs/process/BaseSDTrainProcess.py
#	jobs/process/TrainSliderProcess.py
 2023-07-29 14:29:18 -06:00
Jaret Burkett
9cdf2dd6e4 Bug fixes 2023-07-29 13:39:57 -06:00
Jaret Burkett
1e50b39442 Work on slider rework 2023-07-28 18:11:10 -06:00
Jaret Burkett
5fc2bb5d9c Information trainer 2023-07-28 08:16:29 -06:00
Jaret Burkett
c7640b0865 WIP diffusers pipeline is weird. Starting to hate sdxl 2023-07-27 17:35:24 -06:00
Jaret Burkett
b2e2e4bf47 Added sd1.5 and 2.1 do the diffusers pipeline flow 2023-07-27 12:34:48 -06:00
Jaret Burkett
596e57a6a6 Pipelines working on SDXL for noise prediction 2023-07-27 11:24:33 -06:00
Jaret Burkett
6ab8b8b0f1 WIP. just need to put it here 2023-07-27 01:46:30 -06:00
Jaret Burkett
2305e55c82 Moving over to a highly difussers flow for xl 2023-07-26 18:25:01 -06:00
Jaret Burkett
d3ad195b51 Added rescaling, locon, sdxl, all kinds of stuff. sdxl is still weird 2023-07-26 16:19:50 -06:00
Jaret Burkett
40e60fa021 Finially found that bug. ugh 2023-07-25 15:28:20 -06:00
Jaret Burkett
cb70c03273 SDXL should be working, but I broke something where it is not converging. 2023-07-25 13:50:59 -06:00
Jaret Burkett
7032717294 Added ability to just erase or enhance concepts from a model 2023-07-24 17:33:45 -06:00
Jaret Burkett
61dd818608 Added anchors to regulate the lora 2023-07-24 14:59:16 -06:00
Jaret Burkett
390192c6a1 Moved the base SD training process to a parent class so we can do some more creative stuff without copy pasta 2023-07-24 11:29:39 -06:00
Jaret Burkett
e6fb0229bf Added better optimizer chooised and param support 2023-07-24 09:21:58 -06:00
Jaret Burkett
9a2819900c added target weight to targets 2023-07-23 14:08:37 -06:00
Jaret Burkett
434fb22458 Adde dnoise offset 2023-07-22 15:01:01 -06:00
Jaret Burkett
3f4f429c4a Reworked the balancing and swapping of the lora during training to make it much more stable when trained 2023-07-22 14:13:39 -06:00
Jaret Burkett
ce8e7a1271 Added prompt flag to adjust network multiplier 2023-07-22 00:05:15 -06:00
Jaret Burkett
596e59dd6d Slider training functioning, time to perfect it 2023-07-21 22:06:49 -06:00
Jaret Burkett
ddcd9069e1 Base for loopback lora training setup, still working on proper sliders 2023-07-21 18:26:02 -06:00
Jaret Burkett
aa13251877 Actually addind the Process class..... 2023-07-20 15:46:23 -06:00
Jaret Burkett
c29b9d075f Setup the base process for merging things. WIP 2023-07-20 07:39:31 -06:00