ai-toolkit

ostris/ai-toolkit

Fork 0

mirror of https://github.com/ostris/ai-toolkit.git synced 2026-05-11 16:30:40 +00:00

Commit Graph

Select branches

Hide Pull Requests

WIP

dev

development

hidream_o1

kohya-sdxl

lumina2

main

multi-gpu

qwen_image_edit

sdxl

wavelet_loss

#107

#109

#115

#12

#120

#124

#125

#128

#138

#141

#143

#155

#156

#158

#160

#160

#168

#173

#176

#177

#179

#183

#184

#185

#191

#196

#224

#226

#232

#233

#244

#245

#246

#249

#25

#251

#253

#253

#256

#263

#264

#265

#271

#273

#274

#275

#278

#283

#290

#300

#302

#302

#303

#304

#307

#318

#326

#326

#331

#333

#341

#342

#343

#350

#353

#354

#359

#362

#373

#375

#377

#381

#382

#383

#385

#392

#392

#395

#407

#41

#417

#418

#420

#422

#426

#427

#430

#431

#431

#432

#434

#442

#446

#447

#452

#455

#459

#461

#464

#465

#467

#469

#473

#474

#488

#489

#492

#494

#496

#498

#499

#500

#509

#511

#513

#519

#520

#521

#522

#523

#525

#527

#540

#547

#551

#555

#558

#559

#563

#563

#564

#564

#567

#578

#580

#581

#583

#594

#599

#60

#600

#601

#601

#606

#608

#61

#610

#611

#614

#616

#629

#630

#633

#637

#639

#644

#646

#648

#649

#655

#658

#660

#661

#666

#666

#668

#668

#673

#682

#685

#687

#69

#692

#694

#694

#695

#697

#698

#699

#7

#702

#703

#705

#706

#707

#708

#709

#709

#713

#713

#717

#718

#718

#719

#720

#721

#724

#724

#726

#727

#727

#732

#732

#733

#738

#742

#743

#743

#745

#748

#749

#754

#759

#760

#761

#762

#763

#765

#765

#766

#766

#767

#768

#769

#770

#774

#774

#777

#777

#778

#778

#782

#782

#783

#785

#793

#80

#800

#803

#803

#805

#805

#807

#807

#808

#808

#809

#811

#811

#812

#812

#813

#813

#814

#814

#819

#819

#825

#825

#827

#828

#828

#829

#829

#86

#9

#95

fd338e67bb Fixed bug with dataloader not seperating mulitple datasets Jaret Burkett 2023-08-26 18:07:24 -06:00
8105c05c12 Added bucketting capabilities to dataloader. Finally have full planned capability. noice Jaret Burkett 2023-08-26 16:36:32 -06:00
2cb27c3f57 Merge branch 'main' of github.com:ostris/ai-toolkit Jaret Burkett 2023-08-26 08:55:09 -06:00
3367ab6b2c Moved SD batch processing to a shared method and added it for use in slider training. Still testing if it affects quality over sampling Jaret Burkett 2023-08-26 08:55:00 -06:00
24f46ea7d6 Merge pull request #9 from FoundSol/patch-1 Jaret Burkett 2023-08-25 20:05:51 -06:00
5bef2985b5 Update README.md Fundamentum 2023-08-25 21:13:24 -03:00
aeaca13d69 Fixed issue with shuffeling permutations Jaret Burkett 2023-08-23 22:02:00 -06:00
b408f9f3eb Fixed issue with timestep I broke for sliders Jaret Burkett 2023-08-23 16:15:30 -06:00
7157c316af Added support for training lora, dreambooth, and fine tuning. Still need testing and docs Jaret Burkett 2023-08-23 15:37:00 -06:00
e2c547f6c2 Fixed typo Jaret Burkett 2023-08-23 13:33:48 -06:00
7b770bc305 Merge pull request #7 from ostris/textual_inversion Jaret Burkett 2023-08-23 13:31:37 -06:00
f200cf36c5 Added train example to ti Jaret Burkett 2023-08-23 13:30:29 -06:00
d298240cec Tied in ant tested TI script Jaret Burkett 2023-08-23 13:26:28 -06:00
2e6c55c720 WIP creating textual inversion training script Jaret Burkett 2023-08-22 21:02:38 -06:00
36ba08d3fa Added a converter back to ldm from diffusers for sdxl. Can finally get to training it properly Jaret Burkett 2023-08-21 16:22:01 -06:00
e8667f856f Fix issue with there being an extra . on gene Jaret Burkett 2023-08-20 15:54:38 -06:00
bef5551ea5 Ultimate slider training built, still needs tuning Jaret Burkett 2023-08-19 18:54:34 -06:00
b77b9acc0b Added base for ultimate slider. WIP Jaret Burkett 2023-08-19 15:35:24 -06:00
c6675e2801 Added shuffeling to prompts Jaret Burkett 2023-08-19 07:57:30 -06:00
90eedb78bf Added multiplier jitter, min_snr, ability to choose sdxl encoders to use, shuffle generator, and other fun Jaret Burkett 2023-08-19 05:54:22 -06:00
80e2f4a2a4 Merge branch 'main' of github.com:ostris/ai-toolkit Jaret Burkett 2023-08-18 11:45:00 -06:00
d51c4ca704 Added ability to use two seperate folders for datasets when doing image reference sliders Jaret Burkett 2023-08-18 11:44:33 -06:00
c7ec132d5d third times a charm Jaret Burkett 2023-08-16 20:54:00 -06:00
ed9607e8da Update SliderTraining.ipynb Jaret Burkett 2023-08-16 20:49:09 -06:00
d44f8ac508 Update SliderTraining.ipynb Jaret Burkett 2023-08-16 20:47:56 -06:00
8d09eb44ec Fixed an issue with CFG time embeds on SDXL Jaret Burkett 2023-08-15 18:02:14 -06:00
1d2523b978 WIP porting to kohya-sdxl. So much to do. kohya-sdxl Jaret Burkett 2023-08-15 17:07:34 -06:00
55a5fcc7d9 Added method to get specific keys from model Jaret Burkett 2023-08-15 14:51:04 -06:00
e96874241d Added slider colab to readme Jaret Burkett 2023-08-13 13:55:38 -06:00
e3be1a1758 Added WIP slider training colab Jaret Burkett 2023-08-13 13:52:38 -06:00
1a92e97c6d Added missing deps Jaret Burkett 2023-08-13 13:15:04 -06:00
355c80df07 Added ability to use civit ai url ar model name and built a model downloader and cache manager for it Jaret Burkett 2023-08-13 13:09:51 -06:00
1487d13191 Moved the run job command Jaret Burkett 2023-08-13 10:25:56 -06:00
383bad958d Added a way to run as a library by passing job dict Jaret Burkett 2023-08-13 09:54:39 -06:00
196b693cf0 Worked on reference slider script. It is working well currently. Still going to tune it a bit before a writeup though Jaret Burkett 2023-08-12 17:59:24 -06:00
fd95e7b60c Merge branch 'main' of github.com:ostris/ai-toolkit Jaret Burkett 2023-08-12 05:59:58 -06:00
379992d89e Various bug fixes and improvements Jaret Burkett 2023-08-12 05:59:50 -06:00
c7054d714f Finally muted the annoying safety checker notification Jaret Burkett 2023-08-12 01:38:18 -06:00
67dfd9ced0 Added inbuild plugins and made one for image referenced. WIP Jaret Burkett 2023-08-10 16:20:38 -06:00
1a7e346b41 Added inbuild plugins and made one for image referenced. WIP Jaret Burkett 2023-08-10 16:02:44 -06:00
df48f0a843 Moved some of the job config into base process so it will be easier to extend extensions Jaret Burkett 2023-08-10 12:14:05 -06:00
fbc8a87a05 Reworked the sd rescaler script Jaret Burkett 2023-08-09 08:57:27 -06:00
bf90740b59 Fixed numerous issues with traing ESRGAN Jaret Burkett 2023-08-08 20:03:19 -06:00
ff2c9f3d04 Merge branch 'main' of github.com:ostris/ai-toolkit Jaret Burkett 2023-08-07 18:05:03 -06:00
8bd536df7e Added training for a custom version of ERSGAN arcitecture. Testing training now Jaret Burkett 2023-08-07 18:04:23 -06:00
64fbd4c92a Fix some windows dependency issues Jaret Burkett 2023-08-05 20:28:49 -06:00
8c90fa86c6 Complete reqork of how slider training works and optimized it to hell. Can run entire algorythm in 1 batch now with less VRAM consumption than a quarter of it used to take Jaret Burkett 2023-08-05 18:46:08 -06:00
7e4e660663 Added extensions and an example extension that merges models Jaret Burkett 2023-08-04 09:37:24 -06:00
b865ac8b24 Various windows bug fixes Jaret Burkett 2023-08-04 05:51:58 -06:00
66c6f0f6f7 Big refactor of SD runner and added image generator Jaret Burkett 2023-08-03 14:51:25 -06:00
75ec5d9292 Hotfix to handle latest transformers clip model missing key suddenly Jaret Burkett 2023-08-02 12:26:18 -06:00
1a25b275c8 Did some work on SD rescaler. Need to run a long test on it eventually. Jaret Burkett 2023-08-02 07:59:27 -06:00
2bf3e529ce Set gradient checkpointing on unet enabled by default. Help out immensly with sdxl backprop spikes Jaret Burkett 2023-08-01 15:43:27 -06:00
f53fd08690 Fixed issue with rescaled loras only saving af fp32 Jaret Burkett 2023-08-01 14:08:22 -06:00
8b8d53888d Added Model rescale and prepared a release upgrade WIP Jaret Burkett 2023-08-01 13:49:54 -06:00
63cacf4362 Merge remote-tracking branch 'origin/main' into WIP Jaret Burkett 2023-07-31 15:14:28 -06:00
c1b1e800df Updated module names to be compatable with ney koyha unet Jaret Burkett 2023-07-31 13:16:29 -06:00
7726911562 Allow name to be passed through command line Jaret Burkett 2023-07-31 11:56:57 -06:00
c01673f1b5 Added random weight adjuster to prevent overfitting Jaret Burkett 2023-07-29 19:30:14 -06:00
c35b78f0d4 Added random weight adjuster to prevent overfitting Jaret Burkett 2023-07-29 17:14:14 -06:00
8ba1b11557 Merge branch 'sdxl' into WIP Jaret Burkett 2023-07-29 14:29:18 -06:00
9cdf2dd6e4 Bug fixes sdxl Jaret Burkett 2023-07-29 13:39:57 -06:00
1e50b39442 Work on slider rework Jaret Burkett 2023-07-28 18:11:10 -06:00
5fc2bb5d9c Information trainer Jaret Burkett 2023-07-28 08:16:29 -06:00
c7640b0865 WIP diffusers pipeline is weird. Starting to hate sdxl Jaret Burkett 2023-07-27 17:35:24 -06:00
b2e2e4bf47 Added sd1.5 and 2.1 do the diffusers pipeline flow Jaret Burkett 2023-07-27 12:34:48 -06:00
596e57a6a6 Pipelines working on SDXL for noise prediction Jaret Burkett 2023-07-27 11:24:33 -06:00
6ab8b8b0f1 WIP. just need to put it here Jaret Burkett 2023-07-27 01:46:30 -06:00
2305e55c82 Moving over to a highly difussers flow for xl Jaret Burkett 2023-07-26 18:25:01 -06:00
d3ad195b51 Added rescaling, locon, sdxl, all kinds of stuff. sdxl is still weird Jaret Burkett 2023-07-26 16:19:50 -06:00
40e60fa021 Finially found that bug. ugh Jaret Burkett 2023-07-25 15:28:20 -06:00
cb70c03273 SDXL should be working, but I broke something where it is not converging. Jaret Burkett 2023-07-25 13:50:59 -06:00
52f02d53f1 switched to xl branch on sd-scripts Jaret Burkett 2023-07-25 07:41:08 -06:00
7032717294 Added ability to just erase or enhance concepts from a model Jaret Burkett 2023-07-24 17:33:45 -06:00
61dd818608 Added anchors to regulate the lora Jaret Burkett 2023-07-24 14:59:16 -06:00
390192c6a1 Moved the base SD training process to a parent class so we can do some more creative stuff without copy pasta Jaret Burkett 2023-07-24 11:29:39 -06:00
e6fb0229bf Added better optimizer chooised and param support Jaret Burkett 2023-07-24 09:21:58 -06:00
9a2819900c added target weight to targets Jaret Burkett 2023-07-23 14:08:37 -06:00
452f2a6da2 Added info, config, etc for lora extracotr and slider trainer Jaret Burkett 2023-07-23 13:13:45 -06:00
9367089d48 Added example for slider training that will run as is Jaret Burkett 2023-07-23 11:24:12 -06:00
434fb22458 Adde dnoise offset Jaret Burkett 2023-07-22 15:01:01 -06:00
3f4f429c4a Reworked the balancing and swapping of the lora during training to make it much more stable when trained Jaret Burkett 2023-07-22 14:13:39 -06:00
ce8e7a1271 Added prompt flag to adjust network multiplier Jaret Burkett 2023-07-22 00:05:15 -06:00
596e59dd6d Slider training functioning, time to perfect it Jaret Burkett 2023-07-21 22:06:49 -06:00
ddcd9069e1 Base for loopback lora training setup, still working on proper sliders Jaret Burkett 2023-07-21 18:26:02 -06:00
aa13251877 Actually addind the Process class..... Jaret Burkett 2023-07-20 15:46:23 -06:00
0761656a90 Added my good ole pattern loss. God I love that thing, conv transpose pattern instantly wiped from vae Jaret Burkett 2023-07-20 15:44:16 -06:00
982e0be7a9 Removed train config, updating it, and added my llvae as pytorch model Jaret Burkett 2023-07-20 14:12:28 -06:00
c29b9d075f Setup the base process for merging things. WIP Jaret Burkett 2023-07-20 07:39:31 -06:00
557732e7ff Added Critic support to VAE training. Still tweaking and working on it. Many other fixes Jaret Burkett 2023-07-19 15:57:32 -06:00
6ada328d8d Fixed issues with vgg19 preprocessing. Added yaml support on config file Jaret Burkett 2023-07-19 06:12:57 -06:00
8d8229dfc0 Handle conversions back to ldm for saving Jaret Burkett 2023-07-18 19:34:35 -06:00
17c13eef88 Default to only training mse. Did a lot of cleanup with script. Added logging via tensorboard. Jaret Burkett 2023-07-18 09:40:51 -06:00
94d52572d4 Style and content loss working Jaret Burkett 2023-07-18 07:47:01 -06:00
439310e4dc Made a very basic vae trainer. Jaret Burkett 2023-07-17 19:03:50 -06:00
78b59c5e99 Added support for 3cleir, not fully tested Jaret Burkett 2023-07-16 15:35:14 -06:00
9df7af1720 Adjusted some names and allow to ignore text encoder on extract Jaret Burkett 2023-07-16 12:52:39 -06:00
a61914ddd9 Add support for threshold, ratio, and quantile on traditional LoRa Jaret Burkett 2023-07-12 20:02:22 -06:00
8d6edae9fd Added support for traditional LoRa extract using LoCon script Jaret Burkett 2023-07-12 19:51:40 -06:00
57f14e5ef2 WIP implementing training Jaret Burkett 2023-07-12 08:23:46 -06:00

... 9 10 11 12 13 ...