ai-toolkit

ostris/ai-toolkit

Fork 0

mirror of https://github.com/ostris/ai-toolkit.git synced 2026-01-27 00:49:47 +00:00

Commit Graph

Select branches

Hide Pull Requests

WIP

dev

development

kohya-sdxl

lumina2

main

multi-gpu

qwen_image_edit

sdxl

wavelet_loss

#107

#109

#115

#12

#120

#124

#125

#128

#128

#138

#138

#141

#143

#155

#155

#156

#156

#158

#158

#160

#160

#168

#168

#173

#176

#177

#179

#179

#183

#184

#184

#185

#185

#191

#191

#196

#224

#224

#226

#226

#232

#233

#233

#244

#244

#245

#245

#246

#246

#249

#25

#25

#251

#251

#253

#253

#256

#263

#263

#264

#265

#265

#271

#273

#273

#274

#275

#275

#278

#283

#283

#290

#290

#300

#300

#302

#302

#303

#303

#304

#307

#318

#318

#326

#326

#331

#331

#333

#333

#341

#341

#342

#342

#343

#350

#350

#353

#353

#354

#354

#359

#362

#362

#373

#373

#375

#375

#377

#381

#381

#382

#382

#383

#385

#385

#392

#392

#395

#407

#407

#41

#417

#418

#420

#420

#422

#426

#427

#427

#430

#430

#431

#431

#432

#432

#434

#442

#442

#446

#447

#452

#455

#459

#459

#461

#461

#464

#465

#465

#467

#469

#469

#473

#473

#474

#488

#488

#489

#489

#492

#492

#494

#494

#496

#498

#498

#499

#499

#500

#509

#511

#513

#519

#519

#520

#520

#521

#522

#523

#525

#527

#527

#540

#547

#547

#551

#551

#555

#558

#558

#559

#559

#563

#563

#564

#564

#567

#578

#578

#580

#580

#581

#581

#583

#594

#599

#599

#60

#600

#600

#601

#601

#606

#606

#608

#608

#61

#610

#611

#614

#614

#616

#616

#629

#629

#630

#630

#633

#633

#637

#637

#639

#639

#644

#646

#648

#649

#649

#655

#655

#658

#658

#660

#661

#661

#666

#666

#668

#668

#69

#69

#7

#80

#86

#86

#9

#95

9ef6f1a828 Increase client body size to 100 gb main Jaret Burkett 2026-01-24 12:44:17 -07:00
f29272ee90 Update diffusers version with dgx Jaret Burkett 2026-01-19 14:06:38 -07:00
a6da9e37ac Add support for FLUX.2 klein base models Jaret Burkett 2026-01-17 17:46:25 -07:00
0efed794b4 Fix issue where flux2 would ignore single control image on training Jaret Burkett 2026-01-17 20:26:35 +00:00
e132dbae76 Add number of repeats for a dataset in the ui Jaret Burkett 2026-01-15 08:03:31 -07:00
e40d7ac605 Ignore i2v on ltx is training on images Jaret Burkett 2026-01-14 18:46:27 -07:00
9848de7946 Fix issue with ltx cached latents if there is no audio. Jaret Burkett 2026-01-14 17:27:01 -07:00
73dedbf662 Do caching of latents, first frame and audio when caching latents for LTX2 Jaret Burkett 2026-01-14 11:05:23 -07:00
64fe29b182 Support img 2 vid training for ltx-2 Jaret Burkett 2026-01-13 19:04:56 -07:00
5b5aadadb8 Add LTX-2 Support (#644) Jaret Burkett 2026-01-13 04:55:30 -07:00
6870ab490f Add 4 bit ARA for qwen image 2512 Jaret Burkett 2026-01-01 20:16:56 -07:00
926097aa4c Added 3bit ARA for qwen image 2512 Jaret Burkett 2026-01-01 06:51:49 -07:00
4d5a649a7d Added initial support for Qwen-Image-2512 Jaret Burkett 2025-12-31 06:11:56 -07:00
0d5c181843 Fixed issue where the control images would sometimes be ignored on qwen_image_edit_2511 Jaret Burkett 2025-12-30 16:40:49 +00:00
356449ec3f bump diffusers version Jaret Burkett 2025-12-26 11:18:23 -07:00
90fc99f486 Separate dependencies for DGX OS devices (#610) raziel2001au 2025-12-27 01:32:26 +10:00
a767b82b60 Fixed issue with new logger when ooming Jaret Burkett 2025-12-25 16:57:34 +00:00
8edf1e44c5 Added 3 bit accuracy recovery adapter for qwen image edit 2511 Jaret Burkett 2025-12-24 05:33:47 -07:00
ed36edd85b Bumped docker OS, python version, torch version Jaret Burkett 2025-12-23 19:44:20 -07:00
57a2ab1299 Add initial support for Qwen Image Edit 2511 Jaret Burkett 2025-12-23 10:53:48 -07:00
9883055684 Fix issue where ui could break if caption is read as a non string. Jaret Burkett 2025-12-23 09:47:19 -07:00
87edca1b2b Added initial support to initiate lora training from an existing lora Jaret Burkett 2025-12-22 12:49:15 -07:00
91342853c1 Add support for DGX OS (#567) raziel2001au 2025-12-21 00:20:07 +10:00
8864ba915e Remove easy-dwpose from the default requierments Jaret Burkett 2025-12-20 07:16:20 -07:00
113bbd0e3e Fixed an issue with the new version of nextjs with client body size Jaret Burkett 2025-12-18 19:18:35 -07:00
ba00eea7d9 Add loss graph to the ui Jaret Burkett 2025-12-18 10:08:59 -07:00
3b6c1ade18 Update supporters Jaret Burkett 2025-12-17 15:20:55 -07:00
cd0e691040 Fix NextJS vulnerability (#594) apolinário 2025-12-17 18:03:13 +01:00
26f4f02453 Add support for Z-Image-De-Turbo Jaret Burkett 2025-12-04 10:03:13 -07:00
2d30dc5d52 Bump version Jaret Burkett 2025-12-02 21:29:19 -07:00
6c85184441 Set zit training adapter to default to v2 Jaret Burkett 2025-12-02 16:46:05 -07:00
e6c5aead3b Fix issue that prevented ramtorch layer offloading with z_image Jaret Burkett 2025-12-02 16:14:34 -07:00
d42f5af2fc Fixed issue with DOP when using Z-Image Jaret Burkett 2025-11-28 09:36:21 -07:00
08a39754a4 Fixed issue that prevented caching text embeddings on z-image Jaret Burkett 2025-11-28 09:19:39 -07:00
4e62c38df5 Add support for training Z-Image Turbo with a de-distill training adapter Jaret Burkett 2025-11-28 08:08:53 -07:00
21bb8a2bf4 Merge pull request #525 from ostris/flux2 Jaret Burkett 2025-11-25 07:53:36 -08:00
01cf480233 Add FLUX.2 official weights Jaret Burkett 2025-11-25 08:52:19 -07:00
dadbeda197 Update test weights Jaret Burkett 2025-11-23 10:51:50 -07:00
0b5f3475e2 Merge branch 'main' into flux2 Jaret Burkett 2025-11-23 08:18:35 -07:00
50e5d99545 Fix issue where text encoder was not fully unloaded in some instances Jaret Burkett 2025-11-19 09:01:00 -07:00
26e4b71b57 Fix issue with parsing image info for sample info on some windows machines. Jaret Burkett 2025-11-19 08:45:05 -07:00
cd607c4902 Fix a bug that can happen if you remove a gpu from your machine. Jaret Burkett 2025-11-19 08:28:48 -07:00
af8e9ea149 Add initial support for FLUX.2 Jaret Burkett 2025-11-18 11:17:38 -07:00
323b4aaf5a Do not copy pin memory if it fails, just move Jaret Burkett 2025-11-17 18:04:00 +00:00
2e7b2d9926 Added Differential Guidance training target Jaret Burkett 2025-11-10 09:38:25 -07:00
9b89bab8fe Version bump Jaret Burkett 2025-11-09 10:11:25 -07:00
6f308fc46e When soing guidance loss, make CFG zero an optional target instead of a forced one. Jaret Burkett 2025-11-04 09:16:15 -07:00
c984369294 Fixed resizing of control image resolution for Qwen Image Edit 2509 when using match_target_res Jaret Burkett 2025-10-30 06:30:01 -06:00
42e5e3cd1c Adjust DFE to handle 5 dimension latent spaces Jaret Burkett 2025-10-27 07:48:44 -06:00
8c12977891 Fixed adafactor eps Jaret Burkett 2025-10-26 05:47:25 -06:00
80418209b8 Fixe a variable that could nt be declared when doing blank prompt preservation Jaret Burkett 2025-10-23 16:19:56 -06:00
ee206cfa18 Added blank prompt preservation Jaret Burkett 2025-10-22 14:55:13 -06:00
ca57ffc270 When having less than 3 sample images, add spacing to the grid so images are not huge Jaret Burkett 2025-10-22 13:52:38 -06:00
ff14cd6343 Fix check for making sure vae is on the right device. Jaret Burkett 2025-10-21 14:49:20 -06:00
5123090f6c Adjust dataloader tester to handle videos to test them Jaret Burkett 2025-10-21 14:47:23 -06:00
0d8a33dc16 Offload ARA with the layer if doing layer offloading. Add support to offload the LoRA. Still needs optimizer support Jaret Burkett 2025-10-21 06:03:27 -06:00
76ce757e0c Added initial support for layer offloading wit Wan 2.2 14B models. Jaret Burkett 2025-10-20 14:54:30 -06:00
8bbaa4e224 Update sponsors Jaret Burkett 2025-10-20 09:59:44 -06:00
b7f85928f3 Fix issue with chroma when not quantizing Jaret Burkett 2025-10-19 12:13:05 -06:00
d51297bcf9 Updated supporters in the Readme Jaret Burkett 2025-10-18 03:14:03 -06:00
1f81bc4060 Fix issue where text encoder could be the wrong quantization and fail when using memory manager Jaret Burkett 2025-10-15 11:01:30 -06:00
7abf5e20be Add conv3d to memory management excluded modules Jaret Burkett 2025-10-15 10:12:06 -06:00
91b87e06a1 Reordered logs Jaret Burkett 2025-10-15 09:15:06 -06:00
645c54d617 Fixed issue that may occour if no queue is built when starting one from the table. Jaret Burkett 2025-10-15 08:48:07 -06:00
b523d58699 Added ability to clone an existing job in the ui Jaret Burkett 2025-10-14 14:13:37 -06:00
7e34a03113 Added queing system to the UI Jaret Burkett 2025-10-14 12:00:42 -06:00
0c9e1c3deb Fixed some fringe cases for qwen image edit. Jaret Burkett 2025-10-13 17:10:46 +00:00
77cf3b824f Version Bump Jaret Burkett 2025-10-10 22:16:50 -06:00
e9c4d94256 Allow for matching target resolution with control images for Qwen Image Edit 2509 Jaret Burkett 2025-10-10 14:24:27 -06:00
1bc6dee127 Change auto_memory to be layer_offloading and allow you to set the amount to unload Jaret Burkett 2025-10-10 13:12:32 -06:00
2c2fbf16ea Version bump Jaret Burkett 2025-10-09 11:26:07 -06:00
8068755b0a Fixed issue with wan 2.2 getting stuck on CPU Jaret Burkett 2025-10-09 17:24:25 +00:00
55b8b0e23e Fix issue where ARA was not working when using memory manager Jaret Burkett 2025-10-07 13:39:44 -06:00
dfc85f0b51 Add Auto Memory for qwen models in the ui Jaret Burkett 2025-10-07 10:43:52 -06:00
1ea50d8590 Add cpu info the the job page Jaret Burkett 2025-10-07 08:30:23 -06:00
c9f982af83 Add support for using quantized models with ramtorch Jaret Burkett 2025-10-06 13:46:57 -06:00
dc1cc3e78a Fixed issue where multi control samples didnt work when not caching Jaret Burkett 2025-10-05 14:38:53 -06:00
4e5707854f Initial support for RamTorch. Still a WIP Jaret Burkett 2025-10-05 13:03:26 -06:00
c6edd71a5b Version bump Jaret Burkett 2025-10-01 14:13:38 -06:00
b7c04efb44 A commit with the adits properly named improvements to qwen image edit plus workflow. Fixed a bug. Dont norm the cfg Jaret Burkett 2025-10-01 14:13:15 -06:00
3086a58e5b git status Jaret Burkett 2025-10-01 14:12:17 -06:00
b07b88c46b Allow trigger when caching text embeddings since it is now passed to dataset Jaret Burkett 2025-09-30 16:58:35 -06:00
2ba4000704 Allow masked losses with video models Jaret Burkett 2025-09-30 14:57:07 -06:00
67ed563e03 fix issue with multi batch size on qwen-image-edit-plus Jaret Burkett 2025-09-30 09:04:56 -06:00
2e9de5eb50 Add ability to delete samples from the ui Jaret Burkett 2025-09-29 04:49:32 -06:00
ebadb321e3 On samples page, auto scroll to bottom on load. Added a floating button to scroll to bottom. Jaret Burkett 2025-09-29 03:56:17 -06:00
c233a80337 Reqorked visibility toggle on samples, should help when dealing with more samples Jaret Burkett 2025-09-28 14:13:10 -06:00
c20240be82 Add advanced menu on job to allow user to do things like make a job as stopped if the status ever gets hung Jaret Burkett 2025-09-28 13:43:00 -06:00
4e207d92cd Add seed to the sample image modal Jaret Burkett 2025-09-28 12:54:34 -06:00
f0646a0a70 Reworked ui sample image modal to show more information and function a lot better. Jaret Burkett 2025-09-27 12:50:47 -06:00
98d35f36a9 Add hidream ARA Jaret Burkett 2025-09-27 09:31:23 -06:00
3b1f7b0948 Allow user to set the attention backend. Add method to recomver from the occasional OOM if it is a rare event. Still exit if it ooms 3 times in a row. Jaret Burkett 2025-09-27 08:56:15 -06:00
6da417261c Add extra detachments just to be sure on qiep Jaret Burkett 2025-09-27 08:53:59 -06:00
be990630b9 Remove dropout from cached text embeddings even if used specifies it so blank prompts are not cached. Jaret Burkett 2025-09-26 11:50:53 -06:00
e04f55c553 Fixed scaling issue with control images Jaret Burkett 2025-09-26 11:49:53 -06:00
0eaa3d2893 Merge pull request #434 from ostris/qwen_image_edit_plus Jaret Burkett 2025-09-25 11:33:18 -06:00
1069dee0e4 Added ui sopport for multi control samples and datasets. Added qwen image edit 5209 to the ui Jaret Burkett 2025-09-25 11:10:02 -06:00
454be0958a Initial support for qwen image edit plus Jaret Burkett 2025-09-24 11:39:10 -06:00
f74475161e Add stepped loss type Jaret Burkett 2025-09-22 15:50:12 -06:00
28728a1e92 Added experimental dfe 5 Jaret Burkett 2025-09-21 10:48:52 -06:00