ai-toolkit

ostris/ai-toolkit

Fork 0

mirror of https://github.com/ostris/ai-toolkit.git synced 2026-05-11 08:20:35 +00:00

Commit Graph

Select branches

Hide Pull Requests

WIP

dev

development

hidream_o1

kohya-sdxl

lumina2

main

multi-gpu

qwen_image_edit

sdxl

wavelet_loss

#107

#109

#115

#12

#120

#124

#125

#128

#138

#141

#143

#155

#156

#158

#160

#160

#168

#173

#176

#177

#179

#183

#184

#185

#191

#196

#224

#226

#232

#233

#244

#245

#246

#249

#25

#251

#253

#253

#256

#263

#264

#265

#271

#273

#274

#275

#278

#283

#290

#300

#302

#302

#303

#304

#307

#318

#326

#326

#331

#333

#341

#342

#343

#350

#353

#354

#359

#362

#373

#375

#377

#381

#382

#383

#385

#392

#392

#395

#407

#41

#417

#418

#420

#422

#426

#427

#430

#431

#431

#432

#434

#442

#446

#447

#452

#455

#459

#461

#464

#465

#467

#469

#473

#474

#488

#489

#492

#494

#496

#498

#499

#500

#509

#511

#513

#519

#520

#521

#522

#523

#525

#527

#540

#547

#551

#555

#558

#559

#563

#563

#564

#564

#567

#578

#580

#581

#583

#594

#599

#60

#600

#601

#601

#606

#608

#61

#610

#611

#614

#616

#629

#630

#633

#637

#639

#644

#646

#648

#649

#655

#658

#660

#661

#666

#666

#668

#668

#673

#682

#685

#687

#69

#692

#694

#694

#695

#697

#698

#699

#7

#702

#703

#705

#706

#707

#708

#709

#709

#713

#713

#717

#718

#718

#719

#720

#721

#724

#724

#726

#727

#727

#732

#732

#733

#738

#742

#743

#743

#745

#748

#749

#754

#759

#760

#761

#762

#763

#765

#765

#766

#766

#767

#768

#769

#770

#774

#774

#777

#777

#778

#778

#782

#782

#783

#785

#793

#80

#800

#803

#803

#805

#805

#807

#807

#808

#808

#809

#811

#811

#812

#812

#813

#813

#814

#814

#819

#819

#825

#825

#827

#828

#828

#829

#829

#86

#9

#95

7d80288f78 Merge branch 'main' into hidream_o1 hidream_o1 Jaret Burkett 2026-05-10 14:48:11 -06:00
f38de2a2fe Add tipsv2 locally and fix gradient checkpointing for it main Jaret Burkett 2026-05-10 14:47:44 -06:00
a8001e9a3f Fix gradient checkpointing for hidream o1 Jaret Burkett 2026-05-10 14:41:31 -06:00
f47f9f1f2c Remove dependence on flash attention for hidream o1 Jaret Burkett 2026-05-10 13:44:14 -06:00
bbdb05d744 Fix saving for hidream-o1 Jaret Burkett 2026-05-10 12:10:02 -06:00
05e85d18b5 Initial support for hidream. Lora keys likely need work Jaret Burkett 2026-05-10 10:07:55 -06:00
d144cb5ea6 Switch to uplot for loss graph and rework performance of graph. It is significantly more perfromant now. Jaret Burkett 2026-05-07 07:38:00 -06:00
a12ddd72a1 Change the velocity weight cap on dfe 9 Jaret Burkett 2026-05-07 07:37:05 -06:00
6bb8acbffc Add agreement_threshold default of 0.6 to automagic 2 Jaret Burkett 2026-05-05 19:13:00 -06:00
963a9f42b2 Add decode latent to wan 2.1 models. Add gradinet checkpointing to wan vae. Jaret Burkett 2026-05-05 11:30:16 -06:00
4260a3c5b6 Add optimizer test suite and make minor speed adjustments to Automagicv2 Jaret Burkett 2026-05-05 10:02:30 -06:00
aeca7fe404 Add Automagic v2 optimizer. It uses significantly less vram and is much more efficient. Jaret Burkett 2026-05-05 09:09:07 -06:00
0d91fcee9e Allow edit of captioning job Jaret Burkett 2026-04-30 16:00:16 -06:00
eadc9a58af Version bump Jaret Burkett 2026-04-30 06:00:58 -06:00
e9ab387dfd Fixed issue with qwen image edit models when using multiple control images when not caching text embeddings. Jaret Burkett 2026-04-30 11:59:12 +00:00
deb409085a Made it possible to use the flux 2 small decoder VAE when setting the vae_path manually for flux2 models Jaret Burkett 2026-04-30 05:42:31 -06:00
7ccec8ec2c Add checkpointing and a proper decode for flux 2 VAEs so they can be used with DFE Jaret Burkett 2026-04-30 04:27:13 -06:00
b4f0efb025 Version Bump Jaret Burkett 2026-04-28 13:42:00 -06:00
af6458d1b5 Enable caching of ACE step latents. Jaret Burkett 2026-04-28 13:39:20 -06:00
77b8765939 Fix issue with hover styling on select components. Jaret Burkett 2026-04-28 10:55:20 -06:00
43989cc19e Add advanced config section to the captioner Jaret Burkett 2026-04-28 10:49:46 -06:00
f972b750e6 Performance improvements to captioner. Add ability to set a default caption for ace captioner to avoid needing to caption the audio so we only transcribe Jaret Burkett 2026-04-28 10:15:11 -06:00
acc6a36214 Scale DFE 9 to a velocity equiv weight to match flow matching gradient strength. Probably need to rework all DFEs to do this as the math checks out. Jaret Burkett 2026-04-28 09:10:02 -06:00
1fc4ad3979 Add sapiens2 as a diffusion feature extractor Jaret Burkett 2026-04-27 15:59:03 -06:00
67d67f8c1d Ignore hidden files when captioning Jaret Burkett 2026-04-25 17:38:31 -06:00
998a02f30e Yet another pseudo_huber fix. Still drinking coffee. Jaret Burkett 2026-04-19 10:05:40 -06:00
fc85410c9a Fix issue with precision on pseudo_huber loss Jaret Burkett 2026-04-19 10:02:27 -06:00
20a99258b8 Fix issue is is else on pseudo_huber loss Jaret Burkett 2026-04-19 09:59:18 -06:00
f4445cd78c Added psuedo_huber loss Jaret Burkett 2026-04-19 09:51:46 -06:00
488878f354 Use hidden layers in the loss for DFE 7 and 8 Jaret Burkett 2026-04-18 13:07:38 -06:00
beb40ae29b Add DFE8 with partial step Jaret Burkett 2026-04-17 17:40:16 -06:00
7c4f18ce51 Fix ernie unpatchify Jaret Burkett 2026-04-17 12:03:39 -06:00
8cb9649382 Add decode latent to ernie pipe Jaret Burkett 2026-04-17 12:01:09 -06:00
67048df9f9 Merge branch 'main' of github.com:ostris/ai-toolkit Jaret Burkett 2026-04-17 06:05:40 -06:00
be54094704 Version bump Jaret Burkett 2026-04-17 06:05:26 -06:00
a513a1583e Fixed issue where Qwen VL MOE captioner produced nonsense Jaret Burkett 2026-04-16 21:24:43 +00:00
22ea3dd620 Fixed issue on some systems where Logger didnt have atty Jaret Burkett 2026-04-16 21:09:52 +00:00
ab1ee4df34 Hotfix some issues with Wan models caused by diffusers and transformers updates Jaret Burkett 2026-04-16 20:53:50 +00:00
0c18b39346 Version bump Jaret Burkett 2026-04-16 13:09:45 -06:00
afb62b1fa5 Add support for Nucleus-Image Jaret Burkett 2026-04-16 13:09:10 -06:00
2faba22b46 Fix issue when saving advanced prompt embeds. No such file or directory error Jaret Burkett 2026-04-16 12:22:56 -06:00
0792352dab version bump Jaret Burkett 2026-04-16 09:25:14 -06:00
8f67f5022e Version lock peft version Jaret Burkett 2026-04-15 14:17:26 -06:00
acc3e60140 Add ernie to readme Jaret Burkett 2026-04-15 06:43:36 -06:00
dd7074a21f Fix issue with layer offloading on ernie Jaret Burkett 2026-04-14 19:19:02 -06:00
e74bc9ac7b Fix issue with concatinating advanced prompt embeds. Jaret Burkett 2026-04-14 16:04:34 -06:00
7eb1226a6d Fix issue with loading advanced prompt configs metadata Jaret Burkett 2026-04-14 15:42:09 -06:00
97d8c05d75 Fix issue with captioner sometimes outputting not utf-8 characters Jaret Burkett 2026-04-14 14:37:21 -06:00
3e0c904054 Add support for Baidu's ERNIE-Image (#793) Jaret Burkett (Ostris) 2026-04-14 09:45:12 -06:00
e868fca562 fix custom_flowmatch_sampler (#783) Asaf Agami 2026-04-13 18:42:05 +03:00
233e292256 Added some experimental low step things for zeta Jaret Burkett 2026-04-13 09:37:34 -06:00
1058ef3513 Made AdvancedPromptEmbeds that is compatable with previous PromptEmbeds functionality, but is more streamlined and can accomidate more model embedding paradigms. Jaret Burkett 2026-04-11 10:45:47 -06:00
0d11be41fa Adjust default sample steps. Jaret Burkett 2026-04-10 17:46:34 -06:00
62e18427b4 Adjust default sample steps. Jaret Burkett 2026-04-10 17:46:09 -06:00
9b4e2d1b0b More flac support Jaret Burkett 2026-04-10 12:27:09 -06:00
0b9c365acb Add flac and ogg support Jaret Burkett 2026-04-10 12:10:54 -06:00
bfb373c8fa Prep for future breaking changes in newer versions of transformers library Jaret Burkett 2026-04-10 12:04:32 -06:00
145144eee3 Fix issue with auto updating captions when captioning a dataset Jaret Burkett 2026-04-10 11:51:18 -06:00
765a9d5b2e Add a download button to music samples in in the gear menu Jaret Burkett 2026-04-10 10:07:45 -06:00
d08ea8318f Change default timestep type for ace step to linear Jaret Burkett 2026-04-09 17:39:00 -06:00
78cf049c29 Add support for ACE-Step 1.5 and ACE-Step 1.5 XL. Also added dataset captioning through the UI. (#785) Jaret Burkett 2026-04-09 15:02:03 -06:00
9ca58e9aa2 Fixed offload and quantize order of ltx 2.3 text encoder. Jaret Burkett 2026-04-07 15:11:50 -06:00
0dcbabf6af Fix merge nertwork ref Jaret Burkett 2026-04-01 10:38:31 -06:00
f213e3b1e5 Fix FLUX2 Klein load-time VRAM spikes on low-memory GPUs. (#726) M. Hofer 2026-04-01 17:36:55 +02:00
da2a79590f Add a merge network on save strength Jaret Burkett 2026-04-01 09:21:08 -06:00
853ffaf207 Add light mode support. Jaret Burkett 2026-03-31 16:54:55 -06:00
ad474e3d06 Update and reformat the readme Jaret Burkett 2026-03-31 12:31:05 -06:00
4a3251640a More work on compiling models Jaret Burkett 2026-03-31 12:11:56 -06:00
358d684f6f Move compiiling the model after accelerate manipulation Jaret Burkett 2026-03-31 09:52:27 -06:00
0045260af7 Fix issue where compile true did not actually compile the model Jaret Burkett 2026-03-31 09:27:54 -06:00
e22039e4aa Add more optimizers to the ui Jaret Burkett 2026-03-31 09:20:20 -06:00
bf56217c37 Fixed issue where job would fail if DB is locked. Jaret Burkett 2026-03-31 09:10:33 -06:00
dcb7f465ec Version Bump Jaret Burkett 2026-03-30 15:57:40 -06:00
626d9674ea Add info about automated coding agent pull requests. So sick of them. Jaret Burkett 2026-03-30 11:02:12 -06:00
b43ea6c2d3 Abort caption requests when they are not in view to tax the server less. Jaret Burkett 2026-03-30 10:46:25 -06:00
a484e55d66 Rework dataset model and file dragging. Use single model for dragging, uploading, and selecting images. Jaret Burkett 2026-03-30 10:33:10 -06:00
ac82ebd852 Dont try to list hidden files in datasets Jaret Burkett 2026-03-30 10:03:10 -06:00
171535833a Add Mac OS support for Apple Silicon (#770) Jaret Burkett 2026-03-30 09:37:47 -06:00
bc47fd6755 Make a requirements base file to make it easier to maintain requirements across platforms. Jaret Burkett 2026-03-29 14:04:46 -06:00
fbda10d088 Add a duplicate dataset function to the ui Jaret Burkett 2026-03-29 13:51:18 -06:00
86dcf39eee Allow user to set a training seed via env vars for repeat result testing Jaret Burkett 2026-03-29 13:34:46 -06:00
45e99664b9 Add icons to the top bar on the job page Jaret Burkett 2026-03-29 12:38:47 -06:00
540659709d Improved the load time of dataset and sample images and videos by switching to streaming Jaret Burkett 2026-03-29 10:38:34 -06:00
e030f4f2e0 Show the control images in the image viewer when clicked so they can be easily previewed for reference. Jaret Burkett 2026-03-29 10:00:54 -06:00
affa411edc Fixed an issue where Flux.2 model VAE can be left offloaded to CPU when encoding control images while caching latents Jaret Burkett 2026-03-29 09:49:10 -06:00
6a1fc54779 Add t0 loss target Jaret Burkett 2026-03-28 13:35:21 -06:00
8302b21f8f Version Bump Jaret Burkett 2026-03-28 13:23:52 -06:00
20929b93df Fix onChange path for EMA Decay input (#695) willhsmit 2026-03-28 12:02:32 -07:00
4ef5cbe5bc Fixing bug where width and height are inverted for control image resizing (#707) abionda-sc 2026-03-28 19:00:32 +00:00
700c4b53d0 Pin timm==1.0.22 (#633) Rob Ballantyne 2026-03-28 18:52:41 +00:00
ca72eb1515 Add 1328 native resolution for Qwen Image training (#749) Rayane 2026-03-28 19:09:15 +01:00
5ce87fa48b Version bump Jaret Burkett 2026-03-27 20:26:31 -06:00
740657e25e Improve dataset uploader. Upload the files one at a time instead of one huge chunk. Show progress for each file. Jaret Burkett 2026-03-27 09:26:22 -06:00
f85bf065bf Use pooler embeddings for DFE v6 with dino v3 Jaret Burkett 2026-03-27 07:02:07 -06:00
a802014ec5 Update the torch versions in the README Jaret Burkett 2026-03-26 12:15:32 -06:00
2782df02c3 Allow HF_HUB_ENABLE_HF_TRANSFER to be set via env variable Jaret Burkett 2026-03-26 10:45:49 -06:00
2c8d2acdcb On jobs table, sort idle jobs by last updated so recent active ones are at the top Jaret Burkett 2026-03-26 10:33:17 -06:00
9a77389653 On a new training job, or when editing one, load everything before allowing editing Jaret Burkett 2026-03-26 10:23:42 -06:00
a7bb4ddb2c Work on loss graph. Add smoothed overlay. Allow user to hilite a secton of the graph to zoom into. Jaret Burkett 2026-03-26 10:05:09 -06:00
401f7df425 Merge branch 'main' of github.com:ostris/ai-toolkit Jaret Burkett 2026-03-26 09:11:50 -06:00

1 2 3 4 5 ...