ai-toolkit

ostris/ai-toolkit

Fork 0

mirror of https://github.com/ostris/ai-toolkit.git synced 2026-02-02 11:59:46 +00:00

Commit Graph

Select branches

Hide Pull Requests

WIP

dev

development

kohya-sdxl

lumina2

main

multi-gpu

qwen_image_edit

sdxl

wavelet_loss

#107

#109

#115

#12

#120

#124

#125

#128

#128

#138

#138

#141

#143

#155

#155

#156

#156

#158

#158

#160

#160

#168

#168

#173

#176

#177

#179

#179

#183

#184

#184

#185

#185

#191

#191

#196

#224

#224

#226

#226

#232

#233

#233

#244

#244

#245

#245

#246

#246

#249

#25

#25

#251

#251

#253

#253

#256

#263

#263

#264

#265

#265

#271

#273

#273

#274

#275

#275

#278

#283

#283

#290

#290

#300

#300

#302

#302

#303

#303

#304

#307

#318

#318

#326

#326

#331

#331

#333

#333

#341

#341

#342

#342

#343

#350

#350

#353

#353

#354

#354

#359

#362

#362

#373

#373

#375

#375

#377

#381

#381

#382

#382

#383

#385

#385

#392

#392

#395

#407

#407

#41

#417

#418

#420

#420

#422

#426

#427

#427

#430

#430

#431

#431

#432

#432

#434

#442

#442

#446

#447

#452

#455

#459

#459

#461

#461

#464

#465

#465

#467

#469

#469

#473

#473

#474

#488

#488

#489

#489

#492

#492

#494

#494

#496

#498

#498

#499

#499

#500

#509

#511

#513

#519

#519

#520

#520

#521

#522

#523

#525

#527

#527

#540

#547

#547

#551

#551

#555

#558

#559

#559

#563

#563

#564

#564

#567

#578

#578

#580

#580

#581

#581

#583

#594

#599

#60

#600

#600

#601

#601

#606

#606

#608

#608

#61

#610

#611

#614

#614

#616

#616

#629

#629

#630

#630

#633

#633

#637

#637

#639

#639

#644

#646

#648

#649

#649

#655

#655

#658

#658

#660

#661

#661

#666

#666

#668

#668

#673

#673

#682

#685

#685

#687

#687

#69

#69

#692

#692

#694

#694

#695

#695

#7

#80

#86

#86

#9

#95

f5e40dfa62 WIP on wan Jaret Burkett 2025-03-01 16:12:52 -07:00
acc79956aa WIP create new class to add new models more easily Jaret Burkett 2025-03-01 13:49:02 -07:00
60539c0b0f Allow using prior loss with a custom adapter Jaret Burkett 2025-03-01 08:01:14 -07:00
dd700f70b3 Avoid loading state dict for automagic for now until I can sort out some issues Jaret Burkett 2025-02-26 17:03:14 -07:00
d360e76661 fixed issue with dop prompt replacement Jaret Burkett 2025-02-26 13:35:18 -07:00
6ec23ed226 Fixed issue when doing inverted masked prior with flowmatching algos Jaret Burkett 2025-02-26 12:12:32 -07:00
f6e16e582a Added Differential Output Preservation Loss to trainer and ui Jaret Burkett 2025-02-25 20:12:36 -07:00
259ded9602 Fixed issue with trigger word saving in ui Jaret Burkett 2025-02-24 11:04:24 -07:00
440ba5fb3d Spawn windows in an cmd terminal. Should be working now, but not sure on my system Jaret Burkett 2025-02-24 08:54:56 -07:00
093f14ac19 UI Bug fixes and initial windows support Jaret Burkett 2025-02-24 08:15:22 -07:00
f0fbd8bb53 Merge pull request #256 from ostris/ui Jaret Burkett 2025-02-23 16:10:49 -07:00
0a981bea2b Fixed typo Jaret Burkett 2025-02-23 16:07:38 -07:00
1d0e3a4498 Fixed some build issues for now. Added info to the readme Jaret Burkett 2025-02-23 15:59:17 -07:00
3c7daf49f3 Add HF token to env when spawing via ui Jaret Burkett 2025-02-23 14:52:12 -07:00
56d8d6bd81 Capture speed from the timer for the ui Jaret Burkett 2025-02-23 14:38:46 -07:00
3e49337a58 Set step to the last step saved at when exiting Jaret Burkett 2025-02-23 13:21:22 -07:00
60f848a877 Send more data when loading the model to the ui Jaret Burkett 2025-02-23 12:49:54 -07:00
b366e46f1c Added more settings to the training config Jaret Burkett 2025-02-23 12:34:52 -07:00
a280f78c69 Added checkpoint downloader Jaret Burkett 2025-02-22 16:48:15 -07:00
6e19e7449e Fixed some issues with gpu info refreshing Jaret Burkett 2025-02-22 14:14:23 -07:00
a6d46ad9ae Cleanup of job page Jaret Burkett 2025-02-22 13:54:06 -07:00
f3725578dd Cleaned up dashboard Jaret Burkett 2025-02-22 13:23:26 -07:00
ed99c3c0c8 Moved gpu to its own widget Jaret Burkett 2025-02-22 12:43:20 -07:00
ed84c19205 Moved the job action bar to a shred component Jaret Burkett 2025-02-22 12:20:14 -07:00
a7a9c11d9e Fixed add image dropbox Jaret Burkett 2025-02-22 11:59:21 -07:00
f60698d0ee Fixed some bugs with ui and lock job name to prevent issues with continuing training. Jaret Burkett 2025-02-22 11:49:36 -07:00
5f094fb17a Added controls to the jobs table Jaret Burkett 2025-02-22 10:57:53 -07:00
a5227cba7b Switched to a universal table library Jaret Burkett 2025-02-22 09:59:17 -07:00
77a5e01301 Added proper icon Jaret Burkett 2025-02-22 09:05:55 -07:00
4ef5a668c0 Make left arrow browsing only hit last image max Jaret Burkett 2025-02-21 22:04:53 -07:00
f081d14527 Preview samples full screen and use arrow keys to navigate them Jaret Burkett 2025-02-21 21:52:24 -07:00
710c6de1c9 Samples work in ui now Jaret Burkett 2025-02-21 20:28:52 -07:00
2b6e66e0cb Mor ui work Jaret Burkett 2025-02-21 12:40:17 -07:00
ab641e014f Added funding github stuff Jaret Burkett 2025-02-21 17:13:36 +00:00
ad87f72384 Start, stop, monitor jobs from ui working. Jaret Burkett 2025-02-21 09:49:28 -07:00
d0214c0df9 Make ui more uniform Jaret Burkett 2025-02-21 06:18:27 -07:00
adcf884c0f Built out the ui trainer plugin with db comminication Jaret Burkett 2025-02-21 05:53:35 -07:00
f778d979b5 Saving captions is working Jaret Burkett 2025-02-20 16:17:00 -07:00
db3ccbba33 Handle image deletion Jaret Burkett 2025-02-20 15:58:10 -07:00
0d2be18a9b Delete datasets Jaret Burkett 2025-02-20 14:49:03 -07:00
bbc340e545 Cleanup and add hooks Jaret Burkett 2025-02-20 13:38:58 -07:00
33fdfd6091 Added beginning or lokr Jaret Burkett 2025-02-20 12:47:42 -07:00
9f6030620f Dataset uploads working Jaret Burkett 2025-02-20 12:47:01 -07:00
b5252b5028 More ui work Jaret Burkett 2025-02-20 11:19:01 -07:00
b0d8fc220d More ui more ui Jaret Burkett 2025-02-19 20:54:02 -07:00
cef7d9e594 Config ui section is coming along Jaret Burkett 2025-02-19 07:52:24 -07:00
b13fcc1039 Setup a very basic ui Jaret Burkett 2025-02-18 10:57:14 -07:00
b32d7e552b Shamelessly beg for money Jaret Burkett 2025-02-18 05:15:29 -07:00
4af6c5cf30 Work on supporting flex.2 potential arch Jaret Burkett 2025-02-17 14:10:25 -07:00
1f7784510d WIP Flex 2 pipeline Jaret Burkett 2025-02-16 14:54:29 -07:00
87e557cf1e Bug fixes and improvements to llmadapter Jaret Burkett 2025-02-15 07:18:07 -07:00
bd8d7dc081 fixed various issues with llm attention masking. Added block training on the llm adapter. Jaret Burkett 2025-02-14 11:24:01 -07:00
2be6926398 Added back syustem prompt for llm and remove those tokens from the embeddings Jaret Burkett 2025-02-14 07:23:37 -07:00
87ac031859 Remove system prompt, shouldnt be necessary fo rhow it works. Jaret Burkett 2025-02-13 08:42:48 -07:00
7679105d52 Added llm text encoder adapter Jaret Burkett 2025-02-13 08:28:32 -07:00
2622de1e01 DFE tweaks. Adding support for more llms as text encoders Jaret Burkett 2025-02-13 04:31:49 -07:00
8450aca10e Fixed missed merge conflice and locked diffusers version Jaret Burkett 2025-02-12 09:40:02 -07:00
0b8a32def7 merged in lumina2 branch Jaret Burkett 2025-02-12 09:33:03 -07:00
787bb37e76 Small fixed for DFE, polar guidance, and other things Jaret Burkett 2025-02-12 09:27:44 -07:00
10aa7e9d5e Fixed some breaking changes with diffusers gradient checkpointing. Jaret Burkett 2025-02-10 09:35:31 -07:00
ed1deb71c4 Added examples for training lumina2 lumina2 Jaret Burkett 2025-02-08 16:13:18 -07:00
4de6a825fa Update lumina requirements Jaret Burkett 2025-02-08 15:16:35 -07:00
9a7266275d Wokr on lumina2 Jaret Burkett 2025-02-08 14:52:39 -07:00
d138f07365 Imitial lumina3 support Jaret Burkett 2025-02-08 10:59:53 -07:00
c6d8eedb94 Added ability to use consistent noise for each image in a dataset by hashing the path and using that as a seed. Jaret Burkett 2025-02-08 07:13:48 -07:00
af5e760be1 Merge pull request #249 from ostris/accelerate-multi-gpu Jaret Burkett 2025-02-08 07:11:10 -07:00
ff3d54bb5b Make the mean of the mask multiplier be 1.0 for a more balanced loss. Jaret Burkett 2025-02-06 10:57:06 +00:00
0e75724b4d Lock version of diffusers Jaret Burkett 2025-02-05 18:14:59 +00:00
376bb1bf6f Lock torch version due to breaking changes Jaret Burkett 2025-02-04 23:00:57 +00:00
216ab164ce Experimental features and bug fixes Jaret Burkett 2025-02-04 13:36:34 -07:00
e6180d1e1d Bug fixes Jaret Burkett 2025-01-31 13:23:01 -07:00
15a57bc89f Add new version of DFE. Kitchen sink Jaret Burkett 2025-01-31 11:42:27 -07:00
e5355bf8d5 Added train catch to the blank network Jaret Burkett 2025-01-30 16:15:45 +00:00
34a1c6947a Added flux_shift as timestep type Jaret Burkett 2025-01-27 07:35:00 -07:00
2141c6e06c Merge remote-tracking branch 'origin/main' into accelerate-multi-gpu Jaret Burkett 2025-01-26 11:19:34 -07:00
1188cf1e8a Adjust flux sample sampler to handle some new breaking changes in diffusers. Jaret Burkett 2025-01-26 18:09:21 +00:00
5e663746b8 Working multi gpu training. Still need a lot of tweaks and testing. Jaret Burkett 2025-01-25 16:46:20 -07:00
441474e81f Added a flag to lora extraction script to do a full transformer extraction. Jaret Burkett 2025-01-24 09:34:13 -07:00
a6a690f796 Update full fine tune example to only train transformer blocks. Jaret Burkett 2025-01-24 09:28:34 -07:00
6191f19e55 Added script to convert diffusers model to ComfyUI variant Jaret Burkett 2025-01-23 21:30:23 -07:00
bbfba0c188 Added v2 of dfp Jaret Burkett 2025-01-22 16:32:13 -07:00
e1549ad54d Update dfe model arch Jaret Burkett 2025-01-22 10:37:23 -07:00
04abe57c76 Added weighing to DFE Jaret Burkett 2025-01-22 08:50:57 -07:00
89dd041b97 Added ability to pair samples with a closer noise with optimal_noise_pairing_samples Jaret Burkett 2025-01-21 18:30:10 -07:00
29122b1a54 Added code to handle diffusion feature extraction loss Jaret Burkett 2025-01-21 14:21:34 -07:00
6a8e3d8610 Added a config file for full finetuning flex. Added a lora extraction script for flex Jaret Burkett 2025-01-20 10:09:01 -07:00
4c8a9e1b88 Added example config to train Flex Jaret Burkett 2025-01-18 18:03:20 -07:00
fadb2f3a76 Allow quantizing the te independently on flux. added lognorm_blend timestep schedule Jaret Burkett 2025-01-18 18:02:31 -07:00
4723f23c0d Added ability to split up flux across gpus (experimental). Changed the way timestep scheduling works to prep for more specific schedules. Jaret Burkett 2024-12-31 07:06:55 -07:00
8ef07a9c36 Added training for an experimental decoratgor embedding. Allow for turning off guidance embedding on flux (for unreleased model). Various bug fixes and modifications Jaret Burkett 2024-12-15 08:59:27 -07:00
92ce93140e Adjustments to defaults for automagic Jaret Burkett 2024-11-29 10:28:06 -07:00
f213996aa5 Fixed saving and displaying for automagic Jaret Burkett 2024-11-29 08:00:22 -07:00
cbe31eaf0a Initial work on a auto adjusting optimizer Jaret Burkett 2024-11-29 04:48:58 -07:00
67c2e44edb Added support for training flux redux adapters Jaret Burkett 2024-11-21 20:01:52 -07:00
96d418bb95 Added support for full finetuning flux with randomized param activation. Examples coming soon Jaret Burkett 2024-11-21 13:05:32 -07:00
894374b2e9 Various bug fixes and optimizations for quantized training. Added untested custom adam8bit optimizer. Did some work on LoRM (dont use) Jaret Burkett 2024-11-20 09:16:55 -07:00
6509ba4484 Fix seed generation to make it deterministic so it is consistant from gpu to gpu Jaret Burkett 2024-11-15 12:11:13 -07:00
025ee3dd3d Added ability for adafactor to fully fine tune quantized model. Jaret Burkett 2024-10-30 16:38:07 -06:00
58f9d01c2b Added adafactor implementation that handles stochastic rounding of update and accumulation Jaret Burkett 2024-10-30 05:25:57 -06:00
e72b59a8e9 Added experimental 8bit version of prodigy with stochastic rounding and stochastic gradient accumulation. Still testing. Jaret Burkett 2024-10-29 14:28:28 -06:00