Commit Graph

Select branches

Hide Pull Requests

WIP

dev

development

hidream_o1

kohya-sdxl

lumina2

main

multi-gpu

qwen_image_edit

sdxl

wavelet_loss

#107

#109

#115

#12

#120

#124

#125

#128

#138

#141

#143

#155

#156

#158

#160

#160

#168

#173

#176

#177

#179

#183

#184

#185

#191

#196

#224

#226

#232

#233

#244

#245

#246

#249

#25

#251

#253

#253

#256

#263

#264

#265

#271

#273

#274

#275

#278

#283

#290

#300

#302

#302

#303

#304

#307

#318

#326

#326

#331

#333

#341

#342

#343

#350

#353

#354

#359

#362

#373

#375

#377

#381

#382

#383

#385

#392

#392

#395

#407

#41

#417

#418

#420

#422

#426

#427

#430

#431

#431

#432

#434

#442

#446

#447

#452

#455

#459

#461

#464

#465

#467

#469

#473

#474

#488

#489

#492

#494

#496

#498

#499

#500

#509

#511

#513

#519

#520

#521

#522

#523

#525

#527

#540

#547

#551

#555

#558

#559

#563

#563

#564

#564

#567

#578

#580

#581

#583

#594

#599

#60

#600

#601

#601

#606

#608

#61

#610

#611

#614

#616

#629

#630

#633

#637

#639

#644

#646

#648

#649

#655

#658

#660

#661

#666

#666

#668

#668

#673

#682

#685

#687

#69

#692

#694

#694

#695

#697

#698

#699

#7

#702

#703

#705

#706

#707

#708

#709

#709

#713

#713

#717

#718

#718

#719

#720

#721

#724

#724

#726

#727

#727

#732

#732

#733

#738

#742

#743

#743

#745

#748

#749

#754

#759

#760

#761

#762

#763

#765

#765

#766

#766

#767

#768

#769

#770

#774

#774

#777

#777

#778

#778

#782

#782

#783

#785

#793

#80

#800

#803

#803

#805

#805

#807

#807

#808

#808

#809

#811

#811

#812

#812

#813

#813

#814

#814

#819

#819

#825

#825

#827

#828

#828

#829

#829

#86

#9

#95

Mono Color

• e127c079da fix: print out the path where the image encode failed (#107) liaoliaojun 2024-08-23 11:34:35 +08:00
• 34db804c76 Modal cloud training support, fixed typo in toolkit/scheduler.py, Schnell training support for Colab, issue #92 , issue #114 (#115) martintomov 2024-08-23 06:25:44 +03:00
• 4d35a29c97 Add push_to_hub to the trainer (#109) apolinário 2024-08-23 04:18:56 +01:00
• b322d05fa3 Added tutorial link to readme Jaret Burkett 2024-08-22 16:25:32 -06:00
• 8577849eeb Fixed wrong discord link. Woops. Jaret Burkett 2024-08-22 14:49:03 -06:00
• 338c77d677 Fixed breaking change with diffusers. Allow flowmatch on normal stable diffusion models. Jaret Burkett 2024-08-22 14:36:22 -06:00
• e07a98a50c Bugfixes for full finetuning at bf16 Jaret Burkett 2024-08-22 05:15:33 -06:00
• 6a754b2710 Merge branch 'main' of github.com:ostris/ai-toolkit Jaret Burkett 2024-08-22 04:36:50 -06:00
• a939cf3730 WIP - adding support for flux DoRA and ip adapter training Jaret Burkett 2024-08-22 04:36:39 -06:00
• 169dbd22ba Finaized bug reports Jaret Burkett 2024-08-18 16:21:48 -06:00
• 6e7d721382 More issues testing Jaret Burkett 2024-08-18 16:20:08 -06:00
• dc6f36cd82 Testing github bug reporting stuff Jaret Burkett 2024-08-18 16:09:52 -06:00
• 5603f9e004 issue #76, and RunPod cloud training setup #90 (#80) martintomov 2024-08-19 00:43:45 +03:00
• c45887192a Unload interum weights when doing multi lora fuse Jaret Burkett 2024-08-18 09:35:10 -06:00
• 13a965a26c Fixed bad key naming on lora fuse I just pushed Jaret Burkett 2024-08-18 09:33:31 -06:00
• 77ee7090e8 Update FAQ.md Jaret Burkett 2024-08-18 09:26:22 -06:00
• 078396ceac Added a basic FAQ Jaret Burkett 2024-08-18 09:21:51 -06:00
• f944eeaa4d Fuse flux schnell assistant adapter in pieces when doing lowvram to drastically speed ip up from minutes to seconds. Jaret Burkett 2024-08-18 09:09:11 -06:00
• 81899310f8 Added support for training on flux schnell. Added example config and instructions for training on flux schnell Jaret Burkett 2024-08-17 06:58:39 -06:00
• f9179540d2 Flush after sampling Jaret Burkett 2024-08-16 17:29:42 -06:00
• 452e0e286d For lora assisted training, merge in before quantizing then sample with schnell at -1 weight. Almost doubles training speed with lora adapter. Jaret Burkett 2024-08-16 17:28:44 -06:00
• 165510ace2 Dumb typo Jaret Burkett 2024-08-15 12:59:32 -06:00
• 0355662e8e Added support for polarity guidance for flow matching models Jaret Burkett 2024-08-15 12:22:00 -06:00
• b99d36dfdb fixed issue with batch sizes larget than 1 Jaret Burkett 2024-08-15 12:21:38 -06:00
• 9001e5c933 Change flux latent spact if so it will not use old cache Jaret Burkett 2024-08-14 11:27:40 -06:00
• 7fed4ea761 fixed huge flux training bug. Added ability to use an assistatn lora Jaret Burkett 2024-08-14 10:14:13 -06:00
• e07bf11727 Merge pull request #61 from fofr/patch-1 Jaret Burkett 2024-08-14 08:01:51 -06:00
• c728cc9a0b Update README.md fofr 2024-08-14 15:00:02 +01:00
• 00bd3d54a3 Actually use the save dtype from the config file. Jaret Burkett 2024-08-13 17:08:27 -06:00
• f7cf2f866f Make 100% sure lora alpha matches for flux Jaret Burkett 2024-08-13 14:24:03 -06:00
• 465bc1e2f8 Update readme again Jaret Burkett 2024-08-13 13:37:22 -06:00
• 0beca0d4a7 Updated readme Jaret Burkett 2024-08-13 13:35:20 -06:00
• 418f5f7e8c Added new experimental time step weighing that should solve a lot of issues with distribution. Updated example. Removed a warning Jaret Burkett 2024-08-13 12:02:11 -06:00
• 9ee1ef2a0a Added experimental modified sigma sqrt weight mapping for linear timestep scheduling for flowmatching Jaret Burkett 2024-08-12 17:03:09 -06:00
• 599fafe01f Allow user to have the full flux checkpoint local Jaret Burkett 2024-08-12 09:57:16 -06:00
• af108bb964 Bug fix with dataloader. Added a flag to completly disable sampling Jaret Burkett 2024-08-12 09:19:40 -06:00
• 89d61a3b8e Readme updates Jaret Burkett 2024-08-11 13:23:57 -06:00
• a6aa4b2c7d Added ability to set timesteps to linear for flowmatching schedule Jaret Burkett 2024-08-11 13:06:08 -06:00
• f8f0657b68 Added a colab notebook for training flux loras Jaret Burkett 2024-08-11 12:27:40 -06:00
• 7f0ecdb377 Merge branch 'main' of github.com:ostris/ai-toolkit Jaret Burkett 2024-08-11 11:10:45 -06:00
• fbed8568fb Actually use the correct timestep sampling instead of calculating it and moving on lol. Tested a few with it and it seems to work better. Jaret Burkett 2024-08-11 11:10:37 -06:00
• 6d31c6db73 Added a fix for windows dataloader Jaret Burkett 2024-08-11 10:48:24 -06:00
• 6490a326e5 Fixed issue for vaes without a shift Jaret Burkett 2024-08-11 10:30:55 -06:00
• 8d48ad4e85 fixed bug I added to demo config Jaret Burkett 2024-08-11 10:28:39 -06:00
• ec1ea7aa0e Added support for training on primary gpu with low_vram flag. Updated example script to remove creepy horse sample at that seed Jaret Burkett 2024-08-11 09:54:30 -06:00
• fa02e774b0 Added info about datset Jaret Burkett 2024-08-10 15:08:05 -06:00
• 2308ef2868 Added flux training instructions Jaret Burkett 2024-08-10 14:10:02 -06:00
• b3e03295ad Reworked flux pred. Again Jaret Burkett 2024-08-08 13:06:34 -06:00
• e69a520616 Reworked timestep distribution on flowmatch sampler when training. Jaret Burkett 2024-08-08 06:01:45 -06:00
• acafe9984f Adjustments to loading of flux. Added a feedback to ema Jaret Burkett 2024-08-07 13:17:26 -06:00
• 653fe60f16 Updates to flow matching algo Jaret Burkett 2024-08-07 15:04:17 +00:00
• c2424087d6 8 bit training working on flux Jaret Burkett 2024-08-06 11:53:27 -06:00
• 272c8608c2 Make a CFG version of flux pipeline Jaret Burkett 2024-08-05 16:35:53 -06:00
• 99f24cfb0c Added a conversion script to convert my loras to peft format for flux Jaret Burkett 2024-08-05 14:54:10 -06:00
• 187663ab55 Use peft format for flux loras so they are compatible with diffusers. allow loading an assistant lora Jaret Burkett 2024-08-05 14:34:37 -06:00
• edb7e827ee Adjusted flow matching so target noise multiplier works properly with it. Jaret Burkett 2024-08-05 11:40:05 -06:00
• 0ea27011d5 Bug fix Jaret Burkett 2024-08-04 11:07:19 -06:00
• f321de7bdb Setup to retrain guidance embedding for flux. Use defualt timestep distribution for flux Jaret Burkett 2024-08-04 10:37:23 -06:00
• 88acc28d7f Prep for runpod docker Jaret Burkett 2024-08-03 12:41:06 -06:00
• de2da96a81 Updat4ed requirements Jaret Burkett 2024-08-03 09:50:18 -06:00
• 9beea1c268 Flux training should work now... maybe Jaret Burkett 2024-08-03 09:17:34 -06:00
• 369aa143bc Only train a few blocks on flux (for now) Jaret Burkett 2024-08-03 07:02:27 -06:00
• 87ba867fdc Added flux training. Still a WIP. Wont train right without rectified flow working right Jaret Burkett 2024-08-02 15:00:30 -06:00
• 03613c523f Bugfixes and cleanup Jaret Burkett 2024-08-01 11:45:12 -06:00
• 47744373f2 Change img multiplier math Jaret Burkett 2024-07-30 11:33:41 -06:00
• 443c996e7f Do a noisy unconsitional for vision direct Jaret Burkett 2024-07-29 15:42:26 -06:00
• 8f0f467c20 Switch back to old ilora Jaret Burkett 2024-07-29 07:22:05 -06:00
• e81e19fd0f Added target_norm_std which is a game changer Jaret Burkett 2024-07-28 16:08:33 -06:00
• 0bc4d555c7 A lot of pixart sigma training tweaks Jaret Burkett 2024-07-28 11:23:18 -06:00
• 80aa2dbb80 New image generation img2img. various tweaks and fixes Jaret Burkett 2024-07-24 04:13:41 -06:00
• 8d799031cf Remove reg as prior pred Jaret Burkett 2024-07-21 02:34:12 -06:00
• 6e92922c14 Add a mergable linear to the mid of ilora Jaret Burkett 2024-07-20 21:17:53 -06:00
• c51235c486 Fixed misnamed var Jaret Burkett 2024-07-20 23:00:20 +00:00
• c2c4e8cf34 Added ability to target parts of lora for ilora Jaret Burkett 2024-07-20 22:45:52 +00:00
• 4c249cf607 Added ilora2 Jaret Burkett 2024-07-20 16:40:57 -06:00
• c2d5f712a3 Reworked ilora arch Jaret Burkett 2024-07-20 15:35:59 -06:00
• 22d2f6e28f Fixed issue with grad scaling Jaret Burkett 2024-07-20 08:21:57 -06:00
• a2301cf28c Amall bug fixes Jaret Burkett 2024-07-18 10:39:55 -06:00
• 11e426fdf1 Various features and fixes. Too much brain fog to do a proper description Jaret Burkett 2024-07-18 07:34:14 -06:00
• 58dffd43a8 Added caching to image sizes so we dont do it every time. Jaret Burkett 2024-07-15 19:07:41 -06:00
• e4558dff4b Partial implementation for training auraflow. Jaret Burkett 2024-07-12 12:11:38 -06:00
• c062b7716c Varous bug fixes Jaret Burkett 2024-07-10 15:20:04 -06:00
• c008405480 Added after model load hook Jaret Burkett 2024-07-09 15:34:48 -06:00
• 93e5df1d59 Merge branch 'main' of github.com:ostris/ai-toolkit Jaret Burkett 2024-07-07 07:56:56 -06:00
• 045e4a6e15 Save entire pixart model again Jaret Burkett 2024-07-07 07:56:48 -06:00
• 76f225a467 Fixed issue with TE adapter caption projection Jaret Burkett 2024-07-06 19:09:58 +00:00
• cab8a1c7b8 WIP to add the caption_proj weight to pixart sigma TE adapter Jaret Burkett 2024-07-06 13:00:21 -06:00
• acb06d6ff3 Bug fixes Jaret Burkett 2024-07-03 10:56:34 -06:00
• bb57623a35 Merge branch 'main' of github.com:ostris/ai-toolkit Jaret Burkett 2024-06-29 15:53:40 -06:00
• 3072d20f17 Add ability to include conv_in and conv_out to full train when doing a lora Jaret Burkett 2024-06-29 14:54:50 -06:00
• f6b21f47bb Increased the number of heads for ip adapters. Jaret Burkett 2024-06-28 16:09:52 +00:00
• 603ceca3ca added ema Jaret Burkett 2024-06-28 10:03:26 -06:00
• 657fd09f25 Added more control over Sigma sizes Jaret Burkett 2024-06-26 08:57:53 -06:00
• 8407c4deea Merge branch 'main' of github.com:ostris/ai-toolkit Jaret Burkett 2024-06-23 14:47:43 -06:00
• 64f2b085b7 Minor fixes Jaret Burkett 2024-06-23 14:47:40 -06:00
• 7165f2d25a Work to omprove pixart training Jaret Burkett 2024-06-23 20:46:48 +00:00
• 5d47244c57 Added support for pixart sigma loras Jaret Burkett 2024-06-16 11:56:30 -06:00
• ada722c9e4 Fixed issue with heads not being added Jaret Burkett 2024-06-15 08:34:33 -06:00
• 696f73c30d Removed variant Jaret Burkett 2024-06-14 17:09:47 -06:00
• e3410413b9 Rework head on ilora Jaret Burkett 2024-06-14 16:21:26 -06:00