Commit Graph

  • f5e40dfa62 WIP on wan Jaret Burkett 2025-03-01 16:12:52 -07:00
  • acc79956aa WIP create new class to add new models more easily Jaret Burkett 2025-03-01 13:49:02 -07:00
  • 60539c0b0f Allow using prior loss with a custom adapter Jaret Burkett 2025-03-01 08:01:14 -07:00
  • dd700f70b3 Avoid loading state dict for automagic for now until I can sort out some issues Jaret Burkett 2025-02-26 17:03:14 -07:00
  • d360e76661 fixed issue with dop prompt replacement Jaret Burkett 2025-02-26 13:35:18 -07:00
  • 6ec23ed226 Fixed issue when doing inverted masked prior with flowmatching algos Jaret Burkett 2025-02-26 12:12:32 -07:00
  • f6e16e582a Added Differential Output Preservation Loss to trainer and ui Jaret Burkett 2025-02-25 20:12:36 -07:00
  • 259ded9602 Fixed issue with trigger word saving in ui Jaret Burkett 2025-02-24 11:04:24 -07:00
  • 440ba5fb3d Spawn windows in an cmd terminal. Should be working now, but not sure on my system Jaret Burkett 2025-02-24 08:54:56 -07:00
  • 093f14ac19 UI Bug fixes and initial windows support Jaret Burkett 2025-02-24 08:15:22 -07:00
  • f0fbd8bb53 Merge pull request #256 from ostris/ui Jaret Burkett 2025-02-23 16:10:49 -07:00
  • 0a981bea2b Fixed typo Jaret Burkett 2025-02-23 16:07:38 -07:00
  • 1d0e3a4498 Fixed some build issues for now. Added info to the readme Jaret Burkett 2025-02-23 15:59:17 -07:00
  • 3c7daf49f3 Add HF token to env when spawing via ui Jaret Burkett 2025-02-23 14:52:12 -07:00
  • 56d8d6bd81 Capture speed from the timer for the ui Jaret Burkett 2025-02-23 14:38:46 -07:00
  • 3e49337a58 Set step to the last step saved at when exiting Jaret Burkett 2025-02-23 13:21:22 -07:00
  • 60f848a877 Send more data when loading the model to the ui Jaret Burkett 2025-02-23 12:49:54 -07:00
  • b366e46f1c Added more settings to the training config Jaret Burkett 2025-02-23 12:34:52 -07:00
  • a280f78c69 Added checkpoint downloader Jaret Burkett 2025-02-22 16:48:15 -07:00
  • 6e19e7449e Fixed some issues with gpu info refreshing Jaret Burkett 2025-02-22 14:14:23 -07:00
  • a6d46ad9ae Cleanup of job page Jaret Burkett 2025-02-22 13:54:06 -07:00
  • f3725578dd Cleaned up dashboard Jaret Burkett 2025-02-22 13:23:26 -07:00
  • ed99c3c0c8 Moved gpu to its own widget Jaret Burkett 2025-02-22 12:43:20 -07:00
  • ed84c19205 Moved the job action bar to a shred component Jaret Burkett 2025-02-22 12:20:14 -07:00
  • a7a9c11d9e Fixed add image dropbox Jaret Burkett 2025-02-22 11:59:21 -07:00
  • f60698d0ee Fixed some bugs with ui and lock job name to prevent issues with continuing training. Jaret Burkett 2025-02-22 11:49:36 -07:00
  • 5f094fb17a Added controls to the jobs table Jaret Burkett 2025-02-22 10:57:53 -07:00
  • a5227cba7b Switched to a universal table library Jaret Burkett 2025-02-22 09:59:17 -07:00
  • 77a5e01301 Added proper icon Jaret Burkett 2025-02-22 09:05:55 -07:00
  • 4ef5a668c0 Make left arrow browsing only hit last image max Jaret Burkett 2025-02-21 22:04:53 -07:00
  • f081d14527 Preview samples full screen and use arrow keys to navigate them Jaret Burkett 2025-02-21 21:52:24 -07:00
  • 710c6de1c9 Samples work in ui now Jaret Burkett 2025-02-21 20:28:52 -07:00
  • 2b6e66e0cb Mor ui work Jaret Burkett 2025-02-21 12:40:17 -07:00
  • ab641e014f Added funding github stuff Jaret Burkett 2025-02-21 17:13:36 +00:00
  • ad87f72384 Start, stop, monitor jobs from ui working. Jaret Burkett 2025-02-21 09:49:28 -07:00
  • d0214c0df9 Make ui more uniform Jaret Burkett 2025-02-21 06:18:27 -07:00
  • adcf884c0f Built out the ui trainer plugin with db comminication Jaret Burkett 2025-02-21 05:53:35 -07:00
  • f778d979b5 Saving captions is working Jaret Burkett 2025-02-20 16:17:00 -07:00
  • db3ccbba33 Handle image deletion Jaret Burkett 2025-02-20 15:58:10 -07:00
  • 0d2be18a9b Delete datasets Jaret Burkett 2025-02-20 14:49:03 -07:00
  • bbc340e545 Cleanup and add hooks Jaret Burkett 2025-02-20 13:38:58 -07:00
  • 33fdfd6091 Added beginning or lokr Jaret Burkett 2025-02-20 12:47:42 -07:00
  • 9f6030620f Dataset uploads working Jaret Burkett 2025-02-20 12:47:01 -07:00
  • b5252b5028 More ui work Jaret Burkett 2025-02-20 11:19:01 -07:00
  • b0d8fc220d More ui more ui Jaret Burkett 2025-02-19 20:54:02 -07:00
  • cef7d9e594 Config ui section is coming along Jaret Burkett 2025-02-19 07:52:24 -07:00
  • b13fcc1039 Setup a very basic ui Jaret Burkett 2025-02-18 10:57:14 -07:00
  • b32d7e552b Shamelessly beg for money Jaret Burkett 2025-02-18 05:15:29 -07:00
  • 4af6c5cf30 Work on supporting flex.2 potential arch Jaret Burkett 2025-02-17 14:10:25 -07:00
  • 1f7784510d WIP Flex 2 pipeline Jaret Burkett 2025-02-16 14:54:29 -07:00
  • 87e557cf1e Bug fixes and improvements to llmadapter Jaret Burkett 2025-02-15 07:18:07 -07:00
  • bd8d7dc081 fixed various issues with llm attention masking. Added block training on the llm adapter. Jaret Burkett 2025-02-14 11:24:01 -07:00
  • 2be6926398 Added back syustem prompt for llm and remove those tokens from the embeddings Jaret Burkett 2025-02-14 07:23:37 -07:00
  • 87ac031859 Remove system prompt, shouldnt be necessary fo rhow it works. Jaret Burkett 2025-02-13 08:42:48 -07:00
  • 7679105d52 Added llm text encoder adapter Jaret Burkett 2025-02-13 08:28:32 -07:00
  • 2622de1e01 DFE tweaks. Adding support for more llms as text encoders Jaret Burkett 2025-02-13 04:31:49 -07:00
  • 8450aca10e Fixed missed merge conflice and locked diffusers version Jaret Burkett 2025-02-12 09:40:02 -07:00
  • 0b8a32def7 merged in lumina2 branch Jaret Burkett 2025-02-12 09:33:03 -07:00
  • 787bb37e76 Small fixed for DFE, polar guidance, and other things Jaret Burkett 2025-02-12 09:27:44 -07:00
  • 10aa7e9d5e Fixed some breaking changes with diffusers gradient checkpointing. Jaret Burkett 2025-02-10 09:35:31 -07:00
  • ed1deb71c4 Added examples for training lumina2 lumina2 Jaret Burkett 2025-02-08 16:13:18 -07:00
  • 4de6a825fa Update lumina requirements Jaret Burkett 2025-02-08 15:16:35 -07:00
  • 9a7266275d Wokr on lumina2 Jaret Burkett 2025-02-08 14:52:39 -07:00
  • d138f07365 Imitial lumina3 support Jaret Burkett 2025-02-08 10:59:53 -07:00
  • c6d8eedb94 Added ability to use consistent noise for each image in a dataset by hashing the path and using that as a seed. Jaret Burkett 2025-02-08 07:13:48 -07:00
  • af5e760be1 Merge pull request #249 from ostris/accelerate-multi-gpu Jaret Burkett 2025-02-08 07:11:10 -07:00
  • ff3d54bb5b Make the mean of the mask multiplier be 1.0 for a more balanced loss. Jaret Burkett 2025-02-06 10:57:06 +00:00
  • 0e75724b4d Lock version of diffusers Jaret Burkett 2025-02-05 18:14:59 +00:00
  • 376bb1bf6f Lock torch version due to breaking changes Jaret Burkett 2025-02-04 23:00:57 +00:00
  • 216ab164ce Experimental features and bug fixes Jaret Burkett 2025-02-04 13:36:34 -07:00
  • e6180d1e1d Bug fixes Jaret Burkett 2025-01-31 13:23:01 -07:00
  • 15a57bc89f Add new version of DFE. Kitchen sink Jaret Burkett 2025-01-31 11:42:27 -07:00
  • e5355bf8d5 Added train catch to the blank network Jaret Burkett 2025-01-30 16:15:45 +00:00
  • 34a1c6947a Added flux_shift as timestep type Jaret Burkett 2025-01-27 07:35:00 -07:00
  • 2141c6e06c Merge remote-tracking branch 'origin/main' into accelerate-multi-gpu Jaret Burkett 2025-01-26 11:19:34 -07:00
  • 1188cf1e8a Adjust flux sample sampler to handle some new breaking changes in diffusers. Jaret Burkett 2025-01-26 18:09:21 +00:00
  • 5e663746b8 Working multi gpu training. Still need a lot of tweaks and testing. Jaret Burkett 2025-01-25 16:46:20 -07:00
  • 441474e81f Added a flag to lora extraction script to do a full transformer extraction. Jaret Burkett 2025-01-24 09:34:13 -07:00
  • a6a690f796 Update full fine tune example to only train transformer blocks. Jaret Burkett 2025-01-24 09:28:34 -07:00
  • 6191f19e55 Added script to convert diffusers model to ComfyUI variant Jaret Burkett 2025-01-23 21:30:23 -07:00
  • bbfba0c188 Added v2 of dfp Jaret Burkett 2025-01-22 16:32:13 -07:00
  • e1549ad54d Update dfe model arch Jaret Burkett 2025-01-22 10:37:23 -07:00
  • 04abe57c76 Added weighing to DFE Jaret Burkett 2025-01-22 08:50:57 -07:00
  • 89dd041b97 Added ability to pair samples with a closer noise with optimal_noise_pairing_samples Jaret Burkett 2025-01-21 18:30:10 -07:00
  • 29122b1a54 Added code to handle diffusion feature extraction loss Jaret Burkett 2025-01-21 14:21:34 -07:00
  • 6a8e3d8610 Added a config file for full finetuning flex. Added a lora extraction script for flex Jaret Burkett 2025-01-20 10:09:01 -07:00
  • 4c8a9e1b88 Added example config to train Flex Jaret Burkett 2025-01-18 18:03:20 -07:00
  • fadb2f3a76 Allow quantizing the te independently on flux. added lognorm_blend timestep schedule Jaret Burkett 2025-01-18 18:02:31 -07:00
  • 4723f23c0d Added ability to split up flux across gpus (experimental). Changed the way timestep scheduling works to prep for more specific schedules. Jaret Burkett 2024-12-31 07:06:55 -07:00
  • 8ef07a9c36 Added training for an experimental decoratgor embedding. Allow for turning off guidance embedding on flux (for unreleased model). Various bug fixes and modifications Jaret Burkett 2024-12-15 08:59:27 -07:00
  • 92ce93140e Adjustments to defaults for automagic Jaret Burkett 2024-11-29 10:28:06 -07:00
  • f213996aa5 Fixed saving and displaying for automagic Jaret Burkett 2024-11-29 08:00:22 -07:00
  • cbe31eaf0a Initial work on a auto adjusting optimizer Jaret Burkett 2024-11-29 04:48:58 -07:00
  • 67c2e44edb Added support for training flux redux adapters Jaret Burkett 2024-11-21 20:01:52 -07:00
  • 96d418bb95 Added support for full finetuning flux with randomized param activation. Examples coming soon Jaret Burkett 2024-11-21 13:05:32 -07:00
  • 894374b2e9 Various bug fixes and optimizations for quantized training. Added untested custom adam8bit optimizer. Did some work on LoRM (dont use) Jaret Burkett 2024-11-20 09:16:55 -07:00
  • 6509ba4484 Fix seed generation to make it deterministic so it is consistant from gpu to gpu Jaret Burkett 2024-11-15 12:11:13 -07:00
  • 025ee3dd3d Added ability for adafactor to fully fine tune quantized model. Jaret Burkett 2024-10-30 16:38:07 -06:00
  • 58f9d01c2b Added adafactor implementation that handles stochastic rounding of update and accumulation Jaret Burkett 2024-10-30 05:25:57 -06:00
  • e72b59a8e9 Added experimental 8bit version of prodigy with stochastic rounding and stochastic gradient accumulation. Still testing. Jaret Burkett 2024-10-29 14:28:28 -06:00