Jaret Burkett
|
0d8a33dc16
|
Offload ARA with the layer if doing layer offloading. Add support to offload the LoRA. Still needs optimizer support
|
2025-10-21 06:03:27 -06:00 |
|
Jaret Burkett
|
1f81bc4060
|
Fix issue where text encoder could be the wrong quantization and fail when using memory manager
|
2025-10-15 11:01:30 -06:00 |
|
Jaret Burkett
|
1bc6dee127
|
Change auto_memory to be layer_offloading and allow you to set the amount to unload
|
2025-10-10 13:12:32 -06:00 |
|
Jaret Burkett
|
4e5707854f
|
Initial support for RamTorch. Still a WIP
|
2025-10-05 13:03:26 -06:00 |
|
Jaret Burkett
|
3086a58e5b
|
git status
|
2025-10-01 14:12:17 -06:00 |
|
Jaret Burkett
|
3b1f7b0948
|
Allow user to set the attention backend. Add method to recomver from the occasional OOM if it is a rare event. Still exit if it ooms 3 times in a row.
|
2025-09-27 08:56:15 -06:00 |
|
Jaret Burkett
|
1069dee0e4
|
Added ui sopport for multi control samples and datasets. Added qwen image edit 5209 to the ui
|
2025-09-25 11:10:02 -06:00 |
|
Jaret Burkett
|
454be0958a
|
Initial support for qwen image edit plus
|
2025-09-24 11:39:10 -06:00 |
|
Jaret Burkett
|
3cdf50cbfc
|
Merge pull request #426 from squewel/prior_reg
Dataset-level prior regularization
|
2025-09-18 03:03:18 -06:00 |
|
max
|
e4ae97e790
|
add dataset-level distillation-style regularization
|
2025-09-18 01:11:19 +03:00 |
|
Jaret Burkett
|
218f673e3d
|
Added support for new concept slider training script to CLI and UI
|
2025-09-16 10:22:34 -06:00 |
|
Jaret Burkett
|
af6fdaaaf9
|
Add ability to train a full rank LoRA. (experimental)
|
2025-09-09 07:36:25 -06:00 |
|
Jaret Burkett
|
f699f4be5f
|
Add ability to set transparent color for control images
|
2025-09-02 11:08:44 -06:00 |
|
Jaret Burkett
|
85dcae6e2b
|
Set full size control images to default true
|
2025-09-02 10:30:42 -06:00 |
|
Jaret Burkett
|
7040d8d73b
|
Preperation for audio
|
2025-09-02 07:26:50 -06:00 |
|
Jaret Burkett
|
bf2700f7be
|
Initial support for finetuning qwen image. Will only work with caching for now, need to add controls everywhere.
|
2025-08-21 16:41:17 -06:00 |
|
Jaret Burkett
|
8ea2cf00f6
|
Added training to the ui. Still testing, but everything seems to be working.
|
2025-08-16 05:51:37 -06:00 |
|
Jaret Burkett
|
3413fa537f
|
Wan22 14b training is working, still need tons of testing and some bug fixes
|
2025-08-14 13:03:27 -06:00 |
|
Jaret Burkett
|
85bad57df3
|
Fix bug that would use EMA when set false
|
2025-08-13 11:39:40 -06:00 |
|
Jaret Burkett
|
77b10d884d
|
Add support for training with an accuracy recovery adapter with qwen image
|
2025-08-12 08:21:36 -06:00 |
|
Jaret Burkett
|
bb6db3d635
|
Added support for caching text embeddings. This is just initial support and will probably fail for some models. Still needs to be ompimized
|
2025-08-07 10:27:55 -06:00 |
|
Jaret Burkett
|
5d8922fca2
|
Add ability to designate a dataset as i2v or t2v for models that support it
|
2025-08-06 09:29:47 -06:00 |
|
Jaret Burkett
|
77dc38a574
|
Some work on caching text embeddings
|
2025-07-26 09:22:04 -06:00 |
|
Jaret Burkett
|
f500b9f240
|
Add ability to do more advanced sample prompt objects to prepart for a UI rework on control images and other things.
|
2025-07-17 07:13:35 -06:00 |
|
Jaret Burkett
|
60ef2f1df7
|
Added support for FLUX.1-Kontext-dev
|
2025-06-26 15:24:37 -06:00 |
|
Jaret Burkett
|
f3eb1dff42
|
Add a config flag to trigger fast image size db builder. Add config flag to set unconditional prompt for guidance loss
|
2025-06-24 08:51:29 -06:00 |
|
Jaret Burkett
|
ba1274d99e
|
Added a guidance burning loss. Modified DFE to work with new model. Bug fixes
|
2025-06-23 08:38:27 -06:00 |
|
Jaret Burkett
|
8602470952
|
Updated diffusion feature extractor
|
2025-06-19 15:36:10 -06:00 |
|
Jaret Burkett
|
fc83eb7691
|
WIP on mean flow loss. Still a WIP.
|
2025-06-12 08:00:51 -06:00 |
|
Jaret Burkett
|
eefa93f16e
|
Various code to support experiments.
|
2025-06-09 11:19:21 -06:00 |
|
Jaret Burkett
|
22cdfadab6
|
Added new timestep weighing strategy
|
2025-06-04 01:16:02 -06:00 |
|
Jaret Burkett
|
e5181d23cd
|
Added some experimental training techniques. Ignore for now. Still in testing.
|
2025-05-21 02:19:54 -06:00 |
|
Jaret Burkett
|
43cb5603ad
|
Added chroma model to the ui. Added logic to easily pull latest, use local, or use a specific version of chroma. Allow ustom name or path in the ui for custom models
|
2025-05-07 12:06:30 -06:00 |
|
Jaret Burkett
|
88b3fbae37
|
Various experiments and minor bug fixes for edge cases
|
2025-04-25 13:44:38 -06:00 |
|
Jaret Burkett
|
c12036df95
|
Added ability to use short captions from json caption file
|
2025-04-16 08:32:28 -06:00 |
|
Jaret Burkett
|
d8bdc03256
|
Allow full control of caption extensions
|
2025-04-10 07:42:04 -06:00 |
|
Jaret Burkett
|
96ba2fd129
|
Added methods to the dataloader to automatically generate controls for line, mask, inpainting, depth, and pose.
|
2025-04-09 13:35:04 -06:00 |
|
Jaret Burkett
|
615b0d0e94
|
Added initial support for training i2v adapter WIP
|
2025-04-09 08:06:29 -06:00 |
|
Jaret Burkett
|
a8680c75eb
|
Added initial support for finetuning wan i2v WIP
|
2025-04-07 20:34:38 -06:00 |
|
Jaret Burkett
|
860d892214
|
Pixel shuffle adapter. Some bug fixes thrown in
|
2025-03-29 21:15:01 -06:00 |
|
Jaret Burkett
|
5365200da1
|
Added ability to add models to finetune as plugins. Also added flux2 new arch via that method.
|
2025-03-27 16:07:00 -06:00 |
|
Jaret Burkett
|
ce4c5291a0
|
Added experimental wavelet loss
|
2025-03-26 18:11:23 -06:00 |
|
Jaret Burkett
|
6021a3dbc0
|
Change inpainting mask to zero out on latents instead of image for inpaint area.
|
2025-03-24 14:16:52 -06:00 |
|
Jaret Burkett
|
45be82d5d6
|
Handle inpainting training for control_lora adapter
|
2025-03-24 13:17:47 -06:00 |
|
Jaret Burkett
|
f10937e6da
|
Handle multi control inputs for control lora training
|
2025-03-23 07:37:08 -06:00 |
|
Jaret Burkett
|
f5aa4232fa
|
Added ability to quantize with torchao
|
2025-03-20 16:28:54 -06:00 |
|
Jaret Burkett
|
b829983b16
|
Added ability to load video datasets and train with them
|
2025-03-19 09:54:26 -06:00 |
|
Jaret Burkett
|
3812957bc9
|
Added ability to train control loras. Other important bug fixes thrown in
|
2025-03-14 18:03:00 -06:00 |
|
Jaret Burkett
|
386e68a422
|
Fixed a bug that changes all samples to webp
|
2025-03-08 18:02:56 -07:00 |
|
Jaret Burkett
|
391cf80fea
|
Added training for Wan2.1. Not finalized, wait.
|
2025-03-07 13:53:44 -07:00 |
|