Jaret Burkett
|
33fdfd6091
|
Added beginning or lokr
|
2025-02-20 12:47:42 -07:00 |
|
Jaret Burkett
|
4af6c5cf30
|
Work on supporting flex.2 potential arch
|
2025-02-17 14:10:25 -07:00 |
|
Jaret Burkett
|
1f7784510d
|
WIP Flex 2 pipeline
|
2025-02-16 14:54:29 -07:00 |
|
Jaret Burkett
|
87e557cf1e
|
Bug fixes and improvements to llmadapter
|
2025-02-15 07:18:07 -07:00 |
|
Jaret Burkett
|
bd8d7dc081
|
fixed various issues with llm attention masking. Added block training on the llm adapter.
|
2025-02-14 11:24:01 -07:00 |
|
Jaret Burkett
|
2be6926398
|
Added back syustem prompt for llm and remove those tokens from the embeddings
|
2025-02-14 07:23:37 -07:00 |
|
Jaret Burkett
|
87ac031859
|
Remove system prompt, shouldnt be necessary fo rhow it works.
|
2025-02-13 08:42:48 -07:00 |
|
Jaret Burkett
|
7679105d52
|
Added llm text encoder adapter
|
2025-02-13 08:28:32 -07:00 |
|
Jaret Burkett
|
2622de1e01
|
DFE tweaks. Adding support for more llms as text encoders
|
2025-02-13 04:31:49 -07:00 |
|
Jaret Burkett
|
0b8a32def7
|
merged in lumina2 branch
|
2025-02-12 09:33:03 -07:00 |
|
Jaret Burkett
|
787bb37e76
|
Small fixed for DFE, polar guidance, and other things
|
2025-02-12 09:27:44 -07:00 |
|
Jaret Burkett
|
9a7266275d
|
Wokr on lumina2
|
2025-02-08 14:52:39 -07:00 |
|
Jaret Burkett
|
d138f07365
|
Imitial lumina3 support
|
2025-02-08 10:59:53 -07:00 |
|
Jaret Burkett
|
216ab164ce
|
Experimental features and bug fixes
|
2025-02-04 13:36:34 -07:00 |
|
Jaret Burkett
|
15a57bc89f
|
Add new version of DFE. Kitchen sink
|
2025-01-31 11:42:27 -07:00 |
|
Jaret Burkett
|
bbfba0c188
|
Added v2 of dfp
|
2025-01-22 16:32:13 -07:00 |
|
Jaret Burkett
|
e1549ad54d
|
Update dfe model arch
|
2025-01-22 10:37:23 -07:00 |
|
Jaret Burkett
|
29122b1a54
|
Added code to handle diffusion feature extraction loss
|
2025-01-21 14:21:34 -07:00 |
|
Jaret Burkett
|
4723f23c0d
|
Added ability to split up flux across gpus (experimental). Changed the way timestep scheduling works to prep for more specific schedules.
|
2024-12-31 07:06:55 -07:00 |
|
Jaret Burkett
|
8ef07a9c36
|
Added training for an experimental decoratgor embedding. Allow for turning off guidance embedding on flux (for unreleased model). Various bug fixes and modifications
|
2024-12-15 08:59:27 -07:00 |
|
Jaret Burkett
|
67c2e44edb
|
Added support for training flux redux adapters
|
2024-11-21 20:01:52 -07:00 |
|
Jaret Burkett
|
96d418bb95
|
Added support for full finetuning flux with randomized param activation. Examples coming soon
|
2024-11-21 13:05:32 -07:00 |
|
Jaret Burkett
|
4747716867
|
Fixed issue with adapters not providing gradients with new grad activator
|
2024-10-29 14:22:10 -06:00 |
|
Jaret Burkett
|
e3ebd73610
|
Add a projection layer on vision direct when doing image embeds
|
2024-10-20 10:48:23 -06:00 |
|
Jaret Burkett
|
ce759ebd8c
|
Normalize the image embeddings on vd adapter forward
|
2024-10-12 15:09:48 +00:00 |
|
Jaret Burkett
|
3922981996
|
Added some additional experimental things to the vision direct encoder
|
2024-10-10 19:42:26 +00:00 |
|
Jaret Burkett
|
67e0aca750
|
Added ability to load clip pairs randomly from folder. Other small bug fixes
|
2024-10-03 10:03:49 -06:00 |
|
Jaret Burkett
|
f05224970f
|
Added Vision Languate Adapter usage for pixtral vd adapter
|
2024-09-29 19:39:56 -06:00 |
|
Jaret Burkett
|
b4f64de4c2
|
Quick patch to scope xformer imports until a better solution
|
2024-09-28 15:36:42 -06:00 |
|
Jaret Burkett
|
e4c82803e1
|
Handle random resizing for pixtral input on direct vision adapter
|
2024-09-28 14:53:38 -06:00 |
|
Jaret Burkett
|
a508caad1d
|
Change pixtral to crop based on number of pixels instead of largest dimension
|
2024-09-28 13:05:26 -06:00 |
|
Jaret Burkett
|
58537fc92b
|
Added initial direct vision pixtral support
|
2024-09-28 10:47:51 -06:00 |
|
Jaret Burkett
|
6b4034122f
|
REmove layers from direct vision resampler
|
2024-09-24 15:08:29 -06:00 |
|
Jaret Burkett
|
f85ad452c6
|
Added initial support for pixtral vision as a vision encoder.
|
2024-09-21 15:21:14 -06:00 |
|
Jaret Burkett
|
951e223481
|
Added support to disable single transformers in vision direct adapter
|
2024-09-11 08:54:51 -06:00 |
|
Jaret Burkett
|
fc34a69bec
|
Ignore guidance embed when full tuning flux. adjust block scaler to decat to 1.0. Add MLP resampler for reducing vision adapter tokens
|
2024-09-09 16:24:46 -06:00 |
|
Jaret Burkett
|
279ee65177
|
Remove block scaler
|
2024-09-06 08:28:17 -06:00 |
|
Jaret Burkett
|
3a1f464132
|
Added support for training vision direct weight adapters
|
2024-09-05 10:11:44 -06:00 |
|
Jaret Burkett
|
7d9ab22405
|
Rework ip adapter and vision direct adapters to apply to the single transformer blocks even though they are not cross attn.
|
2024-09-01 10:40:42 -06:00 |
|
Jaret Burkett
|
40f5c59da0
|
Fixes for training ilora on flux
|
2024-08-31 16:55:26 -06:00 |
|
Jaret Burkett
|
3843e0d148
|
Added support for vision direct adapter for flux
|
2024-08-26 16:27:28 -06:00 |
|
Jaret Burkett
|
a939cf3730
|
WIP - adding support for flux DoRA and ip adapter training
|
2024-08-22 04:36:39 -06:00 |
|
Jaret Burkett
|
6e92922c14
|
Add a mergable linear to the mid of ilora
|
2024-07-20 21:17:53 -06:00 |
|
Jaret Burkett
|
c51235c486
|
Fixed misnamed var
|
2024-07-20 23:00:20 +00:00 |
|
Jaret Burkett
|
c2c4e8cf34
|
Added ability to target parts of lora for ilora
|
2024-07-20 22:45:52 +00:00 |
|
Jaret Burkett
|
c2d5f712a3
|
Reworked ilora arch
|
2024-07-20 15:35:59 -06:00 |
|
Jaret Burkett
|
a2301cf28c
|
Amall bug fixes
|
2024-07-18 10:39:55 -06:00 |
|
Jaret Burkett
|
11e426fdf1
|
Various features and fixes. Too much brain fog to do a proper description
|
2024-07-18 07:34:14 -06:00 |
|
Jaret Burkett
|
58dffd43a8
|
Added caching to image sizes so we dont do it every time.
|
2024-07-15 19:07:41 -06:00 |
|
Jaret Burkett
|
e4558dff4b
|
Partial implementation for training auraflow.
|
2024-07-12 12:11:38 -06:00 |
|