11 Commits

Author	SHA1	Message	Date
Jaret Burkett	58537fc92b	Added initial direct vision pixtral support	2024-09-28 10:47:51 -06:00
Jaret Burkett	6b4034122f	REmove layers from direct vision resampler	2024-09-24 15:08:29 -06:00
Jaret Burkett	951e223481	Added support to disable single transformers in vision direct adapter	2024-09-11 08:54:51 -06:00
Jaret Burkett	fc34a69bec	Ignore guidance embed when full tuning flux. adjust block scaler to decat to 1.0. Add MLP resampler for reducing vision adapter tokens	2024-09-09 16:24:46 -06:00
Jaret Burkett	279ee65177	Remove block scaler	2024-09-06 08:28:17 -06:00
Jaret Burkett	3a1f464132	Added support for training vision direct weight adapters	2024-09-05 10:11:44 -06:00
Jaret Burkett	7d9ab22405	Rework ip adapter and vision direct adapters to apply to the single transformer blocks even though they are not cross attn.	2024-09-01 10:40:42 -06:00
Jaret Burkett	3843e0d148	Added support for vision direct adapter for flux	2024-08-26 16:27:28 -06:00
Jaret Burkett	d87b49882c	Work on embedding adapters	2024-03-11 15:18:42 -06:00
Jaret Burkett	2478554c95	Bug fixes. Added IP adapter training for Pixart	2024-02-17 10:06:57 -07:00
Jaret Burkett	4ec4025cbb	Added adapter modules for text encoders and direct vision	2024-02-12 08:46:18 -07:00