28 Commits

Author	SHA1	Message	Date
Jaret Burkett	f38de2a2fe	Add tipsv2 locally and fix gradient checkpointing for it	2026-05-10 14:47:44 -06:00
Jaret Burkett	a12ddd72a1	Change the velocity weight cap on dfe 9	2026-05-07 07:37:05 -06:00
Jaret Burkett	acc6a36214	Scale DFE 9 to a velocity equiv weight to match flow matching gradient strength. Probably need to rework all DFEs to do this as the math checks out.	2026-04-28 09:10:02 -06:00
Jaret Burkett	1fc4ad3979	Add sapiens2 as a diffusion feature extractor	2026-04-27 15:59:03 -06:00
Jaret Burkett	488878f354	Use hidden layers in the loss for DFE 7 and 8	2026-04-18 13:07:38 -06:00
Jaret Burkett	beb40ae29b	Add DFE8 with partial step	2026-04-17 17:40:16 -06:00
Jaret Burkett	233e292256	Added some experimental low step things for zeta	2026-04-13 09:37:34 -06:00
Jaret Burkett	f85bf065bf	Use pooler embeddings for DFE v6 with dino v3	2026-03-27 07:02:07 -06:00
Jaret Burkett	b04c64e0f8	Add a dino version of DFE	2026-03-04 08:20:37 -07:00
Jaret Burkett	3632656cda	make DFE work with more VAEs	2026-02-18 09:46:37 -07:00
Jaret Burkett	f74475161e	Add stepped loss type	2025-09-22 15:50:12 -06:00
Jaret Burkett	28728a1e92	Added experimental dfe 5	2025-09-21 10:48:52 -06:00
Jaret Burkett	3666b112a8	DEF for fake vae and adjust scaling	2025-09-12 18:09:08 -06:00
Jaret Burkett	1f541bc5d8	Changes to handle a different DFE arch	2025-08-27 11:05:16 -06:00
Jaret Burkett	8602470952	Updated diffusion feature extractor	2025-06-19 15:36:10 -06:00
Jaret Burkett	97e101522c	Increase ema feedback amount. Normalize the dfe 4 image embeds	2025-06-10 08:01:13 -06:00
Jaret Burkett	eefa93f16e	Various code to support experiments.	2025-06-09 11:19:21 -06:00
Jaret Burkett	b6d25fcd10	Improvements to vae trainer. Adjust denoise prediction of DFE v3	2025-05-30 12:06:47 -06:00
Jaret Burkett	d9700bdb99	Added initial support for f-lite model	2025-05-01 11:15:18 -06:00
Jaret Burkett	615b0d0e94	Added initial support for training i2v adapter WIP	2025-04-09 08:06:29 -06:00
Jaret Burkett	c083a0e5ea	Allow DFE to not have a VAE	2025-03-30 09:23:01 -06:00
Jaret Burkett	2622de1e01	DFE tweaks. Adding support for more llms as text encoders	2025-02-13 04:31:49 -07:00
Jaret Burkett	787bb37e76	Small fixed for DFE, polar guidance, and other things	2025-02-12 09:27:44 -07:00
Jaret Burkett	216ab164ce	Experimental features and bug fixes	2025-02-04 13:36:34 -07:00
Jaret Burkett	15a57bc89f	Add new version of DFE. Kitchen sink	2025-01-31 11:42:27 -07:00
Jaret Burkett	bbfba0c188	Added v2 of dfp	2025-01-22 16:32:13 -07:00
Jaret Burkett	e1549ad54d	Update dfe model arch	2025-01-22 10:37:23 -07:00
Jaret Burkett	29122b1a54	Added code to handle diffusion feature extraction loss	2025-01-21 14:21:34 -07:00