5 Commits

Author	SHA1	Message	Date
ltqin	67f0b74ec6	Revert "Revert " Fp8 block scale quantization for fmha fwd (#3330)" (#3633)" (#3635) ... This reverts commit de5a1d730d. Co-authored-by: Illia Silin <98187287+illsilin@users.noreply.github.com>	2026-01-23 09:03:22 -08:00
Po Yen Chen	de5a1d730d	Revert " Fp8 block scale quantization for fmha fwd (#3330)" (#3633) ... This reverts commit dd0b4294af.	2026-01-22 21:21:19 -08:00
ltqin	dd0b4294af	Fp8 block scale quantization for fmha fwd (#3330) ... * add block scale parameters to kernel * add block scale to kernel * add smoke test * format * Revert "format" This reverts commit 356c3c9706. * only format my code * format py * fix auto not allowd in function prototype * change instance tttt to ttff * fix structured binding issue * change s_acc elementwise op * async pipeline add block scale * add quantation P using shift exp2 * precompute (m - shift) once per row * change blk scale seqstrt ptr name * fix some name * fix for deduction guide * fix some comments * add P scale to qr_ksvs_pipeline * add comment to idx_identity * change the method of calculating descale block index * unify naming style: use block_scale_ as name prefix * unify naming style * update the CHANGELOG.md * Add FP8 block scale quantization support for FMHA forward kernel --------- Co-authored-by: Illia Silin <98187287+illsilin@users.noreply.github.com> Co-authored-by: Po Yen Chen <PoYen.Chen@amd.com>	2026-01-21 20:58:26 -08:00
Aviral Goel	cd47293869	chore(copyright): update copyright header for experimental & example directory (#3292)	2025-11-26 03:09:39 +04:00
rocking	5948dbffe4	Support fp8 dynamic quantization for fmha (#3206) ... * Support qscale for dynamic quant, remove static quant * Support hdim=256 * Remove bias test case for fp8 --------- Co-authored-by: Illia Silin <98187287+illsilin@users.noreply.github.com> Co-authored-by: asleepzzz <hanwen.chang@amd.com>	2025-11-24 16:28:25 +08:00