4 Commits

Author	SHA1	Message	Date
Aviral Goel	de6466481f	chore(copyright): update copyright header for include directory (#3293)	2025-11-26 11:00:05 -07:00
ruanjm	04dd314883	[CK_TILE] Add Various Fusion Functions to RMSNorm (#1802) ... * Add shortcut to RMSNorm * Modify test for adding shortcut for RMSNorm * Add fused parameter into tests * 1. Add YDataType. 2. rmsnorm2d_fwd_traits_ from rmsnorm2d_fwd.hpp to rmsnorm2d_fwd_api.cpp and rmsnorm2d_fwd_instance_common.hpp * 1. Supports various stride and percisions. * Add support of Epilogue * Add fuse and epilogue support to rmsnorm ref * Modify rmsnorm example * Refactor tests/examples * Bug fix for newly added tests/examples * Bug fix for new tests 2 * Modify smoke test scripts remove dbg code * Supports non-smooth dyanmic quant * Update Rmsnorm2dFwd::GetName() * rename xscale and prec_sx to smoothscale and prec_sm Bug fix after rename Remove files * change example_rmsnorm2d_fwd.cpp * update performance calculator * Fix issue in two-pass when fuse add is enabled * Remove comment of beta --------- Co-authored-by: rocking <ChunYu.Lai@amd.com>	2025-01-15 10:23:48 +08:00
carlushuang	cb6c5d39dc	[CK_TILE] layernorm have more accurate residual (#1623) ... * more accurate residual * modify comment * Fix literal case in README.md --------- Co-authored-by: Po Yen Chen <PoYen.Chen@amd.com>	2024-11-02 13:30:16 +08:00
carlushuang	c3a4800c5f	[CK_TILE] layernorm support fused-quant/fused-add (#1604) ... * add prenorm/postnorm support, refactor using generate.py * update README * update README * fix format * update some description and fix format * update format * format * use non-raw for loading * format and update n4096 * dynamic-quant ready * update readme * support fused dynamic-quant * update fused-quant, with smooth * update README * update args * update some based on comment	2024-10-31 14:54:53 +08:00