5 Commits

Author	SHA1	Message	Date
Haocong WANG	3049b5467c	[GEMM] gemm_universal related optimization (#1453) ... * replace buffer_atomic with global_atomic * fixed global_atomic_add * added bf16 atomic_add * format * clang-format-12 * clean * clean * add guards * Update gtest.cmake * enabled splitk_gemm_multi_d * format * add ckProfiler * format * fixed naming * format * clean * clean * add guards * fix clang format * format * add kbatch printout * clean * Add rocm6.2 related gemm optimization * Limit bf16 atomic usage * remove redundant RCR gemm_universal instance * Add RRR fp8 gemm universal instance * Bug fix * Add GPU_TARGET guard to FP8/BF8 target * bug fix * update cmake * remove all fp8/bf8 example if arch not support * Enable fp8 RRR support in ckProfiler * limit greedy-reverse flag to gemm_universal in ckProfiler --------- Co-authored-by: Jing Zhang <jizhan@fb.com> Co-authored-by: Jing Zhang <jizhan@meta.com> Co-authored-by: zjing14 <zhangjing14@gmail.com> Co-authored-by: Illia Silin <98187287+illsilin@users.noreply.github.com> Co-authored-by: illsilin <Illia.Silin@amd.com>	2024-08-14 10:42:30 +08:00
Haocong WANG	8c90f25be3	[GEMM] F8 GEMM, performance optimized. (#1384) ... * add ab_scale init support * enabled interwave * add scale type; update isSupport * adjust example * clean * enable f8 pure gemm rcr ckprofiler * Add gemm_multiply_multiply instances * clang format * Optimize for ScaleBlockMNK=128 * enable abscale f8 gemm ck profiler * Add pure f8 gemm test suite * Reverting to the state of project at f60fd77 * update copyright * clang format * update copyright --------- Co-authored-by: root <jizhan@amd.com>	2024-07-19 22:06:52 +08:00
zjing14	13c1e64daa	add gemm_bias_add example (#1361) ... * add gemm_bias_add example * changed strideD * clang-format --------- Co-authored-by: Illia Silin <98187287+illsilin@users.noreply.github.com>	2024-07-11 18:08:07 -07:00
zjing14	6fb1f4e03f	Post-merge fix of PR 1300 (#1313) ... * add f8 gemm with multiD for both row/col wise * change compute_type to fp8 * changed tuning parameters in the example * add rcr example * post-merge fix * fix * reduce init range	2024-05-31 22:46:41 -07:00
zjing14	80db62f08d	add f8 gemm multiD with both row/col wise scale (#1300) ... * add f8 gemm with multiD for both row/col wise * change compute_type to fp8 * changed tuning parameters in the example * add rcr example	2024-05-28 12:04:22 -05:00