ROCm/composable_kernel
1
0
Fork 0
mirror of https://github.com/ROCm/composable_kernel.git synced 2026-07-07 23:57:14 +00:00
Code Issues Packages Projects Releases Wiki Activity
1,955 Commits 776 Branches 40 Tags
da5f962dfd120426e4c1fee0a1ae72dbe7bdb79e
Commit Graph

1955 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Anton Gorenko
da5f962dfd Support multiple D in GridwiseGemm_wmma_cshuffle_v3 
DeviceGemm_Wmma_CShuffleV3 is changed for new template parameters.
 2025-05-29 13:09:08 +05:00
Anton Gorenko
a6ea6040ad Add FP16 KM_NK and KM_KN test suites for XDL 
These tests were added to common .inc for better testing of WMMA instances
 2025-05-23 19:05:20 +05:00
Anton Gorenko
2679c0aa2b Disable all tests and instances with f8 on gfx11 
Even though f8_f16 and f16_f8 don't require f8 WMMA instructions,
gfx11 still lacks hardware instructions for fast f8->f32 conversion.
 2025-05-23 15:17:36 +05:00
Anton Gorenko
668914cd58 Add mixed precision examples 2025-05-23 10:53:42 +05:00
Anton Gorenko
c143bf30a5 Fix cache flushing for pk_i4 2025-05-23 10:53:42 +05:00
Anton Gorenko
9e70603bb5 Use PermuteB with f16_i4 in most instances (as xdl) 
Some instances use PermuteB = false for checking correctness.
See also the previous commit.
 2025-05-23 10:53:42 +05:00
Anton Gorenko
83b1419bb7 Fix a bug that fp16_i4 validation passes only with PermuteB 
A permutation required by conversion from pk_i4_t to half_t does not
depend on PermuteB, they can be used independently.
 2025-05-23 10:53:42 +05:00
Anton Gorenko
05ad2146f9 Add test_gemm_universal_xdl/wmma_fp16 to REGRESSION_TESTS 
They take more than 30 seconds
 2025-05-23 10:53:42 +05:00
Anton Gorenko
eac7d359e8 Add missing Regular tests 2025-05-23 10:53:42 +05:00
Anton Gorenko
dd7ac95aff Add test case for bf16_i4 2025-05-23 10:53:42 +05:00
Anton Gorenko
02bf56a6de Add missing add_device_gemm_wmma_universal_f8_f8_bf16 declarations 2025-05-23 10:53:42 +05:00
Anton Gorenko
b1f50b5ba7 Remove instances that are too slow (mostly because of register spilling) 2025-05-23 10:53:42 +05:00
Anton Gorenko
8b5d340d09 Fix segfault in profiler when B is pk_i4_t 
b_device_buf's size in bytes is larger than b_k_n_permute so b_device_buf.ToDevice reads out-of-bounds.
 2025-05-23 10:53:41 +05:00
Anton Gorenko
c7d39a075e Enable profiling of mixed precision with f8 and int4 on WMMA 2025-05-23 10:53:41 +05:00
Anton Gorenko
5082a9cd69 Add instances for Interwave and Intrawave v1 2025-05-23 10:53:41 +05:00
Anton Gorenko
342bb570bf Add a workaround for fp8/bf8->f32 packed conversion issue 2025-05-23 10:53:41 +05:00
Anton Gorenko
17bc0fa4c5 Remove instances that are too slow (mostly because of register spilling) 2025-05-23 10:53:41 +05:00
Anton Gorenko
04d3fc7b07 Add instances with ABlockLdsExtraM and BBlockLdsExtraN = 0 2025-05-23 10:53:41 +05:00
Anton Gorenko
c94c3b4716 Add instances for Interwave and Intrawave v1 2025-05-23 10:53:41 +05:00
Anton Gorenko
c414097e31 Implement Intrawave and Interwave variants of pipeline v1 2025-05-23 10:53:41 +05:00
Anton Gorenko
ede7126dc6 Clone BlockwiseGemmXdlops_pipeline_v1 for WMMA implementation 2025-05-23 10:53:40 +05:00
Anton Gorenko
af9e9eda8a Load in M/NRepeat dims with thread copy's slice instead of a loop 2025-05-23 10:53:40 +05:00
Anton Gorenko
cc818b4bc7 Fix strides of a/b_thread_desc 
The descriptors are larger than needed (even though the compiler don't alloc registers for unused values).
 2025-05-23 10:53:40 +05:00
apoorva
501d957152 Fixed the build errors. 2025-05-22 13:16:48 +05:00
apoorva
9d8f1e4c21 Fixed the gemm specialization error 2025-05-22 13:16:48 +05:00
apoorva
c016164040 Modified some code as per gemm_universal_examples 2025-05-22 13:16:48 +05:00
apoorva
b0aa9339e9 Fixed compilation failure. 2025-05-22 13:16:48 +05:00
apoorva
9cc5702e89 Fixing build erros 2025-05-22 13:16:48 +05:00
apoorva
4b5a9acc95 Fixing clang format 2025-05-22 13:16:48 +05:00
apoorva
840b79dfa3 Fixed review comments and added executable to cmakeLists 2025-05-22 13:16:48 +05:00
apoorva
8f8e631355 Added the missing parameters 2025-05-22 13:16:47 +05:00
apoorva
b35a19599c Adding examples for gemm_wmma instances 2025-05-22 13:16:47 +05:00
apoorva
621012cb86 example for gemm_universal_bf16 2025-05-22 13:16:47 +05:00
Anca Hamuraru
15bfa00312 Moved f16xi4 test under the correct data layout group 2025-05-20 14:42:09 +00:00
Anca Hamuraru
b1a9a27bf1 Merge branch '33-wip' of projects.streamhpc.com:amd/ai/composable_kernel into 33-wip 2025-05-20 13:47:26 +00:00
Anca Hamuraru
185ea0fdc4 Fix typo 2025-05-20 13:45:48 +00:00
Anca Hamuraru
ae21582a88 Updated the set of tests for FP16 2025-05-20 13:45:15 +00:00
Anca Hamuraru
b350bd212d Updated the set of tests for FP16 2025-05-20 13:16:48 +00:00
Anca Hamuraru
0a5e6d48ec Fixed typos 2025-05-20 13:16:12 +00:00
Anca Hamuraru
a08ca63b36 Padding not supported for when BDataType is pk_i4_t. Added fix for correct check and removed padding instances. 2025-05-20 13:14:07 +00:00
Anca Hamuraru
dc26ee3014 Added tests for fp16, KM_KN and KM_NK 2025-05-20 07:47:07 +00:00
Anca Hamuraru
7975c9cea6 Fixed typos for padded instances 2025-05-19 14:51:56 +00:00
Anca Hamuraru
a0a2bf27b1 Fixed typos for bf16xbf16xbf16 padding instances 2025-05-19 13:08:05 +00:00
Anca Hamuraru
bbda71f096 Added padding instances for f16xf8xf16, f16xi4xf16 2025-05-16 08:31:32 +00:00
Anca Hamuraru
e97a7f246d Added padding instances for f8xf16xf16 2025-05-15 11:31:50 +00:00
Anca Hamuraru
537d19c459 Added packed instances for bf16xi4xbf16 2025-05-15 10:36:50 +00:00
Anca Hamuraru
a3d99c696d Merge branch '32-add-the-remaining-combination-of-data-types-mixed-precision-for-gemm_universal-pipeline3-for' into '33-wip' 
Added mixed precision instances for gemm_universal

See merge request amd/ai/composable_kernel!11
 2025-05-15 06:53:55 +00:00
Anca Hamuraru
0482b83fe6 Added padding instances for bf16xbf16, f8xf8 2025-05-14 14:36:10 +00:00
Anca Hamuraru
e2855633ee Fixes for padding instances for f16xf16xf16 2025-05-14 10:50:34 +00:00
Anca Hamuraru
ab28ac0b81 Merge branch '33-wip' of projects.streamhpc.com:amd/ai/composable_kernel into 33-wip 2025-05-14 09:43:36 +00:00