ROCm/composable_kernel
1
0
Fork 0
mirror of https://github.com/ROCm/composable_kernel.git synced 2026-07-01 04:07:56 +00:00
Code Issues Packages Projects Releases Wiki Activity
2,001 Commits 776 Branches 40 Tags
9fdfff82ea61229f99e35fa28ccaeb5cdc20366c
Commit Graph

680 Commits

Author SHA1 Message Date
OscarXu
9fdfff82ea Fix v2 topk_weight cal. Add silu asm. 2025-05-20 13:42:06 +08:00
OscarXu
f87973a4ac Merge remote-tracking branch 'origin/moe_bs_stage1_dev' into moe_merge_v3_bs_for_aiter 2025-05-19 19:34:42 +08:00
OscarXu
a4ed178b4c Add gemm2 v3 64x128x128 2025-05-19 19:33:04 +08:00
OscarXu
215ddb0be0 Merge remote-tracking branch 'origin/moe_bs_stage1_dev' into moe_merge_v3_bs_for_aiter 2025-05-17 04:35:43 -05:00
OscarXu
9c9bf1aece Moe blockscale gemm1&gemm2 asm support for aiter. Suppression cmkae flag til new compler. 2025-05-17 04:33:52 -05:00
OscarXu
e4516b71c9 Merge branch 'moe_bs_stage1_dev' into moe_merge_v3_bs_for_aiter 2025-05-17 00:43:46 -05:00
OscarXu
98606fad94 Merge remote-tracking branch 'origin/wjx/moe_v3_aiter' into moe_bs_stage1_dev 2025-05-14 20:48:42 -05:00
OscarXu
c84ad83905 v1 fix for mi350. 2025-05-14 08:05:17 -05:00
valarLip
5f81710346 fix blockscale gemm bug 2025-05-14 08:23:49 +00:00
OscarXu
9ecbcce2e9 Merge remote-tracking branch 'origin/wjx/moe_v3_aiter' into moe_merge_v3_bs_for_aiter 2025-05-14 15:05:08 +08:00
OscarXu
b2c0c3cfeb gemm1 v3 64x128x128 debug 2025-05-14 10:07:11 +08:00
OscarXu
50590b8f17 Add gemm1 v1 32x128x128 2025-05-13 16:46:51 +08:00
valarLip
eaebefb278 update moe v1 pipeline 2025-05-13 08:42:49 +00:00
OscarXu
9ead312164 Gemm1 GUFusion function pass. Perf WIP 2025-05-13 15:32:39 +08:00
OscarXu
19aa39b978 Merge remote-tracking branch 'origin/wjx/moe_v3_aiter' into moe_bs_stage1_dev 2025-05-13 10:46:40 +08:00
OscarXu
f392874e3d revert unexpected file change 2025-05-13 09:55:33 +08:00
OscarXu
fe8bb251da gemm1 up-only pass. GU WIP 2025-05-12 21:08:42 +08:00
OscarXu
0a845c0b7d Merge remote-tracking branch 'origin/moe_blockscale_dev_gfx950' into moe_merge_v3_bs_for_aiter. Manual fix for thread_group_tensor_slice_transfer_v7r3_scatter 2025-05-12 19:25:39 +08:00
valarLip
3ea573acd6 update moe 2025-05-12 08:10:50 +00:00
valarLip
037a5ff76c update moe 2025-05-12 06:36:23 +00:00
OscarXu
f1a534f6e7 Compile pass. Gemm1 function WIP 2025-05-12 13:20:16 +08:00
lalala-sh
d9ab2fe4f5 update moe 2025-05-12 05:08:58 +00:00
OscarXu
3e5005a47b fix compile error. Gemm2 pass. Gemm1 WIP 2025-05-12 11:21:14 +08:00
OscarXu
7729fdb349 temp save for gemm1. Function not ready 2025-05-12 09:32:58 +08:00
Bartłomiej Kocot
6fddb5708c Add grouped conv fwd bias relu instances (#2179) 
* Add grouped conv fwd bias relu instances

* fixes

* fix
 2025-05-09 22:52:34 +02:00
jefyang1
6b1a339b6f Fix grouped conv bwd data tests on gfx950 (#2173) 2025-05-09 09:01:06 -07:00
OscarXu
03d5a50b45 Merge remote-tracking branch 'origin/wjx/align_v3_pipeline' into moe_bs_stage1_dev 2025-05-09 20:15:11 +08:00
Andriy Roshchenko
cb27e7c77f Ensure MX GEMM Instances can be Cross-Compiled for Multiple Architectures (#2171) 
* Re-enable MX GEMM instances

* Fix compilation error when building MX GEMM for multiple architectures
 2025-05-08 13:26:03 -06:00
lalala-sh
6c459e8c38 Merge branch 'develop' into wjx/align_v3_pipeline 2025-05-08 18:08:31 +08:00
lalala-sh
def952a178 use mem_op::set when topk=1 2025-05-08 09:49:16 +00:00
lalala-sh
960b2bce1c update 2025-05-08 09:48:23 +00:00
OscarXu
586c2a9a15 Merge remote-tracking branch 'origin/f8blk_scale_opt' into moe_blockscale_dev 2025-05-08 16:39:08 +08:00
aska-0096
68c7fe843d temp save, a performant version. 2025-05-08 07:44:06 +00:00
OscarXu
62877fa074 16x16 function merged to moe 2025-05-08 14:33:31 +08:00
OscarXu
8021128572 merge origin/f8blk_scale_opt 2025-05-07 17:10:03 +08:00
OscarXu
1fae385575 add warmup to asm launch 2025-05-07 16:55:42 +08:00
OscarXu
c989bbe3aa Update v1_128x128x128 to 2x2 instead of 4x1 2025-05-07 14:24:30 +08:00
Rostyslav Geyyer
8a0d659f92 Add FP4 MX MFMA tests (#2151) 
* Add conversion tests

* Fix ctor

* Fix nan logic

* Fix conversion logic

* Permute packed f4_t values

* Fix conversion to float, repack vector elements

* Fix device tests

* Permute elements in a vector

* Add a repro test

* Add a conversion for a repro test

* Update test vectors

* Update conversion

* Fix the test

* Update test vector generator

* Fix vector sr conversion

* Permute conversion args

* Update conversion

* Test

* Fix packing

* Simplify conversion function

* Pack conversion in a loop

* Pack conversion in a loop

* Pack another conversion in a loop

* Pack one more conversion in a loop

* Pack the last conversion in a loop

* Clean up

* Add ops

* Add tests

* Add missing utils

* Update reference mx gemm

* Add f4x2 init mode

* Update host tensor utils

* Update chunk size for f4x2

* Add non scaled ops

* Add a type utility

* Update non scaled reference kernel

* Add non scaled tests

* Debug mfma arguments

* Add more debug info

* Update chunk size

* Update data layout

* Add more debugging

* Fix B stride

* Fix reference gemm

* Fix build

* One more reference fix

* Add more debug info

* Disable some tests

* Enable tests

* Add fp4 dimensions

* Update reference kernels

* Temp edits

* Remove leftovers

* Fix conflicts

* Clean up

* More clean up

* Revert "More clean up"

This reverts commit d8d35a0846.

* Add layouts to tests

---------

Co-authored-by: Andriy Roshchenko <107577548+andriy-ca@users.noreply.github.com>
 2025-05-06 09:24:00 -05:00
lalala-sh
0ab978584d fix bugs 2025-05-06 07:36:59 +00:00
OscarXu
e7fe8587f6 Add asm for no-loop v3_128x128x128 2025-05-06 10:47:29 +08:00
aska-0096
8c40f3d8fd experimental optimization for scale load in blkscale gemm 2025-05-02 07:12:01 +00:00
Andriy Roshchenko
79b0bfeb41 MX GEMM - Add FP8 GEMM Tests for Different Layouts (#2152) 
* Add gemm_mx_fp8_bf8 example with row-major B

* Add more overloads of MX MFMA instructions

* Add MK_KN (RRR) tests

* Add KM_NK (CCR) tests

* Add more problem sizes to Large tests

* Add test_gemm_mx to the list of regression tests
 2025-05-01 11:55:48 -06:00
OscarXu
efbb85be2a Add .co direct asm support by CK_USE_ASM_MOE_STAGE2_BLOCKSCALE 2025-04-30 22:05:54 +08:00
mtgu0705
fe1648f0ce fix device kernel selection. 2025-04-30 13:33:31 +08:00
lalala-sh
9c06c3817a [fix] align v3 gufusion pipeline 2025-04-30 02:27:39 +00:00
lalala-sh
b8427b812e align v3 gufusion pipeline 2025-04-30 01:35:49 +00:00
OscarXu
7024136ca1 Fix no-mainloop scenario 2025-04-29 16:09:49 +08:00
Bartłomiej Kocot
4094ad158a Integrate universal gemm with conv bwd data and add SplitK (#1315) 
* Integrate universal gemm with conv bwd data

* Fix multi d kernel

* Add splitK support

* instances refactor

* instances refactor

* refactor

* fixeS

* fixes

* 16x16 instnaces

* Fixes

* Fix

* Fix

* Fix

* Fix

* Fix

* Fixes

* fix

* fix
 2025-04-28 23:54:49 +02:00
aska-0096
240817cd49 blockscale preshuffle, pipeline optimized, compiler issue 2025-04-28 10:20:23 +00:00
OscarXu
f3fedde7e6 Fix int overflow casued by large B matrix 2025-04-28 15:55:10 +08:00