OscarXu
9fdfff82ea
Fix v2 topk_weight cal. Add silu asm.
2025-05-20 13:42:06 +08:00
OscarXu
f87973a4ac
Merge remote-tracking branch 'origin/moe_bs_stage1_dev' into moe_merge_v3_bs_for_aiter
2025-05-19 19:34:42 +08:00
OscarXu
a4ed178b4c
Add gemm2 v3 64x128x128
2025-05-19 19:33:04 +08:00
OscarXu
215ddb0be0
Merge remote-tracking branch 'origin/moe_bs_stage1_dev' into moe_merge_v3_bs_for_aiter
2025-05-17 04:35:43 -05:00
OscarXu
9c9bf1aece
Moe blockscale gemm1&gemm2 asm support for aiter. Suppression cmkae flag til new compler.
2025-05-17 04:33:52 -05:00
OscarXu
e4516b71c9
Merge branch 'moe_bs_stage1_dev' into moe_merge_v3_bs_for_aiter
2025-05-17 00:43:46 -05:00
OscarXu
98606fad94
Merge remote-tracking branch 'origin/wjx/moe_v3_aiter' into moe_bs_stage1_dev
2025-05-14 20:48:42 -05:00
OscarXu
c84ad83905
v1 fix for mi350.
2025-05-14 08:05:17 -05:00
valarLip
5f81710346
fix blockscale gemm bug
2025-05-14 08:23:49 +00:00
OscarXu
9ecbcce2e9
Merge remote-tracking branch 'origin/wjx/moe_v3_aiter' into moe_merge_v3_bs_for_aiter
2025-05-14 15:05:08 +08:00
OscarXu
b2c0c3cfeb
gemm1 v3 64x128x128 debug
2025-05-14 10:07:11 +08:00
OscarXu
50590b8f17
Add gemm1 v1 32x128x128
2025-05-13 16:46:51 +08:00
valarLip
eaebefb278
update moe v1 pipeline
2025-05-13 08:42:49 +00:00
OscarXu
9ead312164
Gemm1 GUFusion function pass. Perf WIP
2025-05-13 15:32:39 +08:00
OscarXu
19aa39b978
Merge remote-tracking branch 'origin/wjx/moe_v3_aiter' into moe_bs_stage1_dev
2025-05-13 10:46:40 +08:00
OscarXu
f392874e3d
revert unexpected file change
2025-05-13 09:55:33 +08:00
OscarXu
fe8bb251da
gemm1 up-only pass. GU WIP
2025-05-12 21:08:42 +08:00
OscarXu
0a845c0b7d
Merge remote-tracking branch 'origin/moe_blockscale_dev_gfx950' into moe_merge_v3_bs_for_aiter. Manual fix for thread_group_tensor_slice_transfer_v7r3_scatter
2025-05-12 19:25:39 +08:00
valarLip
3ea573acd6
update moe
2025-05-12 08:10:50 +00:00
valarLip
037a5ff76c
update moe
2025-05-12 06:36:23 +00:00
OscarXu
f1a534f6e7
Compile pass. Gemm1 function WIP
2025-05-12 13:20:16 +08:00
lalala-sh
d9ab2fe4f5
update moe
2025-05-12 05:08:58 +00:00
OscarXu
3e5005a47b
fix compile error. Gemm2 pass. Gemm1 WIP
2025-05-12 11:21:14 +08:00
OscarXu
7729fdb349
temp save for gemm1. Function not ready
2025-05-12 09:32:58 +08:00
Bartłomiej Kocot
6fddb5708c
Add grouped conv fwd bias relu instances ( #2179 )
...
* Add grouped conv fwd bias relu instances
* fixes
* fix
2025-05-09 22:52:34 +02:00
jefyang1
6b1a339b6f
Fix grouped conv bwd data tests on gfx950 ( #2173 )
2025-05-09 09:01:06 -07:00
OscarXu
03d5a50b45
Merge remote-tracking branch 'origin/wjx/align_v3_pipeline' into moe_bs_stage1_dev
2025-05-09 20:15:11 +08:00
Andriy Roshchenko
cb27e7c77f
Ensure MX GEMM Instances can be Cross-Compiled for Multiple Architectures ( #2171 )
...
* Re-enable MX GEMM instances
* Fix compilation error when building MX GEMM for multiple architectures
2025-05-08 13:26:03 -06:00
lalala-sh
6c459e8c38
Merge branch 'develop' into wjx/align_v3_pipeline
2025-05-08 18:08:31 +08:00
lalala-sh
def952a178
use mem_op::set when topk=1
2025-05-08 09:49:16 +00:00
lalala-sh
960b2bce1c
update
2025-05-08 09:48:23 +00:00
OscarXu
586c2a9a15
Merge remote-tracking branch 'origin/f8blk_scale_opt' into moe_blockscale_dev
2025-05-08 16:39:08 +08:00
aska-0096
68c7fe843d
temp save, a performant version.
2025-05-08 07:44:06 +00:00
OscarXu
62877fa074
16x16 function merged to moe
2025-05-08 14:33:31 +08:00
OscarXu
8021128572
merge origin/f8blk_scale_opt
2025-05-07 17:10:03 +08:00
OscarXu
1fae385575
add warmup to asm launch
2025-05-07 16:55:42 +08:00
OscarXu
c989bbe3aa
Update v1_128x128x128 to 2x2 instead of 4x1
2025-05-07 14:24:30 +08:00
lalala-sh
0ab978584d
fix bugs
2025-05-06 07:36:59 +00:00
OscarXu
e7fe8587f6
Add asm for no-loop v3_128x128x128
2025-05-06 10:47:29 +08:00
aska-0096
8c40f3d8fd
experimental optimization for scale load in blkscale gemm
2025-05-02 07:12:01 +00:00
Andriy Roshchenko
79b0bfeb41
MX GEMM - Add FP8 GEMM Tests for Different Layouts ( #2152 )
...
* Add gemm_mx_fp8_bf8 example with row-major B
* Add more overloads of MX MFMA instructions
* Add MK_KN (RRR) tests
* Add KM_NK (CCR) tests
* Add more problem sizes to Large tests
* Add test_gemm_mx to the list of regression tests
2025-05-01 11:55:48 -06:00
OscarXu
efbb85be2a
Add .co direct asm support by CK_USE_ASM_MOE_STAGE2_BLOCKSCALE
2025-04-30 22:05:54 +08:00
mtgu0705
fe1648f0ce
fix device kernel selection.
2025-04-30 13:33:31 +08:00
lalala-sh
9c06c3817a
[fix] align v3 gufusion pipeline
2025-04-30 02:27:39 +00:00
lalala-sh
b8427b812e
align v3 gufusion pipeline
2025-04-30 01:35:49 +00:00
OscarXu
7024136ca1
Fix no-mainloop scenario
2025-04-29 16:09:49 +08:00
Bartłomiej Kocot
4094ad158a
Integrate universal gemm with conv bwd data and add SplitK ( #1315 )
...
* Integrate universal gemm with conv bwd data
* Fix multi d kernel
* Add splitK support
* instances refactor
* instances refactor
* refactor
* fixeS
* fixes
* 16x16 instnaces
* Fixes
* Fix
* Fix
* Fix
* Fix
* Fix
* Fixes
* fix
* fix
2025-04-28 23:54:49 +02:00
aska-0096
240817cd49
blockscale preshuffle, pipeline optimized, compiler issue
2025-04-28 10:20:23 +00:00
OscarXu
f3fedde7e6
Fix int overflow casued by large B matrix
2025-04-28 15:55:10 +08:00
Anton Gorenko
edd92fc546
DeviceGemm_Wmma_CShuffleV3 with BlockGemmPipelineVersion::v3 ( #2096 )
...
* Prepare files for DeviceGemm_Wmma_CShuffleV3
* Implement main part of CShuffleV3 with block pipeline v3 for WMMA
* Remove unused functions and template params for A/B descriptors
* Support both gfx11 and gfx12
* Enable SplitK for gfx12 and disable for gfx11
* Added RowColRow layout for DeviceGemmV2 fp16
* Added more instances for Row, Col, Row data layout
* Added instances for DeviceGemm_Wmma_CShuffleV3, Col, Row, Row data layout
* Added instances for DeviceGemm_Wmma_CShuffleV3, Col, Col, Row data layout
* Added more instances for DeviceGemm_Wmma_CShuffleV3, Row, Row, Row data layout
* Fix formatting
* Add documentation
Based on e5ad48a784anca@streamhpc.com >
2025-04-28 10:14:21 +05:00
