OscarXu
dbf5378a08
gemm2 perf optimized without HotLoopScheduler. HotLoopScheduler WIP
2025-06-19 03:53:15 -05:00
OscarXu
e91c75aef3
Optimize moe_bs_fp8 gemm1 v1 pipeline. Perf of buf2lds is better than buf2gpr now.
2025-06-12 03:20:51 -05:00
OscarXu
79f47b4611
Add buf2lds moe_bs_fp8 support to gemm1 v3 and gemm2 v1/v3. Add result_all_zero check
2025-06-11 03:06:57 -05:00
OscarXu
2938b13fee
buf2lds moe_bs_fp8_gemm1 func pass
2025-06-09 03:16:35 -05:00
OscarXu
25c0e6e37e
fix type_convert fp32 to bf16
2025-06-06 01:34:43 -05:00
OscarXu
3e2f52ed6d
restore minimum_occupancy logic
2025-06-05 20:19:22 -05:00
OscarXu
63053f49ed
Fix moe blockscale gemm1 barrier 0x800 for new compiler
2025-05-29 23:11:40 -05:00
OscarXu
3fa9b53a27
remove type_convert debug msg
2025-05-29 22:34:51 -05:00
OscarXu
6be76c53b6
No asm ver. for merging moe blocksale fp8 into mainline
2025-05-29 03:38:56 -05:00
OscarXu
52d68c9529
flag and barrier fix for copmiler branch MainOpSelV3
2025-05-29 03:13:11 -05:00
OscarXu
653bc83f8a
Remove rocm6.3 workaround flags and macro
2025-05-28 21:05:21 -05:00
OscarXu
772debdf8f
Fix do_weight in gemm1. Fix cshuffle_datatype. Clang-format
2025-05-28 18:29:06 +08:00
OscarXu
fc9ef98e7b
Add gemm2 64x128x128 asm. Fix BF16 ref.
2025-05-21 16:57:57 +08:00
OscarXu
9fdfff82ea
Fix v2 topk_weight cal. Add silu asm.
2025-05-20 13:42:06 +08:00
OscarXu
f87973a4ac
Merge remote-tracking branch 'origin/moe_bs_stage1_dev' into moe_merge_v3_bs_for_aiter
2025-05-19 19:34:42 +08:00
OscarXu
a4ed178b4c
Add gemm2 v3 64x128x128
2025-05-19 19:33:04 +08:00
OscarXu
215ddb0be0
Merge remote-tracking branch 'origin/moe_bs_stage1_dev' into moe_merge_v3_bs_for_aiter
2025-05-17 04:35:43 -05:00
OscarXu
9c9bf1aece
Moe blockscale gemm1&gemm2 asm support for aiter. Suppression cmkae flag til new compler.
2025-05-17 04:33:52 -05:00
OscarXu
e4516b71c9
Merge branch 'moe_bs_stage1_dev' into moe_merge_v3_bs_for_aiter
2025-05-17 00:43:46 -05:00
OscarXu
98606fad94
Merge remote-tracking branch 'origin/wjx/moe_v3_aiter' into moe_bs_stage1_dev
2025-05-14 20:48:42 -05:00
OscarXu
c84ad83905
v1 fix for mi350.
2025-05-14 08:05:17 -05:00
valarLip
5f81710346
fix blockscale gemm bug
2025-05-14 08:23:49 +00:00
OscarXu
9ecbcce2e9
Merge remote-tracking branch 'origin/wjx/moe_v3_aiter' into moe_merge_v3_bs_for_aiter
2025-05-14 15:05:08 +08:00
OscarXu
b2c0c3cfeb
gemm1 v3 64x128x128 debug
2025-05-14 10:07:11 +08:00
OscarXu
50590b8f17
Add gemm1 v1 32x128x128
2025-05-13 16:46:51 +08:00
valarLip
eaebefb278
update moe v1 pipeline
2025-05-13 08:42:49 +00:00
OscarXu
9ead312164
Gemm1 GUFusion function pass. Perf WIP
2025-05-13 15:32:39 +08:00
OscarXu
19aa39b978
Merge remote-tracking branch 'origin/wjx/moe_v3_aiter' into moe_bs_stage1_dev
2025-05-13 10:46:40 +08:00
OscarXu
f392874e3d
revert unexpected file change
2025-05-13 09:55:33 +08:00
OscarXu
fe8bb251da
gemm1 up-only pass. GU WIP
2025-05-12 21:08:42 +08:00
OscarXu
0a845c0b7d
Merge remote-tracking branch 'origin/moe_blockscale_dev_gfx950' into moe_merge_v3_bs_for_aiter. Manual fix for thread_group_tensor_slice_transfer_v7r3_scatter
2025-05-12 19:25:39 +08:00
valarLip
3ea573acd6
update moe
2025-05-12 08:10:50 +00:00
valarLip
037a5ff76c
update moe
2025-05-12 06:36:23 +00:00
OscarXu
f1a534f6e7
Compile pass. Gemm1 function WIP
2025-05-12 13:20:16 +08:00
lalala-sh
d9ab2fe4f5
update moe
2025-05-12 05:08:58 +00:00
OscarXu
3e5005a47b
fix compile error. Gemm2 pass. Gemm1 WIP
2025-05-12 11:21:14 +08:00
OscarXu
7729fdb349
temp save for gemm1. Function not ready
2025-05-12 09:32:58 +08:00
Khushbu Agarwal
d8faf1c6a1
Support for swizzle and transpose for MFMA_16x16x32_F16/BF16 ( #2172 )
...
* Changes for updating tile distribution for shuffle and transpose
* Fixed swizzle and transpose, removed comments
* clang formatted
* Adding support for bf16 type
* Addressing review comments
2025-05-10 22:40:05 -07:00
Bartłomiej Kocot
6fddb5708c
Add grouped conv fwd bias relu instances ( #2179 )
...
* Add grouped conv fwd bias relu instances
* fixes
* fix
2025-05-09 22:52:34 +02:00
jefyang1
6b1a339b6f
Fix grouped conv bwd data tests on gfx950 ( #2173 )
2025-05-09 09:01:06 -07:00
OscarXu
03d5a50b45
Merge remote-tracking branch 'origin/wjx/align_v3_pipeline' into moe_bs_stage1_dev
2025-05-09 20:15:11 +08:00
Khushbu Agarwal
ef72a4b9bc
Disable SMFMA for gfx90a ( #2182 )
2025-05-09 00:18:07 -07:00
Andriy Roshchenko
cb27e7c77f
Ensure MX GEMM Instances can be Cross-Compiled for Multiple Architectures ( #2171 )
...
* Re-enable MX GEMM instances
* Fix compilation error when building MX GEMM for multiple architectures
2025-05-08 13:26:03 -06:00
lalala-sh
6c459e8c38
Merge branch 'develop' into wjx/align_v3_pipeline
2025-05-08 18:08:31 +08:00
lalala-sh
def952a178
use mem_op::set when topk=1
2025-05-08 09:49:16 +00:00
lalala-sh
960b2bce1c
update
2025-05-08 09:48:23 +00:00
OscarXu
586c2a9a15
Merge remote-tracking branch 'origin/f8blk_scale_opt' into moe_blockscale_dev
2025-05-08 16:39:08 +08:00
aska-0096
68c7fe843d
temp save, a performant version.
2025-05-08 07:44:06 +00:00
Thomas Ning
c757046d49
Revert "Disable the SMFMA instruction for gfx90a. ( #2174 )" ( #2175 )
...
This reverts commit a32d907771 .
2025-05-08 00:07:03 -07:00
OscarXu
62877fa074
16x16 function merged to moe
2025-05-08 14:33:31 +08:00