OscarXu
52d68c9529
flag and barrier fix for copmiler branch MainOpSelV3
2025-05-29 03:13:11 -05:00
OscarXu
653bc83f8a
Remove rocm6.3 workaround flags and macro
2025-05-28 21:05:21 -05:00
OscarXu
772debdf8f
Fix do_weight in gemm1. Fix cshuffle_datatype. Clang-format
2025-05-28 18:29:06 +08:00
OscarXu
fc9ef98e7b
Add gemm2 64x128x128 asm. Fix BF16 ref.
2025-05-21 16:57:57 +08:00
OscarXu
b146191da2
v2 tok_weight WIP
2025-05-20 16:34:07 +08:00
OscarXu
9fdfff82ea
Fix v2 topk_weight cal. Add silu asm.
2025-05-20 13:42:06 +08:00
OscarXu
f87973a4ac
Merge remote-tracking branch 'origin/moe_bs_stage1_dev' into moe_merge_v3_bs_for_aiter
2025-05-19 19:34:42 +08:00
OscarXu
a4ed178b4c
Add gemm2 v3 64x128x128
2025-05-19 19:33:04 +08:00
OscarXu
330173eb34
Merge remote-tracking branch 'origin/moe_bs_stage1_dev' into moe_merge_v3_bs_for_aiter
2025-05-19 19:12:37 +08:00
OscarXu
a92849c7b4
Add gemm2 v3 64x128x128
2025-05-19 19:08:15 +08:00
OscarXu
9aed1afb87
Merge remote-tracking branch 'origin/moe_bs_stage1_dev' into moe_merge_v3_bs_for_aiter
2025-05-19 14:02:34 +08:00
OscarXu
ce3cc1b967
Update gemm2 asm with latest compiler flag
2025-05-19 14:01:14 +08:00
OscarXu
81a1e1c7fb
Merge remote-tracking branch 'origin/moe_bs_stage1_dev' into moe_merge_v3_bs_for_aiter
2025-05-19 10:35:25 +08:00
OscarXu
3b94b389a9
Add gemm1 gfx942 .co support
2025-05-19 10:34:37 +08:00
OscarXu
215ddb0be0
Merge remote-tracking branch 'origin/moe_bs_stage1_dev' into moe_merge_v3_bs_for_aiter
2025-05-17 04:35:43 -05:00
OscarXu
9c9bf1aece
Moe blockscale gemm1&gemm2 asm support for aiter. Suppression cmkae flag til new compler.
2025-05-17 04:33:52 -05:00
OscarXu
19e43cb175
Cmakelist diable compiler-bound flags
2025-05-17 00:51:44 -05:00
OscarXu
e4516b71c9
Merge branch 'moe_bs_stage1_dev' into moe_merge_v3_bs_for_aiter
2025-05-17 00:43:46 -05:00
OscarXu
98606fad94
Merge remote-tracking branch 'origin/wjx/moe_v3_aiter' into moe_bs_stage1_dev
2025-05-14 20:48:42 -05:00
OscarXu
c84ad83905
v1 fix for mi350.
2025-05-14 08:05:17 -05:00
OscarXu
9ecbcce2e9
Merge remote-tracking branch 'origin/wjx/moe_v3_aiter' into moe_merge_v3_bs_for_aiter
2025-05-14 15:05:08 +08:00
OscarXu
b2c0c3cfeb
gemm1 v3 64x128x128 debug
2025-05-14 10:07:11 +08:00
OscarXu
50590b8f17
Add gemm1 v1 32x128x128
2025-05-13 16:46:51 +08:00
valarLip
eaebefb278
update moe v1 pipeline
2025-05-13 08:42:49 +00:00
OscarXu
9ead312164
Gemm1 GUFusion function pass. Perf WIP
2025-05-13 15:32:39 +08:00
OscarXu
19aa39b978
Merge remote-tracking branch 'origin/wjx/moe_v3_aiter' into moe_bs_stage1_dev
2025-05-13 10:46:40 +08:00
OscarXu
f392874e3d
revert unexpected file change
2025-05-13 09:55:33 +08:00
OscarXu
fe8bb251da
gemm1 up-only pass. GU WIP
2025-05-12 21:08:42 +08:00
OscarXu
0a845c0b7d
Merge remote-tracking branch 'origin/moe_blockscale_dev_gfx950' into moe_merge_v3_bs_for_aiter. Manual fix for thread_group_tensor_slice_transfer_v7r3_scatter
2025-05-12 19:25:39 +08:00
OscarXu
e202de188e
temp cmake flag suppression for aiter test
2025-05-12 09:34:42 +00:00
OscarXu
2930c0708a
Add v3 128x128x128_4x4_16x16.co for gfx950
2025-05-12 09:27:45 +00:00
valarLip
037a5ff76c
update moe
2025-05-12 06:36:23 +00:00
OscarXu
f1a534f6e7
Compile pass. Gemm1 function WIP
2025-05-12 13:20:16 +08:00
OscarXu
3e5005a47b
fix compile error. Gemm2 pass. Gemm1 WIP
2025-05-12 11:21:14 +08:00
OscarXu
7729fdb349
temp save for gemm1. Function not ready
2025-05-12 09:32:58 +08:00
Mingtao Gu
a23390163d
fix moe gemm2 for gfx950 ( #2164 )
...
Co-authored-by: mtgu0705 <mtgu@amd.com >
2025-05-09 08:25:31 -07:00
OscarXu
03d5a50b45
Merge remote-tracking branch 'origin/wjx/align_v3_pipeline' into moe_bs_stage1_dev
2025-05-09 20:15:11 +08:00
lalala-sh
6c459e8c38
Merge branch 'develop' into wjx/align_v3_pipeline
2025-05-08 18:08:31 +08:00
OscarXu
586c2a9a15
Merge remote-tracking branch 'origin/f8blk_scale_opt' into moe_blockscale_dev
2025-05-08 16:39:08 +08:00
OscarXu
3faa371b9f
Update .co binary to 16x16
2025-05-08 16:21:22 +08:00
aska-0096
68c7fe843d
temp save, a performant version.
2025-05-08 07:44:06 +00:00
BingYuan.Zhou
6a3960c1e1
Flatmm merge ( #2168 )
...
* sync with function interface of cshuffleepiloge,fix flatmm build fail
* move code from solin/flatmm which add mfma16*16*32fp8 and optimize flatmm
---------
Co-authored-by: solin <bingzhou@amd.com >
2025-05-08 12:59:57 +08:00
Khushbu Agarwal
c7b8e86e34
[CK_Tile] Simplified Mem pipeline ( #2159 )
...
* simplify code
* compiled the code
* Simplified example and codegen for mem pipeline
* Reveting config and universal gemm example
* clang formatted
* remove comments
* clang formatted
* Add memory operation changes for defualt pipeline
* fix config file
---------
Co-authored-by: ThomasNing <thomas.ning@amd.com >
2025-05-07 18:37:31 -07:00
OscarXu
8021128572
merge origin/f8blk_scale_opt
2025-05-07 17:10:03 +08:00
kylasa
956fe8f751
Simple copy kernel, which can be a tool to experiment with CK_Tile API with minimal code. ( #2156 )
...
* Test Copy kernel code for testing tile distribution logic
* Fix the error
* Solved the problem
* Updated comments and document formatting
* Removed unused tile distribution and code cleanup
* Added README.md and formatting for CI/CD.
---------
Co-authored-by: ThomasNing <thomas.ning@amd.com >
2025-05-07 00:02:59 -07:00
OscarXu
c989bbe3aa
Update v1_128x128x128 to 2x2 instead of 4x1
2025-05-07 14:24:30 +08:00
carlushuang
4e9b76f88c
[CK_TILE] optimize moe sorting kernel, boost large context case up to 20x ( #2153 )
...
* combine 2-3 as single stage
* support zeroing
* improve long tokens
* update specialization
* b16 ws
* 8bit topk optimize
* update 15 example
2025-05-06 17:32:07 +08:00
lalala-sh
abff33eaab
tune fp8 example
2025-05-06 08:46:38 +00:00
OscarXu
e7fe8587f6
Add asm for no-loop v3_128x128x128
2025-05-06 10:47:29 +08:00
jakpiase
0bcb804ad0
[CK_TILE] Remove scratch usage from universal gemm ( #2001 )
...
* moves kbatch condition outside of kernel
* add reviewer comments
* fixes
* fix tests
* fixes after review
---------
Co-authored-by: Adam Osewski <19374865+aosewski@users.noreply.github.com >
2025-05-05 18:46:44 +02:00
