OscarXu
6fb2b54ff4
mx_fp4 default parameter change
2025-05-17 01:03:28 -05:00
OscarXu
ec8d00d58d
mx_moe_fp4 ready for aiter with clang-format.
2025-05-16 04:09:26 -05:00
OscarXu
39ff3fbf05
v3 function pass
2025-05-16 03:42:48 -05:00
OscarXu
c5be9a501b
v1 function pass.
2025-05-16 03:16:38 -05:00
OscarXu
efd3c24587
minor fix
2025-05-16 01:02:51 -05:00
OscarXu
f70f778e27
v1 compile pass. Function not ready
2025-05-15 08:01:56 -05:00
OscarXu
68dbe558df
compile error fix
2025-05-15 16:55:20 +08:00
OscarXu
c0babbca62
Merge remote-tracking branch 'origin/fp4_gu_moe' into fp4_gu_moe_gemm1
2025-05-15 16:12:19 +08:00
OscarXu
17922821ec
Add gemm1 v1
2025-05-15 16:11:43 +08:00
mtgu0705
4e2ec31e4d
rename moe block selector and pipeline
2025-05-15 02:12:50 -05:00
mtgu0705
dfba3c11e7
fix the bug, 128x128x256 tile function passed
2025-05-15 00:11:10 -05:00
mtgu0705
7cfd1db335
update debug
2025-05-14 21:41:28 -05:00
mtgu0705
efdd420742
debug save
2025-05-14 09:33:24 -05:00
mtgu0705
102151ebcf
temp save
2025-05-14 08:13:47 -05:00
mtgu0705
2700b217be
16x16x128 input size blockscale function passed
2025-05-14 03:20:59 -05:00
mtgu0705
1bbb50b212
mfma using asm, device result correct, host result need to check
2025-05-13 20:57:34 -05:00
mtgu0705
6dfe24c53e
updated
2025-05-13 04:15:53 -05:00
mtgu0705
5b26ad3bbf
update CE elementOP
2025-05-13 02:19:13 -05:00
mtgu0705
5ba86c210b
updated and build passed
2025-05-13 14:49:37 +08:00
mtgu0705
cc43f88f08
add code for mxfp4 gemm, blockscale not supported yet
2025-05-12 20:56:50 +08:00
Your Name
58f848cc07
Merge branch 'wjx/align_v3_pipeline' into fp4_gu_moe
2025-05-12 16:21:39 +08:00
mtgu0705
726551dec4
(M, N, K)=(128, 128, 128) function failed.
2025-05-11 10:16:26 +00:00
mtgu0705
70648240f9
added fp4_bpreshuffle example, build failures
2025-05-10 21:34:32 +08:00
Your Name
5421e71155
Merge branch 'wip-f4' into mt1
2025-05-10 14:56:21 +08:00
aska-0096
0987b0af44
remove unnecessary hacky
2025-05-09 16:07:22 +00:00
aska-0096
7bde4b8d34
Add pipeline v3. Have some runtime issue and register spill
2025-05-09 09:47:22 +00:00
mtgu0705
c0e010711c
update for function debug
2025-05-09 08:37:04 +00:00
aska-0096
bb043a3202
remove some unnecessary hacky; enable 256x256x256 tilesize
2025-05-09 07:54:28 +00:00
mtgu0705
f2a474e2e9
fix update
2025-05-09 11:04:39 +08:00
mtgu0705
11f386108e
some fixes
2025-05-08 23:38:27 +08:00
aska-0096
b2efb06315
Spilt the fp4 target. Fix the known bugs. 128x128x128 sanity checked; remove prints
2025-05-08 15:07:33 +00:00
mtgu0705
7c49f9dd31
add mx fp8 b_preshuffle support, function not yet tested.
2025-05-08 22:41:54 +08:00
lalala-sh
6c459e8c38
Merge branch 'develop' into wjx/align_v3_pipeline
2025-05-08 18:08:31 +08:00
aska-0096
32e6c8aad3
16x16x128 correct; 64x64x128 failed
2025-05-08 09:42:53 +00:00
Ding, Yi
6519ba3aa9
wip3
2025-05-08 07:44:22 +00:00
BingYuan.Zhou
6a3960c1e1
Flatmm merge ( #2168 )
...
* sync with function interface of cshuffleepiloge,fix flatmm build fail
* move code from solin/flatmm which add mfma16*16*32fp8 and optimize flatmm
---------
Co-authored-by: solin <bingzhou@amd.com >
2025-05-08 12:59:57 +08:00
Khushbu Agarwal
c7b8e86e34
[CK_Tile] Simplified Mem pipeline ( #2159 )
...
* simplify code
* compiled the code
* Simplified example and codegen for mem pipeline
* Reveting config and universal gemm example
* clang formatted
* remove comments
* clang formatted
* Add memory operation changes for defualt pipeline
* fix config file
---------
Co-authored-by: ThomasNing <thomas.ning@amd.com >
2025-05-07 18:37:31 -07:00
Ding, Yi
8d51a4ae96
wip2
2025-05-07 09:40:47 +00:00
Ding, Yi
d12b750bb0
wip
2025-05-07 08:17:07 +00:00
kylasa
956fe8f751
Simple copy kernel, which can be a tool to experiment with CK_Tile API with minimal code. ( #2156 )
...
* Test Copy kernel code for testing tile distribution logic
* Fix the error
* Solved the problem
* Updated comments and document formatting
* Removed unused tile distribution and code cleanup
* Added README.md and formatting for CI/CD.
---------
Co-authored-by: ThomasNing <thomas.ning@amd.com >
2025-05-07 00:02:59 -07:00
carlushuang
4e9b76f88c
[CK_TILE] optimize moe sorting kernel, boost large context case up to 20x ( #2153 )
...
* combine 2-3 as single stage
* support zeroing
* improve long tokens
* update specialization
* b16 ws
* 8bit topk optimize
* update 15 example
2025-05-06 17:32:07 +08:00
lalala-sh
abff33eaab
tune fp8 example
2025-05-06 08:46:38 +00:00
jakpiase
0bcb804ad0
[CK_TILE] Remove scratch usage from universal gemm ( #2001 )
...
* moves kbatch condition outside of kernel
* add reviewer comments
* fixes
* fix tests
* fixes after review
---------
Co-authored-by: Adam Osewski <19374865+aosewski@users.noreply.github.com >
2025-05-05 18:46:44 +02:00
Andriy Roshchenko
79b0bfeb41
MX GEMM - Add FP8 GEMM Tests for Different Layouts ( #2152 )
...
* Add gemm_mx_fp8_bf8 example with row-major B
* Add more overloads of MX MFMA instructions
* Add MK_KN (RRR) tests
* Add KM_NK (CCR) tests
* Add more problem sizes to Large tests
* Add test_gemm_mx to the list of regression tests
2025-05-01 11:55:48 -06:00
Illia Silin
9a9f59ae69
Revert "Add ck tile examples to package ( #1880 )" ( #2150 )
2025-04-30 10:20:16 -07:00
lalala-sh
b8427b812e
align v3 gufusion pipeline
2025-04-30 01:35:49 +00:00
Daniel Su
d9786f3363
Check max-ilp-scheduling compiler option for moe_gemm examples ( #2127 )
2025-04-28 13:40:22 -07:00
jakpiase
434d19f696
Add ck tile examples to package ( #1880 )
...
* add ck tile examples to package
* Update jenkinsfile
* fix for jenkinsfile
* fix for building ck tile code on non gfx9
* compile ck tile examples only for gfx94
* include ck tile examples in all target
* fix for basic gemm UseStructuredSparsity
* Update CMakeLists.txt
* Update gemm_pipeline_problem.hpp
* add targets to rocm install
---------
Co-authored-by: Illia Silin <98187287+illsilin@users.noreply.github.com >
2025-04-28 09:53:19 -07:00
lalala-sh
83394e40d2
fix moe i4 example bug ( #2139 )
2025-04-28 09:49:31 -07:00
Yi DING
8add2cf45d
Fix fp8 convert & add option for basic example ( #2129 )
2025-04-27 16:26:05 -07:00
