Commit Graph

1986 Commits

Author SHA1 Message Date
mtgu0705
c8a329e271 update MX moe GEMM1 hotloopscheduling 2025-05-27 08:49:46 -05:00
mtgu0705
a36a747e29 rename the block pipeline 2025-05-24 00:03:43 -05:00
feifei14119
2e39bf06f7 fix typo 2025-05-23 11:23:01 +00:00
mtgu0705
2216ff0521 update mx moe gemm1 gemm2 TF and BW calculation 2025-05-23 05:29:39 -05:00
mtgu0705
d6bfdc9d7d update mx moe gemm1_bns tile size to 64x128x256 2025-05-23 05:10:45 -05:00
feifei14119
ce4e7b39da gemm1 func pass 2025-05-23 09:26:38 +00:00
mtgu0705
eb588bc083 update the TFlops calculation in the example 2025-05-20 10:00:13 -05:00
mtgu0705
582dc7f842 enable fp4 moe no weigth preshuffle, function pass 2025-05-20 08:18:22 -05:00
mtgu0705
589e1dfea9 init mx fp4 B no preshuffle version 2025-05-20 04:40:22 -05:00
mtgu0705
680de28f77 commit with debug info 2025-05-19 21:47:35 -05:00
mtgu0705
685a01877f fix a, b scale loading bugs, a, b scale loading now correctly 2025-05-19 06:18:57 -05:00
mtgu0705
2e6fafaf75 updated code, build passed. 2025-05-18 22:29:32 -05:00
mtgu0705
a4b5a374b9 Merge remote-tracking branch 'origin/wip-f4-pk' into mx_moe_f4_scale_shuffle 2025-05-17 09:49:24 -05:00
mtgu0705
d4aaf9d0d0 Merge remote-tracking branch 'origin/moe_mx_fp4_for_aiter' into mx_moe_f4_scale_shuffle 2025-05-17 09:30:48 -05:00
mtgu0705
eeeba8901f update code 2025-05-17 09:28:26 -05:00
OscarXu
6fb2b54ff4 mx_fp4 default parameter change 2025-05-17 01:03:28 -05:00
mtgu0705
94fb9190be init moe mx f4 scale shuffle 2025-05-16 14:46:09 -05:00
aska-0096
248e287866 generalize the pipeline scheduling. 2025-05-16 10:41:59 +00:00
aska-0096
a0379d81e7 modify the way we represent fp4 2025-05-16 09:44:04 +00:00
OscarXu
ec8d00d58d mx_moe_fp4 ready for aiter with clang-format. 2025-05-16 04:09:26 -05:00
OscarXu
f03a96ffcf align file and function name 2025-05-16 03:54:28 -05:00
OscarXu
39ff3fbf05 v3 function pass 2025-05-16 03:42:48 -05:00
OscarXu
c5be9a501b v1 function pass. 2025-05-16 03:16:38 -05:00
aska-0096
a1bec7670a tempsave 2025-05-16 08:14:56 +00:00
OscarXu
efd3c24587 minor fix 2025-05-16 01:02:51 -05:00
OscarXu
f70f778e27 v1 compile pass. Function not ready 2025-05-15 08:01:56 -05:00
Ding, Yi
9009d75c7a Pack e8m0 as int32_t 2025-05-15 09:12:17 +00:00
aska-0096
062e16d54a Improve the pipeline 2025-05-15 09:08:36 +00:00
OscarXu
68dbe558df compile error fix 2025-05-15 16:55:20 +08:00
OscarXu
7c76e19e55 Merge remote-tracking branch 'origin/fp4_gu_moe' into fp4_gu_moe_gemm1 2025-05-15 16:37:08 +08:00
mtgu0705
b65bc1ba4a added mx moe block v3 support, function passed 2025-05-15 03:26:37 -05:00
OscarXu
bcb4f7e98c Add gemm1 v1 to selector 2025-05-15 16:22:45 +08:00
OscarXu
c0babbca62 Merge remote-tracking branch 'origin/fp4_gu_moe' into fp4_gu_moe_gemm1 2025-05-15 16:12:19 +08:00
OscarXu
17922821ec Add gemm1 v1 2025-05-15 16:11:43 +08:00
mtgu0705
4e2ec31e4d rename moe block selector and pipeline 2025-05-15 02:12:50 -05:00
Your Name
e060999d29 v3 2025-05-15 13:19:07 +08:00
mtgu0705
dfba3c11e7 fix the bug, 128x128x256 tile function passed 2025-05-15 00:11:10 -05:00
mtgu0705
7cfd1db335 update debug 2025-05-14 21:41:28 -05:00
mtgu0705
efdd420742 debug save 2025-05-14 09:33:24 -05:00
mtgu0705
102151ebcf temp save 2025-05-14 08:13:47 -05:00
mtgu0705
2700b217be 16x16x128 input size blockscale function passed 2025-05-14 03:20:59 -05:00
Ding, Yi
4ba9fe186c Use random scale for init1 2025-05-14 05:42:39 +00:00
Ding, Yi
e7130d483c a/b thread_desc stride fix 2025-05-14 05:11:32 +00:00
feifei14119
7be8730247 fix cpu ref 2025-05-14 10:22:18 +08:00
mtgu0705
1bbb50b212 mfma using asm, device result correct, host result need to check 2025-05-13 20:57:34 -05:00
Ding, Yi
521471c956 Fix fp8/bf8 B-row 2025-05-13 10:13:18 +00:00
mtgu0705
6dfe24c53e updated 2025-05-13 04:15:53 -05:00
Ding, Yi
178e361101 Fix fp8/bf8; remove duplicated code 2025-05-13 07:52:13 +00:00
mtgu0705
c11fef9197 added code for debug 2025-05-13 15:25:03 +08:00
mtgu0705
5b26ad3bbf update CE elementOP 2025-05-13 02:19:13 -05:00