114 Commits

Author	SHA1	Message	Date
OscarXu	79f47b4611	Add buf2lds moe_bs_fp8 support to gemm1 v3 and gemm2 v1/v3. Add result_all_zero check	2025-06-11 03:06:57 -05:00
OscarXu	2938b13fee	buf2lds moe_bs_fp8_gemm1 func pass	2025-06-09 03:16:35 -05:00
OscarXu	6be76c53b6	No asm ver. for merging moe blocksale fp8 into mainline	2025-05-29 03:38:56 -05:00
OscarXu	52d68c9529	flag and barrier fix for copmiler branch MainOpSelV3	2025-05-29 03:13:11 -05:00
OscarXu	653bc83f8a	Remove rocm6.3 workaround flags and macro	2025-05-28 21:05:21 -05:00
OscarXu	772debdf8f	Fix do_weight in gemm1. Fix cshuffle_datatype. Clang-format	2025-05-28 18:29:06 +08:00
OscarXu	fc9ef98e7b	Add gemm2 64x128x128 asm. Fix BF16 ref.	2025-05-21 16:57:57 +08:00
OscarXu	b146191da2	v2 tok_weight WIP	2025-05-20 16:34:07 +08:00
OscarXu	9fdfff82ea	Fix v2 topk_weight cal. Add silu asm.	2025-05-20 13:42:06 +08:00
OscarXu	f87973a4ac	Merge remote-tracking branch 'origin/moe_bs_stage1_dev' into moe_merge_v3_bs_for_aiter	2025-05-19 19:34:42 +08:00
OscarXu	a4ed178b4c	Add gemm2 v3 64x128x128	2025-05-19 19:33:04 +08:00
OscarXu	330173eb34	Merge remote-tracking branch 'origin/moe_bs_stage1_dev' into moe_merge_v3_bs_for_aiter	2025-05-19 19:12:37 +08:00
OscarXu	a92849c7b4	Add gemm2 v3 64x128x128	2025-05-19 19:08:15 +08:00
OscarXu	9aed1afb87	Merge remote-tracking branch 'origin/moe_bs_stage1_dev' into moe_merge_v3_bs_for_aiter	2025-05-19 14:02:34 +08:00
OscarXu	ce3cc1b967	Update gemm2 asm with latest compiler flag	2025-05-19 14:01:14 +08:00
OscarXu	81a1e1c7fb	Merge remote-tracking branch 'origin/moe_bs_stage1_dev' into moe_merge_v3_bs_for_aiter	2025-05-19 10:35:25 +08:00
OscarXu	3b94b389a9	Add gemm1 gfx942 .co support	2025-05-19 10:34:37 +08:00
OscarXu	215ddb0be0	Merge remote-tracking branch 'origin/moe_bs_stage1_dev' into moe_merge_v3_bs_for_aiter	2025-05-17 04:35:43 -05:00
OscarXu	9c9bf1aece	Moe blockscale gemm1&gemm2 asm support for aiter. Suppression cmkae flag til new compler.	2025-05-17 04:33:52 -05:00
OscarXu	19e43cb175	Cmakelist diable compiler-bound flags	2025-05-17 00:51:44 -05:00
OscarXu	e4516b71c9	Merge branch 'moe_bs_stage1_dev' into moe_merge_v3_bs_for_aiter	2025-05-17 00:43:46 -05:00
OscarXu	98606fad94	Merge remote-tracking branch 'origin/wjx/moe_v3_aiter' into moe_bs_stage1_dev	2025-05-14 20:48:42 -05:00
OscarXu	c84ad83905	v1 fix for mi350.	2025-05-14 08:05:17 -05:00
OscarXu	9ecbcce2e9	Merge remote-tracking branch 'origin/wjx/moe_v3_aiter' into moe_merge_v3_bs_for_aiter	2025-05-14 15:05:08 +08:00
OscarXu	b2c0c3cfeb	gemm1 v3 64x128x128 debug	2025-05-14 10:07:11 +08:00
OscarXu	50590b8f17	Add gemm1 v1 32x128x128	2025-05-13 16:46:51 +08:00
valarLip	eaebefb278	update moe v1 pipeline	2025-05-13 08:42:49 +00:00
OscarXu	9ead312164	Gemm1 GUFusion function pass. Perf WIP	2025-05-13 15:32:39 +08:00
OscarXu	19aa39b978	Merge remote-tracking branch 'origin/wjx/moe_v3_aiter' into moe_bs_stage1_dev	2025-05-13 10:46:40 +08:00
OscarXu	f392874e3d	revert unexpected file change	2025-05-13 09:55:33 +08:00
OscarXu	fe8bb251da	gemm1 up-only pass. GU WIP	2025-05-12 21:08:42 +08:00
OscarXu	0a845c0b7d	Merge remote-tracking branch 'origin/moe_blockscale_dev_gfx950' into moe_merge_v3_bs_for_aiter. Manual fix for thread_group_tensor_slice_transfer_v7r3_scatter	2025-05-12 19:25:39 +08:00
OscarXu	e202de188e	temp cmake flag suppression for aiter test	2025-05-12 09:34:42 +00:00
OscarXu	2930c0708a	Add v3 128x128x128_4x4_16x16.co for gfx950	2025-05-12 09:27:45 +00:00
valarLip	037a5ff76c	update moe	2025-05-12 06:36:23 +00:00
OscarXu	f1a534f6e7	Compile pass. Gemm1 function WIP	2025-05-12 13:20:16 +08:00
OscarXu	3e5005a47b	fix compile error. Gemm2 pass. Gemm1 WIP	2025-05-12 11:21:14 +08:00
OscarXu	7729fdb349	temp save for gemm1. Function not ready	2025-05-12 09:32:58 +08:00
Mingtao Gu	a23390163d	fix moe gemm2 for gfx950 (#2164) ... Co-authored-by: mtgu0705 <mtgu@amd.com>	2025-05-09 08:25:31 -07:00
OscarXu	03d5a50b45	Merge remote-tracking branch 'origin/wjx/align_v3_pipeline' into moe_bs_stage1_dev	2025-05-09 20:15:11 +08:00
lalala-sh	6c459e8c38	Merge branch 'develop' into wjx/align_v3_pipeline	2025-05-08 18:08:31 +08:00
OscarXu	586c2a9a15	Merge remote-tracking branch 'origin/f8blk_scale_opt' into moe_blockscale_dev	2025-05-08 16:39:08 +08:00
OscarXu	3faa371b9f	Update .co binary to 16x16	2025-05-08 16:21:22 +08:00
aska-0096	68c7fe843d	temp save, a performant version.	2025-05-08 07:44:06 +00:00
OscarXu	8021128572	merge origin/f8blk_scale_opt	2025-05-07 17:10:03 +08:00
OscarXu	c989bbe3aa	Update v1_128x128x128 to 2x2 instead of 4x1	2025-05-07 14:24:30 +08:00
lalala-sh	abff33eaab	tune fp8 example	2025-05-06 08:46:38 +00:00
OscarXu	e7fe8587f6	Add asm for no-loop v3_128x128x128	2025-05-06 10:47:29 +08:00
aska-0096	8c40f3d8fd	experimental optimization for scale load in blkscale gemm	2025-05-02 07:12:01 +00:00
OscarXu	efbb85be2a	Add .co direct asm support by CK_USE_ASM_MOE_STAGE2_BLOCKSCALE	2025-04-30 22:05:54 +08:00