693 Commits

Author	SHA1	Message	Date
OscarXu	dbf5378a08	gemm2 perf optimized without HotLoopScheduler. HotLoopScheduler WIP	2025-06-19 03:53:15 -05:00
OscarXu	e91c75aef3	Optimize moe_bs_fp8 gemm1 v1 pipeline. Perf of buf2lds is better than buf2gpr now.	2025-06-12 03:20:51 -05:00
OscarXu	79f47b4611	Add buf2lds moe_bs_fp8 support to gemm1 v3 and gemm2 v1/v3. Add result_all_zero check	2025-06-11 03:06:57 -05:00
OscarXu	2938b13fee	buf2lds moe_bs_fp8_gemm1 func pass	2025-06-09 03:16:35 -05:00
OscarXu	25c0e6e37e	fix type_convert fp32 to bf16	2025-06-06 01:34:43 -05:00
OscarXu	3e2f52ed6d	restore minimum_occupancy logic	2025-06-05 20:19:22 -05:00
OscarXu	63053f49ed	Fix moe blockscale gemm1 barrier 0x800 for new compiler	2025-05-29 23:11:40 -05:00
OscarXu	3fa9b53a27	remove type_convert debug msg	2025-05-29 22:34:51 -05:00
OscarXu	6be76c53b6	No asm ver. for merging moe blocksale fp8 into mainline	2025-05-29 03:38:56 -05:00
OscarXu	52d68c9529	flag and barrier fix for copmiler branch MainOpSelV3	2025-05-29 03:13:11 -05:00
OscarXu	653bc83f8a	Remove rocm6.3 workaround flags and macro	2025-05-28 21:05:21 -05:00
OscarXu	772debdf8f	Fix do_weight in gemm1. Fix cshuffle_datatype. Clang-format	2025-05-28 18:29:06 +08:00
OscarXu	fc9ef98e7b	Add gemm2 64x128x128 asm. Fix BF16 ref.	2025-05-21 16:57:57 +08:00
OscarXu	9fdfff82ea	Fix v2 topk_weight cal. Add silu asm.	2025-05-20 13:42:06 +08:00
OscarXu	f87973a4ac	Merge remote-tracking branch 'origin/moe_bs_stage1_dev' into moe_merge_v3_bs_for_aiter	2025-05-19 19:34:42 +08:00
OscarXu	a4ed178b4c	Add gemm2 v3 64x128x128	2025-05-19 19:33:04 +08:00
OscarXu	215ddb0be0	Merge remote-tracking branch 'origin/moe_bs_stage1_dev' into moe_merge_v3_bs_for_aiter	2025-05-17 04:35:43 -05:00
OscarXu	9c9bf1aece	Moe blockscale gemm1&gemm2 asm support for aiter. Suppression cmkae flag til new compler.	2025-05-17 04:33:52 -05:00
OscarXu	e4516b71c9	Merge branch 'moe_bs_stage1_dev' into moe_merge_v3_bs_for_aiter	2025-05-17 00:43:46 -05:00
OscarXu	98606fad94	Merge remote-tracking branch 'origin/wjx/moe_v3_aiter' into moe_bs_stage1_dev	2025-05-14 20:48:42 -05:00
OscarXu	c84ad83905	v1 fix for mi350.	2025-05-14 08:05:17 -05:00
valarLip	5f81710346	fix blockscale gemm bug	2025-05-14 08:23:49 +00:00
OscarXu	9ecbcce2e9	Merge remote-tracking branch 'origin/wjx/moe_v3_aiter' into moe_merge_v3_bs_for_aiter	2025-05-14 15:05:08 +08:00
OscarXu	b2c0c3cfeb	gemm1 v3 64x128x128 debug	2025-05-14 10:07:11 +08:00
OscarXu	50590b8f17	Add gemm1 v1 32x128x128	2025-05-13 16:46:51 +08:00
valarLip	eaebefb278	update moe v1 pipeline	2025-05-13 08:42:49 +00:00
OscarXu	9ead312164	Gemm1 GUFusion function pass. Perf WIP	2025-05-13 15:32:39 +08:00
OscarXu	19aa39b978	Merge remote-tracking branch 'origin/wjx/moe_v3_aiter' into moe_bs_stage1_dev	2025-05-13 10:46:40 +08:00
OscarXu	f392874e3d	revert unexpected file change	2025-05-13 09:55:33 +08:00
OscarXu	fe8bb251da	gemm1 up-only pass. GU WIP	2025-05-12 21:08:42 +08:00
OscarXu	0a845c0b7d	Merge remote-tracking branch 'origin/moe_blockscale_dev_gfx950' into moe_merge_v3_bs_for_aiter. Manual fix for thread_group_tensor_slice_transfer_v7r3_scatter	2025-05-12 19:25:39 +08:00
valarLip	3ea573acd6	update moe	2025-05-12 08:10:50 +00:00
valarLip	037a5ff76c	update moe	2025-05-12 06:36:23 +00:00
OscarXu	f1a534f6e7	Compile pass. Gemm1 function WIP	2025-05-12 13:20:16 +08:00
lalala-sh	d9ab2fe4f5	update moe	2025-05-12 05:08:58 +00:00
OscarXu	3e5005a47b	fix compile error. Gemm2 pass. Gemm1 WIP	2025-05-12 11:21:14 +08:00
OscarXu	7729fdb349	temp save for gemm1. Function not ready	2025-05-12 09:32:58 +08:00
Bartłomiej Kocot	6fddb5708c	Add grouped conv fwd bias relu instances (#2179) ... * Add grouped conv fwd bias relu instances * fixes * fix	2025-05-09 22:52:34 +02:00
jefyang1	6b1a339b6f	Fix grouped conv bwd data tests on gfx950 (#2173)	2025-05-09 09:01:06 -07:00
OscarXu	03d5a50b45	Merge remote-tracking branch 'origin/wjx/align_v3_pipeline' into moe_bs_stage1_dev	2025-05-09 20:15:11 +08:00
Andriy Roshchenko	cb27e7c77f	Ensure MX GEMM Instances can be Cross-Compiled for Multiple Architectures (#2171) ... * Re-enable MX GEMM instances * Fix compilation error when building MX GEMM for multiple architectures	2025-05-08 13:26:03 -06:00
lalala-sh	6c459e8c38	Merge branch 'develop' into wjx/align_v3_pipeline	2025-05-08 18:08:31 +08:00
lalala-sh	def952a178	use mem_op::set when topk=1	2025-05-08 09:49:16 +00:00
lalala-sh	960b2bce1c	update	2025-05-08 09:48:23 +00:00
OscarXu	586c2a9a15	Merge remote-tracking branch 'origin/f8blk_scale_opt' into moe_blockscale_dev	2025-05-08 16:39:08 +08:00
aska-0096	68c7fe843d	temp save, a performant version.	2025-05-08 07:44:06 +00:00
OscarXu	62877fa074	16x16 function merged to moe	2025-05-08 14:33:31 +08:00
OscarXu	8021128572	merge origin/f8blk_scale_opt	2025-05-07 17:10:03 +08:00
OscarXu	1fae385575	add warmup to asm launch	2025-05-07 16:55:42 +08:00
OscarXu	c989bbe3aa	Update v1_128x128x128 to 2x2 instead of 4x1	2025-05-07 14:24:30 +08:00