575 Commits

Author	SHA1	Message	Date
coderfeli	dd42d8e8fa	support index type	2025-03-10 10:07:44 +00:00
mtgu0705	6915b0b059	updated gemm2.	2025-03-04 18:11:15 +08:00
mtgu0705	4a29a65f3e	Modified CshuffleCShuffleMXdlPerWavePerShuffle to 1 to suit C multiple shuffle	2025-03-04 13:13:03 +08:00
mtgu0705	ca281a995c	fixed int4 moe tflops calculation.	2025-03-04 13:11:14 +08:00
mtgu0705	d033ed5ec5	revert the v3r1_gather.hpp	2025-02-28 19:09:23 +08:00
mtgu0705	29d9235bf3	for int4 moe2 for type_convert support.	2025-02-26 17:04:17 +08:00
mtgu0705	29d8d28bbb	commit a version for compiler debug.	2025-02-24 14:44:02 +08:00
mtgu0705	04ff8111d8	Revert "fix nswizzle = true" ... This reverts commit 24d8024f0e.	2025-02-19 16:42:06 +08:00
coderfeli	2fca1921b8	fix nswizzle = true	2025-02-19 16:20:34 +08:00
mtgu0705	11eaac1932	enable pipeline v3.	2025-02-19 14:22:39 +08:00
mtgu0705	77e2385f0e	update tile size.	2025-02-19 09:56:37 +08:00
mtgu0705	fc1558e354	update int4 moe with latest input changes.	2025-02-18 18:09:19 +08:00
coderfeli	9ff2394e26	fix swizzle = false	2025-02-18 17:43:00 +08:00
coderfeli	a61084f432	opt gemm2 to 2x2 wave	2025-02-18 17:42:46 +08:00
mtgu0705	854cd8b4a1	commit missing files	2025-02-18 16:29:26 +08:00
mtgu0705	182e7480ba	Split the blockwise pipeline for fp8xint4.	2025-02-18 15:38:05 +08:00
mtgu0705	49bac8cef7	Added b preshuffle pipeline v3 support.	2025-02-18 13:34:55 +08:00
mtgu0705	a0432459e7	Added moe_pk_i4_gemm2, function pass.	2025-02-18 13:34:41 +08:00
mtgu0705	a09f038c68	test expert = 8 and function pass.	2025-02-18 13:32:58 +08:00
mtgu0705	be79b63bfe	fix bug in moe_gemm1.cpp, now function pass.	2025-02-18 13:32:46 +08:00
mtgu0705	1b0b7810cd	Initial int4 moe, compile pass, function not check.	2025-02-18 13:32:25 +08:00
mtgu0705	e420767e3a	modified the tile size to 256, 128x128x128.	2025-02-18 13:25:30 +08:00
mtgu0705	ed89a238a0	fix.	2025-02-18 13:22:03 +08:00
mtgu0705	9a3f75eeb8	fp8xint4 bpreshuffle function pass	2025-02-18 13:21:36 +08:00
mtgu0705	ba5a6a2477	General fix.	2025-02-18 13:21:06 +08:00
mtgu0705	e0391df785	Added gemm_fp8xint4_Bpreshuffle files, function not checked yet	2025-02-18 13:20:36 +08:00
mtgu0705	2559ef64c3	Init Gemm_fp8xint4 Bpreshuffle	2025-02-18 13:15:35 +08:00
mtgu0705	8df8a17943	Add Gemm fp8xint4 example and kernel, function pass.	2025-02-18 13:14:18 +08:00
coderfeli	45d1c52ef5	hotfix moegemm2 nswizzle	2025-02-18 04:10:58 +00:00
coderfeli	bca3f14c7c	fix nswizzle=0	2025-02-18 03:36:13 +00:00
coderfeli	1687fc988e	chage ktile	2025-02-17 14:26:43 +00:00
coderfeli	4404984abc	2x2 ok	2025-02-17 09:52:22 +00:00
coderfeli	f64b137521	merge haocong branch	2025-02-17 09:30:02 +00:00
coderfeli	88412f9ead	impl sorting count eid	2025-02-17 09:11:57 +00:00
coderfeli	fcc2c867af	impl gemm2 swizzle	2025-02-17 02:33:52 +00:00
coderfeli	96047cab6f	impl e swizzel	2025-02-17 01:26:42 +00:00
coderfeli	56cc306d31	fix perf calc	2025-02-15 08:32:07 +00:00
coderfeli	7572a6916c	merge develop	2025-02-15 03:23:00 +00:00
coderfeli	7796fc738b	fix gemm2 scale, gemm2 ok now	2025-02-15 03:09:47 +00:00
coderfeli	61e3c23851	fix moe gemm2	2025-02-15 01:48:56 +00:00
coderfeli	db53dba4a0	hotfix:gemm1 use real tokens and gemm2 ok	2025-02-14 15:08:28 +00:00
coderfeli	84b27d7504	merge max_token_id and fix err	2025-02-14 08:19:54 +00:00
Bartłomiej Kocot	6b6fcd370b	[CK TILE] Check for num loop < Prefetch Stages in gemm (#1886)	2025-02-14 09:15:27 +01:00
coderfeli	b3ae04f8ed	fix ref gemm no padding	2025-02-14 07:48:41 +00:00
coderfeli	83be79ba58	add max_token_id	2025-02-14 06:22:17 +00:00
coderfeli	1078d22916	add logics and debug	2025-02-14 05:23:15 +00:00
coderfeli	d4b8f1e3b0	add codes for a scatter	2025-02-14 11:05:26 +08:00
Haocong WANG	f18cfec43c	Merge branch 'develop' into update_cka8w8_uc	2025-02-14 10:52:39 +08:00
coderfeli	82e1f1b903	change cshuffle cluster, mi300x reach roofline	2025-02-13 10:11:36 +00:00
valarLip	0e5e29c4e2	porting fmoe_sorting from moe_sorting (#1884) ... * porting fmoe_sorting from moe_sorting * pass default example test * remod	2025-02-13 15:34:34 +08:00