4 Commits

Author	SHA1	Message	Date
ZiWei Yuan	1374b98ee5	[feat](moe_kernel): add amd blis support (int8) (#1600) ... * [feat]: init amd adaption * [feat]: add blis support * [fix]: fix setup and moe kernel warpper * [fix](setup.py): support rebuild with cache and import kt_kernel works fine * [feat]: add moe_kernel converter for amd and implement the load method(haven't tested yet) * [feat](moe_kernel/moe.hpp): delete unused memory when using save * [fix](moe_kernel): update PLAIN for pack * [fix](moe_kernel): rm printf debug * [fix](moe_kernel): skip gpu experts * [fix](moe_kernel/moe.hpp): update include memory path * [feat](moe_kernel/moe.hpp): support expert deferral * [feat]: finish amd --------- Co-authored-by: mrhaoxx <mr.haoxx@gmail.com>	2025-11-27 12:08:53 +08:00
Jiaqi Liao	d483147307	Fix kt-kernel compile issue (#1595) ... * update install.sh * fix import issue * update README	2025-11-11 19:30:27 +08:00
Jiaqi Liao	94c25626dc	Fix kt-kernel for new wrapper (#1588) ... * update README for kt-kernel * style: format C++ and Python code in kt-kernel - Format C++ files: task_queue, ext_bindings, and MoE operators - Format Python utility modules: amx, llamafile, and loader - Improve code readability and consistency	2025-11-10 21:47:34 +08:00
Jiaqi Liao	9bc00e587b	Refactor KTMoEWrapper backend (#1587) ... * universal backend for cpu inference * expert defer	2025-11-10 20:26:15 +08:00