ktransformers

mirror of https://github.com/kvcache-ai/ktransformers.git synced 2026-03-15 02:47:22 +00:00

Files

ZiWei Yuan 1374b98ee5 [feat](moe_kernel): add amd blis support (int8) (#1600 )

* [feat]: init amd adaption

* [feat]: add blis support

* [fix]: fix setup and moe kernel warpper

* [fix](setup.py): support rebuild with cache and import kt_kernel works
fine

* [feat]: add moe_kernel converter for amd and implement the load
method(haven't tested yet)

* [feat](moe_kernel/moe.hpp): delete unused memory when using save

* [fix](moe_kernel): update PLAIN for pack

* [fix](moe_kernel): rm printf debug

* [fix](moe_kernel): skip gpu experts

* [fix](moe_kernel/moe.hpp): update include memory path

* [feat](moe_kernel/moe.hpp): support expert deferral

* [feat]: finish amd

---------

Co-authored-by: mrhaoxx <mr.haoxx@gmail.com>

2025-11-27 12:08:53 +08:00

amx

[feat](moe_kernel): add amd blis support (int8) (#1600 )

2025-11-27 12:08:53 +08:00

kvcache

update kt-kernel

2025-11-03 15:19:52 +08:00

llamafile

[feat](moe_kernel): add amd blis support (int8) (#1600 )

2025-11-27 12:08:53 +08:00

moe_kernel

[feat](moe_kernel): add amd blis support (int8) (#1600 )