Aliez Ren
|
02be2bf53f
|
[feat](kt-kernel): add AVX2/AVX-VNNI RAWINT4 MoE backend (#1942)
* [feat](kt-kernel): add AVX2/AVX-VNNI RAWINT4 MoE backend
* Update AVX2 tutorial with AVX2 compilation instructions
Added instructions for forcing AVX2 compilation on AVX512 or AMX machines.
* Add instructions for AVX2 compilation
---------
Co-authored-by: Jiaheng Dai <108478605+jdai0@users.noreply.github.com>
|
2026-04-30 17:16:49 +08:00 |
|
callmegaga
|
a9411f1d72
|
Supports vnni-256 for GPTQ INT4 (#1926)
* [feat](kt-kernel): support avx-vnni-256 for gptq int4
|
2026-04-13 17:59:59 +08:00 |
|
mrhaoxx
|
7a9daf0cd4
|
[feat](kt-kernel): support avx2 only inference for bf16 fp8 and gptq int4 (#1892)
* feat: support avx2 bf16 fp8 inference
* feat: support avx2 gptq int4 inference
* fix: numeric issues in fp8 dequant
* Tutorial avx2 (#1900)
* fix: prevent injecting -DLLAMA_AVX512=ON on AVX2-only machines
* docs: add AVX2 tutorial for running KTransformers on AVX2-only CPUs
* Tutorial avx2 (#1901)
* fix: prevent injecting -DLLAMA_AVX512=ON on AVX2-only machines
* docs: add AVX2 tutorial for running KTransformers on AVX2-only CPUs
* docs: update README.md
---------
Co-authored-by: Benjamin F <159887351+yyj6666667@users.noreply.github.com>
|
2026-03-27 14:45:02 +08:00 |
|
Jianwei Dong
|
027832c590
|
[feat](kt-kernel): CPU-GPU experts sched (#1796)
|
2026-01-16 17:01:15 +08:00 |
|
ErvinXie
|
d8046e1bb4
|
Kt minimax (#1742)
[feat]: fp8 kernel and kt-cli support
|
2025-12-24 15:39:44 +08:00 |
|
Jianwei Dong
|
1f79f6da92
|
[feat](kt-kernel): Add automatic deployment workflow (#1719)
|
2025-12-16 15:20:06 +08:00 |
|
ZiWei Yuan
|
c2b8c60c4e
|
[ci]: add int4_1 & int4_1k (#1653)
* [feat]: init amd adaption
* [feat]: add blis support
* [fix]: fix setup and moe kernel warpper
* [fix](setup.py): support rebuild with cache and import kt_kernel works
fine
* [feat]: add moe_kernel converter for amd and implement the load
method(haven't tested yet)
* [feat](moe_kernel/moe.hpp): delete unused memory when using save
* [fix](moe_kernel): update PLAIN for pack
* [fix](moe_kernel): rm printf debug
* [fix](moe_kernel): skip gpu experts
* [fix](moe_kernel/moe.hpp): update include memory path
* [feat](moe_kernel/moe.hpp): support expert deferral
* [feat]: finish amd
* [ci]: add int4_1 & int4_1k
---------
Co-authored-by: mrhaoxx <mr.haoxx@gmail.com>
|
2025-12-02 15:58:14 +08:00 |
|
Jianwei Dong
|
c256150e08
|
update ci test (#1647)
|
2025-11-27 16:39:48 +08:00 |
|
Jianwei Dong
|
fef6dd98a8
|
add accuracy and performance test (#1643)
|
2025-11-27 10:56:39 +08:00 |
|
Jianwei Dong
|
51745a9ea1
|
add ci (#1642)
|
2025-11-25 20:52:08 +08:00 |
|