kvcache-ai/ktransformers
1
0
Fork 0
mirror of https://github.com/kvcache-ai/ktransformers.git synced 2026-06-07 00:04:14 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
ovowei-patch-2
ktransformers/kt-kernel/operators
History
callmegaga a9411f1d72 Supports vnni-256 for GPTQ INT4 (#1926) 
* [feat](kt-kernel): support avx-vnni-256 for gptq int4
2026-04-13 17:59:59 +08:00
..
amx
[feat]: add AVX512F+BW fallback for FP8 and BF16 under AMX backend (#1908)
2026-04-03 12:46:22 +08:00
avx2
Supports vnni-256 for GPTQ INT4 (#1926)
2026-04-13 17:59:59 +08:00
kvcache
update kt-kernel
2025-11-03 15:19:52 +08:00
llamafile
[feat](kt-kernel): CPU-GPU experts sched (#1796)
2026-01-16 17:01:15 +08:00
moe_kernel
[feat](kt-kernel): CPU-GPU experts sched (#1796)
2026-01-16 17:01:15 +08:00
common.hpp
[feat](kt-kernel): CPU-GPU experts sched (#1796)
2026-01-16 17:01:15 +08:00
mla-tp.hpp
add kt-kernel
2025-10-12 05:13:00 +00:00
moe-tp.hpp
[fix](kt-kernel): fix typo in moe-tp's forward time-profiling (#1720)
2025-12-17 12:06:33 +08:00
reduce.hpp
add kt-kernel
2025-10-12 05:13:00 +00:00
rms-norm.hpp
add kt-kernel
2025-10-12 05:13:00 +00:00
rope.hpp
add kt-kernel
2025-10-12 05:13:00 +00:00
softmax.hpp
add kt-kernel
2025-10-12 05:13:00 +00:00
tp.hpp
add kt-kernel
2025-10-12 05:13:00 +00:00