ikawrakow/ik_llama.cpp
1
0
Fork 0
mirror of https://github.com/ikawrakow/ik_llama.cpp.git synced 2026-02-25 23:54:10 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
a7fb0fc3cc7aebf8477e058789cb9f65e0141205
ik_llama.cpp/ggml
History
Iwan Kawrakow a7fb0fc3cc Experimenting with dequant + f32 GEMM 
For iq4_kt this results in a massive PP improvement
from PP512 = ~42 t/s to PP512 = 128 t/s.
2025-05-31 11:08:27 +03:00
..
cmake
Merge mainline llama.cpp (#3)
2024-07-27 07:55:01 +02:00
include
Trellis quants with CPU inference (#441)
2025-05-23 09:17:52 +03:00
src
Experimenting with dequant + f32 GEMM
2025-05-31 11:08:27 +03:00
.gitignore
Merge mainline llama.cpp (#3)
2024-07-27 07:55:01 +02:00
CMakeLists.txt
Option to enable disable the IQK CPU FA kernels (#429)
2025-05-17 11:21:58 +03:00