ikawrakow/ik_llama.cpp
1
0
Fork 0
mirror of https://github.com/ikawrakow/ik_llama.cpp.git synced 2026-02-25 23:54:10 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
dd0b08d1d84b99b4e9c256737f0ca43ec73ffa3b
ik_llama.cpp/ggml
History
Iwan Kawrakow dd0b08d1d8 iq2_tn: AVX512 
Just reusing the k-quants template gets us to PP-512 = 376 t/s,
TG-128 = 47.6 t/s for TriLM-3.9B.
2024-08-05 14:53:49 +03:00
..
cmake
Merge mainline llama.cpp (#3)
2024-07-27 07:55:01 +02:00
include
iq2_tn: TriLM specific 2.0625 bpw quantization
2024-08-05 14:22:05 +03:00
src
iq2_tn: AVX512
2024-08-05 14:53:49 +03:00
.gitignore
Merge mainline llama.cpp (#3)
2024-07-27 07:55:01 +02:00
CMakeLists.txt
Merge mainline llama.cpp (#3)
2024-07-27 07:55:01 +02:00