ikawrakow/ik_llama.cpp
1
0
Fork 0
mirror of https://github.com/ikawrakow/ik_llama.cpp.git synced 2026-02-25 15:44:10 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
fa710abffbf659d7015991599947b3ec3ca3e4c3
ik_llama.cpp/ggml
History
Iwan Kawrakow fa710abffb iq1_bn: improve CUDA TG 
On RTX-3080 TG-128(Bitnet-1.58b-3B) goes from 318 t/s to 340 t/s.
I see I have on the front page 301 t/s, so pretty nice improvement
since then.
2024-10-26 16:53:17 +03:00
..
cmake
Merge mainline llama.cpp (#3)
2024-07-27 07:55:01 +02:00
include
Remove forgotten IQ1_TN, IQ2_TN enum values
2024-10-25 14:14:56 +03:00
src
iq1_bn: improve CUDA TG
2024-10-26 16:53:17 +03:00
.gitignore
Merge mainline llama.cpp (#3)
2024-07-27 07:55:01 +02:00
CMakeLists.txt
Move to c++17 projectwide (#80)
2024-10-04 14:43:26 +03:00