ikawrakow/ik_llama.cpp
1
0
Fork 0
mirror of https://github.com/ikawrakow/ik_llama.cpp.git synced 2026-03-02 10:00:07 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
57dd55e2c742bfc50e0f5c6fb95c14118cff44f6
ik_llama.cpp/examples/batched/batched.cpp
Georgi Gerganov 8c70a5ff25 batched : add bench tool (#3545) 
* batched : add bench tool

* batched : minor fix table

* batched-bench : add readme + n_kv_max is now configurable

* batched-bench : init warm-up batch

* batched-bench : pass custom set of PP, TG and PL

* batched-bench : add mmq CLI arg
2023-10-11 21:25:33 +03:00

7.5 KiB
Raw Blame History

View Raw
Reference in New Issue View Git Blame Copy Permalink