Files
ik_llama.cpp/examples/parallel
Kawrakow 1a4cfbcc53 Merge mainline - Aug 12 2024 (#17)
* Merge mainline

* Fix after merge

* Remove CI check

---------

Co-authored-by: Iwan Kawrakow <iwan.kawrakow@gmail.com>
2024-08-12 15:14:32 +02:00
..

llama.cpp/example/parallel

Simplified simulation of serving incoming requests in parallel