ikawrakow/ik_llama.cpp
1
0
Fork 0
mirror of https://github.com/ikawrakow/ik_llama.cpp.git synced 2026-03-03 10:30:27 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
f60b94d4866b769827040b8b7b2a60e146e59d72
ik_llama.cpp/examples/perplexity/perplexity.cpp
slaren a96d02297c perplexity : support using multiple sequences to allow larger batch sizes (#5946) 
* perplexity : support using multiple sequences to allow larger batch sizes

ggml-ci

* set cparams.n_parallel to the number of sequences

* print tested n_ctx, add assert
2024-03-09 19:55:54 +01:00

70 KiB
Raw Blame History

View Raw
Reference in New Issue View Git Blame Copy Permalink