firecoperana c1931663ad server: improve speed of speculative decoding (#1119) ...

* server: improve speed of speculative decoding

change logs

rpc: add recompute

spec dec fix

* Fix n_batch_size not set to context size for draft model

---------

Co-authored-by: firecoperana <firecoperana>

2026-01-10 08:01:22 +02:00

..

cmake

Merge mainline llama.cpp (#3)

2024-07-27 07:55:01 +02:00

include

server: improve speed of speculative decoding (#1119)

2026-01-10 08:01:22 +02:00

src

server: improve speed of speculative decoding (#1119)

2026-01-10 08:01:22 +02:00

.gitignore

Merge mainline llama.cpp (#3)

2024-07-27 07:55:01 +02:00

CMakeLists.txt

CUDA: compress-mode size (#1110)

2026-01-07 18:33:17 +02:00