firecoperana c1931663ad server: improve speed of speculative decoding (#1119) ...

* server: improve speed of speculative decoding

change logs

rpc: add recompute

spec dec fix

* Fix n_batch_size not set to context size for draft model

---------

Co-authored-by: firecoperana <firecoperana>

2026-01-10 08:01:22 +02:00

976 B

Raw Blame History

View Raw