ikawrakow/ik_llama.cpp
1
0
Fork 0
mirror of https://github.com/ikawrakow/ik_llama.cpp.git synced 2026-02-19 20:54:36 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
04cf685e82582e02f060712044d3d498268c8359
ik_llama.cpp/examples/parallel
History
firecoperana 1cb7e1bf39 spec : add self speculative decoding, ngram and refactor (#1261) 
* spec : add self speculative decoding and ngram-mod and refactor

common : use common_ prefix for common library function

llama : use LLAMA_TOKEN_NULL

spec : add self speculative decoding (no draft model required) + refactor

spec : add ngram-mod

spec : various improvements ton ngram-map + docs

spec : fix the check-rate logic of ngram-simple

common : add common_speculative_is_compat()

spec : simplify time measurement using common_time_meas

refactor common_sampler_init

refactor common_token_to_piece

refactor and fix cur_p bug

clean up

* spec : remove check rate

* spec: show warnings instead of abort

---------

Co-authored-by: firecoperana <firecoperana>
Co-authored-by: Sascha Rogmann <59577610+srogmann@users.noreply.github.com>
2026-02-13 19:04:55 +01:00
..
CMakeLists.txt
build: rename main → llama-cli, server → llama-server, llava-cli → llama-llava-cli, etc... (#7809)
2024-06-13 00:41:52 +01:00
parallel.cpp
spec : add self speculative decoding, ngram and refactor (#1261)
2026-02-13 19:04:55 +01:00
README.md
Fix some documentation typos/grammar mistakes (#4032)
2023-11-11 23:04:58 -07:00

README.md

llama.cpp/example/parallel

Simplified simulation of serving incoming requests in parallel