ikawrakow/ik_llama.cpp
1
0
Fork 0
mirror of https://github.com/ikawrakow/ik_llama.cpp.git synced 2026-03-01 17:40:25 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
52c8bc3cf312e1caf02d37bfb9d9d865cbe33594
ik_llama.cpp/examples/speculative/speculative.cpp
Branden Butler 40a34fe8d0 speculative : fix prompt tokenization in speculative example (#4025) 
* Support special tokens and not adding BOS to prompt in speculative

* Adapt to new should_add_bos function

* Ensure tgt and dft have same add_bos setting
2023-11-20 11:50:04 +02:00

16 KiB
Raw Blame History

View Raw
Reference in New Issue View Git Blame Copy Permalink