ikawrakow/ik_llama.cpp
1
0
Fork 0
mirror of https://github.com/ikawrakow/ik_llama.cpp.git synced 2026-03-10 14:00:08 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
3226b5d74b5e98967525e9c768172b50ef1aec3a
ik_llama.cpp/llama.cpp
Kerfuffle b0465289f6 kv cache slot search improvements (#3493) 
* kv cache slot search improvements

* Use n_ctx in kv find slot for consistency

* Ensure kv cache head points to a valid slot in llama_decode internal

* Add some comments to prevent dumb people (like me) from getting confused.
2023-10-06 10:10:13 -06:00

301 KiB
Raw Blame History

View Raw
Reference in New Issue View Git Blame Copy Permalink