ik_llama.cpp/llama.cpp at 46a50dd4bf3103c598591489ff0d38904965e865

mirror of https://github.com/ikawrakow/ik_llama.cpp.git synced 2026-03-08 04:50:13 +00:00

Files

Evan Jones 5b067c42a2 llama : only copy used KV cache in get / set state (#1272 )

* llama : only copy used KV cache in get / set state

* switch to ggml for copying k, v

* avoid designated initializers

2023-05-02 22:26:13 -04:00

View Raw