firecoperana 0cb6dcc8c8 server: cache prompt to host memory (#954) ...

* server : host-memory prompt caching

change similarity calculation and prompt save conditions

Remove unneeded token limit

rename variable

Separate prompt save and load logic

change default values

change log

remove truncate prompt logic

* add description

* bug fixes

* remove token limit in init

---------

Co-authored-by: firecoperana <firecoperana>

2025-11-14 18:40:13 +02:00

172 KiB

Raw Blame History

View Raw