Pierrick Hymbert a82d6e2eb0 server: stop generation at n_ctx_train if n_predict is not set (#6638) ...

* server: cap n_predict if not set to n_ctx_train

* server: fix infinite loop

* server: infinite loop, move in process_token
server: infinite loop: set stop limit to true

* minor: spaces

* minor: spaces

* server: include prompt tokens in the EOS limit

2024-04-26 12:15:30 +02:00

154 KiB

Raw Blame History

View Raw