kingbri 7e007f0761 Model: Handle finish chunks and logprobs in separate functions ...

Helps split up and trim the generate_gen function.

Signed-off-by: kingbri <8082010+kingbri1@users.noreply.github.com>

2025-04-24 21:19:03 -04:00

..

exllamav2

Model: Handle finish chunks and logprobs in separate functions

2025-04-24 21:19:03 -04:00

infinity

Model: Reject model requests when unloading

2025-04-19 22:34:06 -04:00

base_model_container.py

Tree: Format

2025-04-21 23:21:26 -04:00