kingbri 75af974c88 Model: Raise an error if the context length is too large ...

The dynamic generator gave a not-so-helpful exception already which
basically said to not exceed the max sequence length. Instead of
possible undefined behavior, error out.

Signed-off-by: kingbri <bdashore3@proton.me>

2024-09-19 22:05:56 -04:00

..

exllamav2

Model: Raise an error if the context length is too large

2024-09-19 22:05:56 -04:00

infinity

remove logging

2024-09-04 16:14:09 +01:00