kingbri 63650d2c3c Model: Disable banned strings if grammar is used ...

ExllamaV2 filters don't allow for rewinding which is what banned
strings uses. Therefore, constrained generation via LMFE or outlines
is not compatible for now.

Signed-off-by: kingbri <bdashore3@proton.me>

2024-08-05 11:08:58 -04:00

..

exllamav2

Model: Disable banned strings if grammar is used

2024-08-05 11:08:58 -04:00

infinity

Embeddings: Update config, args, and parameter names

2024-07-30 15:32:26 -04:00