TerminalMan 2cda890deb Add health check monitoring for EXL2 errors (#206) ...

* Add health check monitoring for EXL2 errors

* Health: Format and change status code

A status code of 503 makes more sense to use.
---------

2024-09-22 21:40:36 -04:00

..

grammar.py

Grammar: Add custom ExLlamaV2TokenEnforcerFilter class

2024-09-14 21:42:53 +02:00

model.py

Add health check monitoring for EXL2 errors (#206)

2024-09-22 21:40:36 -04:00

utils.py

fix issues with optional dependencies (#204)

2024-09-19 22:24:55 -04:00

version.py

Dependencies: Change handling of exllamav2 checks

2024-09-22 12:57:28 -04:00