kingbri 57b3d69949 API + Model: Add support for JSON schema constraints ...

Add the ability to constrain the return value of a model to be JSON.
Built using the JSON schema standard to define the properties of what
the model should return.

This feature should be more accurate than using GBNF/EBNF to yield
the same results due to the use of lmformatenforcer.

GBNF/EBNF will be added in a different commit/branch.

Signed-off-by: kingbri <bdashore3@proton.me>

2024-02-24 23:40:11 -05:00

..

args.py

Config: Add experimental torch cuda malloc backend

2024-02-14 21:45:56 -05:00

auth.py

Auth: Create keys on different exception

2024-02-04 01:56:42 -05:00

config.py

Launch: Make exllamav2 requirement more friendly

2024-02-02 23:36:17 -05:00

gen_logging.py

Tree: Refactor code organization

2024-01-25 00:15:40 -05:00

generators.py

Tree: Refactor code organization

2024-01-25 00:15:40 -05:00

logger.py

Tree: Refactor code organization

2024-01-25 00:15:40 -05:00

sampling.py

API + Model: Add support for JSON schema constraints

2024-02-24 23:40:11 -05:00

templating.py

API: Add template switching and unload endpoints

2024-01-25 00:15:40 -05:00

utils.py

Sampling: Cleanup and update

2024-02-02 23:36:17 -05:00