turboderp ed97bbb2af Model: Add draft_num_tokens config option, update model container to forward draft and bsz args to backend

2026-05-23 00:40:42 +02:00

..

exllamav2

API: Accept JSON schema in request.response_format.json_schema, delay JSON filter until start of content block

2026-05-02 20:29:59 +02:00

exllamav3

Model: Add draft_num_tokens config option, update model container to forward draft and bsz args to backend

2026-05-23 00:40:42 +02:00

infinity

Model: Add proper jobs cleanup and fix var calls

2025-04-24 21:30:55 -04:00

base_model_container.py

API: Accept JSON schema in request.response_format.json_schema, delay JSON filter until start of content block

2026-05-02 20:29:59 +02:00