turboderp bc99d36bed API: Multiple revisions: ...

- Remove reasoning_suppress_header
- update stream parser to respect multi-token channel tags instead
- make start_in_reasoning configurable (default: existing auto behavior)
- add "object" and "completed" tags to output chunks
- fix "model_name" -> "model"
- add tool_calls_in_reasoning option (default: true, prior behavior)

2026-07-15 16:58:31 +02:00

..

actions.py

Config: Make cuda_malloc_async configurable again, change import order to make sure config is loaded before torch is imported

2026-04-17 02:39:16 +02:00

args.py

Ruff: Format (line length)

2026-03-30 00:19:07 +02:00

auth.py

Config: Make cuda_malloc_async configurable again, change import order to make sure config is loaded before torch is imported

2026-04-17 02:39:16 +02:00

concurrency.py

API + Model: Add blocks and checks for various load requests

2024-05-25 21:16:14 -04:00

config_models.py

API: Multiple revisions:

2026-07-15 16:58:31 +02:00

debug_requests.py

Logging: Add comprehensive request logging option

2026-05-27 00:33:45 +02:00

downloader.py

Ruff: Format (line length)

2026-03-30 00:19:07 +02:00

errors.py

API: Fix error message/code when context length exceeded

2026-06-15 20:36:25 +02:00

gen_logging.py

Logging: Add draft metrics

2026-06-13 00:29:53 +02:00

hardware.py

Dependencies: Update exllamav3, remove xformers and flash-attn

2026-07-15 02:55:20 +02:00

health.py

Add health check monitoring for EXL2 errors (#206)

2024-09-22 21:40:36 -04:00

image_util.py

Common: Refactor get_image to common functions

2025-06-15 19:20:36 +02:00

logger.py

OAI endpoints: More rework

2026-04-02 01:26:44 +02:00

model.py

Model: Remove redundant enum value

2026-07-15 02:31:50 +02:00

multimodal.py

Fix circular import in vision.py

2026-07-15 01:15:01 +02:00

networking.py

Networking: Add configurable SSE ping interval (default: 15s) to keep alive streaming connections during long prefill

2026-07-15 16:24:46 +02:00

optional_dependencies.py

Dependencies: Update exllamav3, remove xformers and flash-attn

2026-07-15 02:55:20 +02:00

sampling.py

Sampling: Enable grammar and regex filters (already supported by Formatron)

2026-07-15 12:33:23 +02:00

signals.py

Fix Ctrl-C handling

2026-07-15 00:59:24 +02:00

tabby_config.py

Ruff: Format (line length)

2026-03-30 00:19:07 +02:00

templating.py

Templating: Move mutable fields to global scope (latent bug)

2026-07-15 12:54:23 +02:00

transformers_utils.py

Ruff: Format (line length)

2026-03-30 00:19:07 +02:00

utils.py

Ruff: Format (line length)

2026-03-30 00:19:07 +02:00