turboderp 224c254083 Logging: Prevent TypeError when reporting metrics (latent bug)

2026-07-15 22:23:38 +02:00

..

actions.py

Config: Make cuda_malloc_async configurable again, change import order to make sure config is loaded before torch is imported

2026-04-17 02:39:16 +02:00

args.py

…

auth.py

Config: Make cuda_malloc_async configurable again, change import order to make sure config is loaded before torch is imported

2026-04-17 02:39:16 +02:00

concurrency.py

…

config_models.py

API: Multiple revisions:

2026-07-15 16:58:31 +02:00

debug_requests.py

Logging: Add comprehensive request logging option

2026-05-27 00:33:45 +02:00

downloader.py

…

errors.py

API: Fix error message/code when context length exceeded

2026-06-15 20:36:25 +02:00

gen_logging.py

Logging: Prevent TypeError when reporting metrics (latent bug)

2026-07-15 22:23:38 +02:00

hardware.py

Dependencies: Update exllamav3, remove xformers and flash-attn

2026-07-15 02:55:20 +02:00

health.py

…

image_util.py

…

logger.py

OAI endpoints: More rework

2026-04-02 01:26:44 +02:00

model.py

Model: Remove redundant enum value

2026-07-15 02:31:50 +02:00

multimodal.py

Fix circular import in vision.py

2026-07-15 01:15:01 +02:00

networking.py

Networking: Add configurable SSE ping interval (default: 15s) to keep alive streaming connections during long prefill

2026-07-15 16:24:46 +02:00

optional_dependencies.py

Dependencies: Update exllamav3, remove xformers and flash-attn

2026-07-15 02:55:20 +02:00

sampling.py

Sampling: Enable grammar and regex filters (already supported by Formatron)

2026-07-15 12:33:23 +02:00

signals.py

Fix Ctrl-C handling

2026-07-15 00:59:24 +02:00

tabby_config.py

…

templating.py

Templating: Move mutable fields to global scope (latent bug)

2026-07-15 12:54:23 +02:00

transformers_utils.py

…

utils.py

…