turboderp 9b6ffdc3b2 exllamav3: Expose loop detect option, enable 800-token window by default

2026-06-16 23:30:16 +02:00

..

actions.py

Config: Make cuda_malloc_async configurable again, change import order to make sure config is loaded before torch is imported

2026-04-17 02:39:16 +02:00

args.py

Ruff: Format (line length)

2026-03-30 00:19:07 +02:00

auth.py

Config: Make cuda_malloc_async configurable again, change import order to make sure config is loaded before torch is imported

2026-04-17 02:39:16 +02:00

concurrency.py

API + Model: Add blocks and checks for various load requests

2024-05-25 21:16:14 -04:00

config_models.py

exllamav3: Add draft_mode option, support MTP and n-gram drafting

2026-06-13 00:12:24 +02:00

debug_requests.py

Logging: Add comprehensive request logging option

2026-05-27 00:33:45 +02:00

downloader.py

Ruff: Format (line length)

2026-03-30 00:19:07 +02:00

errors.py

API: Fix error message/code when context length exceeded

2026-06-15 20:36:25 +02:00

gen_logging.py

Logging: Add draft metrics

2026-06-13 00:29:53 +02:00

hardware.py

Ruff: Format (line length)

2026-03-30 00:19:07 +02:00

health.py

Add health check monitoring for EXL2 errors (#206)

2024-09-22 21:40:36 -04:00

image_util.py

Common: Refactor get_image to common functions

2025-06-15 19:20:36 +02:00

logger.py

OAI endpoints: More rework

2026-04-02 01:26:44 +02:00

model.py

API: Fix error message/code when context length exceeded

2026-06-15 20:36:25 +02:00

multimodal.py

Ruff: Format (line length)

2026-03-30 00:19:07 +02:00

networking.py

API: Fix error message/code when context length exceeded

2026-06-15 20:36:25 +02:00

optional_dependencies.py

Dependencies: Don't try to import exllamav2

2026-06-05 01:58:47 +02:00

sampling.py

exllamav3: Expose loop detect option, enable 800-token window by default

2026-06-16 23:30:16 +02:00

signals.py

Config: Make cuda_malloc_async configurable again, change import order to make sure config is loaded before torch is imported

2026-04-17 02:39:16 +02:00

tabby_config.py

Ruff: Format (line length)

2026-03-30 00:19:07 +02:00

templating.py

OAI endpoints: More rework

2026-04-02 01:26:44 +02:00

transformers_utils.py

Ruff: Format (line length)

2026-03-30 00:19:07 +02:00

utils.py

Ruff: Format (line length)

2026-03-30 00:19:07 +02:00