turboderp 195de2a40d Networking: Add configurable SSE ping interval (default: 15s) to keep alive streaming connections during long prefill

2026-07-15 16:24:46 +02:00

..

types

API: Fix v1/token/encode endpoint after regression

2026-06-27 02:40:35 +02:00

utils

Model: Load in a detached task so client disconnecting doesn't cancel an in-progress load.

2026-07-15 02:03:03 +02:00

router.py

Networking: Add configurable SSE ping interval (default: 15s) to keep alive streaming connections during long prefill

2026-07-15 16:24:46 +02:00