theroyallab/tabbyAPI
1
0
Fork 0
mirror of https://github.com/theroyallab/tabbyAPI.git synced 2026-03-14 15:57:27 +00:00
Code Issues Packages Projects Releases Wiki Activity

API: Add chat_template_kwargs alias for template_vars

Browse Source 
This key is used in VLLM and SGLang.

Signed-off-by: kingbri <8082010+kingbri1@users.noreply.github.com>
This commit is contained in:
kingbri
2025-05-12 15:33:34 -04:00
parent c9dc0b2aa4
commit 7900b72848
2 changed files with 9 additions and 2 deletions
Download Patch File Download Diff File Expand all files Collapse all files

3
docs/04.-Chat-Completions.md
View File

@@ -23,6 +23,9 @@ A chat completions request to TabbyAPI also supports custom template variables i
}
```
> [!NOTE]
> To preserve compatibility with other standards, `chat_template_kwargs` can be used instead of `template_vars`
Now let's pass the custom var in the following template:
```jinja2
I'm going to say {{ test_var }}