theroyallab/tabbyAPI
1
0
Fork 0
mirror of https://github.com/theroyallab/tabbyAPI.git synced 2026-03-15 00:07:28 +00:00
Code Issues Packages Projects Releases Wiki Activity
155 Commits 4 Branches 0 Tags
de9a19b5d3777090b6a279daf2b0f42ebf356942
Commit Graph

3 Commits

Author SHA1 Message Date
kingbri
de9a19b5d3 Templating: Add generation prompt appending 
Append generation prompts if given the flag on an OAI chat completion
request.

This appends the "assistant" message to the instruct prompt. Defaults
to true since this is intended behavior.

Signed-off-by: kingbri <bdashore3@proton.me>
 2023-12-18 23:53:47 -05:00
kingbri
7cbc08fc72 Templates: Add auto-detection from path 
This replicates FastChat's model path detection.

Signed-off-by: kingbri <bdashore3@proton.me>
 2023-12-18 23:53:47 -05:00
kingbri
f631dd6ff7 Templates: Switch to Jinja2 
Jinja2 is a lightweight template parser that's used in Transformers
for parsing chat completions. It's much more efficient than Fastchat
and can be imported as part of requirements.

Also allows for unblocking Pydantic's version.

Users now have to provide their own template if needed. A separate
repo may be usable for common prompt template storage.

Signed-off-by: kingbri <bdashore3@proton.me>
 2023-12-18 23:53:47 -05:00