kingbri eee8b642bd OAI: Implement completion API endpoint ...

Add support for /v1/completions with the option to use streaming
if needed. Also rewrite API endpoints to use async when possible
since that improves request performance.

Model container parameter names also needed rewrites as well and
set fallback cases to their disabled values.

Signed-off-by: kingbri <bdashore3@proton.me>

2023-11-13 18:31:26 -05:00

2.3 KiB

Raw Blame History

View Raw