3 Commits

Author	SHA1	Message	Date
kingbri	eee8b642bd	OAI: Implement completion API endpoint ... Add support for /v1/completions with the option to use streaming if needed. Also rewrite API endpoints to use async when possible since that improves request performance. Model container parameter names also needed rewrites as well and set fallback cases to their disabled values. Signed-off-by: kingbri <bdashore3@proton.me>	2023-11-13 18:31:26 -05:00
kingbri	a10c14d357	Config: Switch to YAML and add load progress ... YAML is a more flexible format when it comes to configuration. Commandline arguments are difficult to remember and configure especially for an API with complicated commandline names. Rather than using half-baked textfiles, implement a proper config solution. Also add a progress bar when loading models in the commandline. Signed-off-by: kingbri <bdashore3@proton.me>	2023-11-12 00:21:16 -05:00
david	b967e2e604	Initial	2023-11-09 21:27:45 -06:00