2 Commits

Author	SHA1	Message	Date
kingbri	5d32aa02cd	Tree: Update to use ModelContainer and args ... Use command-line arguments to load an initial model if necessary. API routes are broken, but we should be using the container from now on as a primary interface with the exllama2 library. Also these args should be turned into a YAML configuration file in the future. Signed-off-by: kingbri <bdashore3@proton.me>	2023-11-10 23:19:54 -05:00
turboderp	9d34479e3e	Model container with generator logic, initial	2023-11-11 02:53:00 +01:00