kingbri 5d32aa02cd Tree: Update to use ModelContainer and args ...

Use command-line arguments to load an initial model if necessary.
API routes are broken, but we should be using the container from
now on as a primary interface with the exllama2 library.

Also these args should be turned into a YAML configuration file in
the future.

Signed-off-by: kingbri <bdashore3@proton.me>

2023-11-10 23:19:54 -05:00

12 KiB

Raw Blame History

View Raw