kingbri 58590a6c57 Config: Add option to force streaming off ...

Many APIs automatically ask for request streaming without giving
the user the option to turn it off. Therefore, give the user more
freedom by giving a server-side kill switch.

Signed-off-by: kingbri <bdashore3@proton.me>

2024-02-07 21:09:59 -05:00

..

args.py

Config: Add option to force streaming off

2024-02-07 21:09:59 -05:00

auth.py

Auth: Create keys on different exception

2024-02-04 01:56:42 -05:00

config.py

Launch: Make exllamav2 requirement more friendly

2024-02-02 23:36:17 -05:00

gen_logging.py

Tree: Refactor code organization

2024-01-25 00:15:40 -05:00

generators.py

Tree: Refactor code organization

2024-01-25 00:15:40 -05:00

logger.py

Tree: Refactor code organization

2024-01-25 00:15:40 -05:00

sampling.py

Adds aliases for min_temp and max_temp (#58)

2024-02-03 21:51:29 -05:00

templating.py

API: Add template switching and unload endpoints

2024-01-25 00:15:40 -05:00

utils.py

Sampling: Cleanup and update

2024-02-02 23:36:17 -05:00