kingbri b9e5693c1b API + Model: Apply config.yml defaults for all load paths ...

There are two ways to load a model:
1. Via the load endpoint
2. Inline with a completion

The defaults were not applying on the inline load, so rewrite to fix
that. However, while doing this, set up a defaults dictionary rather
than comparing it at runtime and remove the pydantic default lambda
on all the model load fields.

This makes the code cleaner and establishes a clear config tree for
loading models.

Signed-off-by: kingbri <bdashore3@proton.me>

2024-09-10 23:35:35 -04:00

..

args.py

Config: Use an explicit "auto" value for rope_alpha

2024-08-31 22:59:56 -04:00

auth.py

Tree: Switch to asynchronous file handling

2024-09-10 16:45:14 -04:00

concurrency.py

API + Model: Add blocks and checks for various load requests

2024-05-25 21:16:14 -04:00

downloader.py

Config: Migrate to global class instead of dicts

2024-09-04 23:18:47 -04:00

gen_logging.py

Model: Attach request ID to logs

2024-08-01 00:25:54 -04:00

logger.py

API: Add HuggingFace downloader

2024-04-29 01:15:02 -04:00

model.py

API + Model: Apply config.yml defaults for all load paths

2024-09-10 23:35:35 -04:00

networking.py

Config: Migrate to global class instead of dicts

2024-09-04 23:18:47 -04:00

sampling.py

Tree: Switch to asynchronous file handling

2024-09-10 16:45:14 -04:00

signals.py

Model: Bypass lock checks when shutting down

2024-08-03 16:05:34 -04:00

tabby_config.py

API + Model: Apply config.yml defaults for all load paths

2024-09-10 23:35:35 -04:00

templating.py

Tree: Fix classmethod usage

2024-09-10 20:52:29 -04:00

transformers_utils.py

Transformers Utils: Fix file read

2024-09-10 22:41:39 -04:00

utils.py

Config: Migrate to global class instead of dicts

2024-09-04 23:18:47 -04:00