kingbri ce2602df9a Model: Fix max seq len handling ...

Previously, the max sequence length was overriden by the user's
config and never took the model's config.json into account.

Now, set the default to 4096, but include config.prepare when
selecting the max sequence length. The yaml and API request
now serve as overrides rather than parameters.

Signed-off-by: kingbri <bdashore3@proton.me>

2023-12-19 23:37:52 -05:00

..

types

Model: Fix max seq len handling

2023-12-19 23:37:52 -05:00

utils.py

Templates: Switch to Jinja2

2023-12-18 23:53:47 -05:00