kingbri fc4570220c API + Model: Add new parameters and clean up documentation ...

The example JSON fields were changed because of the new sampler
default strategy. Fix these by manually changing the values.

Also add support for fasttensors and expose generate_window to
the API. It's recommended to not adjust generate_window as it's
dynamically scaled based on max_seq_len by default.

Signed-off-by: kingbri <bdashore3@proton.me>

2024-01-25 00:15:40 -05:00

..

sample_preset.yml

API + Model: Add new parameters and clean up documentation

2024-01-25 00:15:40 -05:00