theroyallab/tabbyAPI
1
0
Fork 0
mirror of https://github.com/theroyallab/tabbyAPI.git synced 2026-03-14 15:57:27 +00:00
Code Issues Packages Projects Releases Wiki Activity

Merge pull request #75 from DocShotgun/main

Browse Source 
Additional clarification for override_base_seq_len
This commit is contained in:
Brian Dashore
2024-03-03 01:30:45 -05:00
committed by GitHub
parent fc857893ee 8245488926
commit de91eade4b
1 changed files with 2 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

3
config_sample.yml
View File

@@ -73,7 +73,8 @@ model:
# Overrides base model context length (default: Empty)
# WARNING: Don't set this unless you know what you're doing!
# Only use this if the model's base sequence length in config.json is incorrect (ex. Mistral/Mixtral models)
# Again, do NOT use this for configuring context length, use max_seq_len above ^
# Only use this if the model's base sequence length in config.json is incorrect (ex. Mistral 7B)
#override_base_seq_len:
# Automatically allocate resources to GPUs (default: True)