kingbri
7b8b3fe23d
Kobold: Fix max length type
...
Was mistakenly a string instead of an integer.
Signed-off-by: kingbri <bdashore3@proton.me >
2024-07-26 23:00:26 -04:00
kingbri
e3226ed930
Kobold: Add untracked file
...
Model types weren't added.
Signed-off-by: kingbri <bdashore3@proton.me >
2024-07-26 22:57:55 -04:00
kingbri
3038f668e8
Kobold: Add extra routes for horde compatability
...
Needed to connect to horde. Also do some reordering to clean the
router file up.
Signed-off-by: kingbri <bdashore3@proton.me >
2024-07-26 22:55:54 -04:00
kingbri
2773517a16
API: Add setup function to routers
...
This helps prepare the router before exposing it to the parent app.
Signed-off-by: kingbri <bdashore3@proton.me >
2024-07-26 22:24:33 -04:00
kingbri
884b6f5ecd
API: Add log options for initialization
...
Make each API log their respective URLs to help inform users.
Signed-off-by: kingbri <bdashore3@proton.me >
2024-07-26 21:32:05 -04:00
kingbri
e8fc13a1f6
Tree: Format
...
Signed-off-by: kingbri <bdashore3@proton.me >
2024-07-26 18:33:04 -04:00
kingbri
ea80b62e30
Sampling: Reorder aliased params and add kobold aliases
...
Also add dynatemp range which is an alternative way of calculating
min and max temp.
Signed-off-by: kingbri <bdashore3@proton.me >
2024-07-26 18:32:33 -04:00
kingbri
7522b1447b
Model: Add support for HuggingFace config and bad_words_ids
...
This is necessary for Kobold's API. Current models use bad_words_ids
in generation_config.json, but for some reason, they're also present
in the model's config.json.
Signed-off-by: kingbri <bdashore3@proton.me >
2024-07-26 18:23:22 -04:00
kingbri
545e26608f
Kobold: Move params to aliases
...
Some of the parameters the API provides are aliases for their OAI
equivalents. It makes more sense to move them to the common file.
Signed-off-by: kingbri <bdashore3@proton.me >
2024-07-26 16:46:54 -04:00
kingbri
b7cb6f0b91
API: Add KoboldAI server
...
Used for interacting with applications that use KoboldAI's API
such as horde.
Signed-off-by: kingbri <bdashore3@proton.me >
2024-07-26 16:37:30 -04:00
