TavernAI - Extras

[TOC]

What is this

A set of unofficial APIs for various TavernAI extensions

How to run

• Install Python 3.10
• Run pip install -r requirements.txt
• Run python server.py

Included functionality

BLIP model for image captioning

POST /api/caption

Input

{ "image": "base64 encoded image" }

Output

{ "caption": "caption of the posted image" }

BART model for text summarization

POST /api/summarize

Input

{ "text": "text to be summarize", "params": {} }

Output

{ "summary": "summarized text" }

Optional: params object for control over summarization:

Name	Default value
temperature	1.0
repetition_penalty	1.0
max_length	500
min_length	200
length_penalty	1.5
bad_words	["\n", '"', "*", "[", "]", "{", "}", ":", "(", ")", "<", ">"]

BERT model for text classification

POST /api/classify

Input

{ "text": "text to classify sentiment of" }

Output

{
    "classification": [
        {
            "label": "joy",
            "score": 1.0
        },
        {
            "label": "anger",
            "score": 0.7
        },
        {
            "label": "love",
            "score": 0.6
        },
        {
            "label": "sadness",
            "score": 0.5
        },
        {
            "label": "fear",
            "score": 0.4
        },
        {
            "label": "surprise",
            "score": 0.3
        }
    ]
}

NOTES

1. Sorted by descending score order
2. Six fixed categories
3. Value range from 0.0 to 1.0

Additional options

Flag	Description
--port	Specify the port on which the application is hosted. Default: 5100
--listen	Hosts the app on the local network
--share	Shares the app on CloudFlare tunnel
--cpu	Run the models on the CPU instead of CUDA
--bart-model	Load a custom BART model. Expects a HuggingFace model ID. Default: Qiliang/bart-large-cnn-samsum-ChatGPT_v3
--bert-model	Load a custom BERT model. Expects a HuggingFace model ID. Default: bhadresh-savani/distilbert-base-uncased-emotion
--blip-model	Load a custom BLIP model. Expects a HuggingFace model Id. Default: Salesforce/blip-image-captioning-base