mirror of
https://github.com/theroyallab/tabbyAPI.git
synced 2026-03-15 00:07:28 +00:00
44 lines
1.4 KiB
Markdown
44 lines
1.4 KiB
Markdown
# TabbyAPI
|
|
|
|
> [!NOTE]
|
|
>
|
|
> Need help? Join the [Discord Server](https://discord.gg/sYQxnuD7Fj) and get the `Tabby` role. Please be nice when asking questions.
|
|
|
|
A FastAPI based application that allows for generating text using an LLM (large language model) using the https://github.com/turboderp/exllamav2.
|
|
|
|
## Disclaimer
|
|
|
|
This API is still in the alpha phase. There may be bugs and changes down the line. Please be aware that you might need to reinstall dependencies if needed.
|
|
|
|
### Help Wanted
|
|
|
|
Please check the issues page for issues that contributors can help on. We appreciate all contributions. Please read the contributions section for more details about issues and pull requests.
|
|
|
|
If you want to add samplers, add them in the [exllamav2 library](https://github.com/turboderp/exllamav2) and then link them to tabbyAPI.
|
|
|
|
## Getting Started
|
|
|
|
Read the [Wiki](https://github.com/theroyallab/tabbyAPI/wiki) for more information. It contains user-facing documentation for installation, configuration, sampling, API usage, and so much more.
|
|
|
|
## Contributing
|
|
|
|
If you have issues with the project:
|
|
|
|
- Describe the issues in detail
|
|
|
|
- If you have a feature request, please indicate it as such.
|
|
|
|
If you have a Pull Request
|
|
|
|
- Describe the pull request in detail, what, and why you are changing something
|
|
|
|
## Developers and Permissions
|
|
|
|
Creators/Developers:
|
|
|
|
- [kingbri](https://github.com/bdashore3)
|
|
|
|
- [Splice86](https://github.com/Splice86)
|
|
|
|
- [Turboderp](https://github.com/turboderp)
|