Files
tabbyAPI/TabbyAPI_Colab_Example.ipynb
DocShotgun 67507105d0 Update colab, expose additional args
* Exposed draft model args for speculative decoding
* Exposed int8 cache, dummy models, and no flash attention
* Resolved CUDA 11.8 dependency issue
2023-12-04 22:20:46 -08:00

7.3 KiB