turboderp 7964c73241 Add sampling settings as cmdline options to chat example

2023-09-05 14:32:02 +02:00

..

chat.py

Add sampling settings as cmdline options to chat example

2023-09-05 14:32:02 +02:00

inference.py

Reworking attention, allow for batched inference with independent cache per sequence

2023-09-03 15:56:38 +02:00

streaming.py

Tidying up

2023-09-02 16:40:57 +02:00