turboderp 8c9a3ecb49 Add dyn temp options to chat example

2024-01-30 17:51:59 +01:00

..

batched_inference.py

Cleanup examples a bit

2024-01-20 10:57:16 +01:00

cfg.py

CFG support in streaming gen

2024-01-01 23:48:24 +01:00

chat_example.ipynb

Add files via upload

2023-11-23 16:02:50 +01:00

chat_formatting.py

Fixed padding issue

2023-11-29 01:43:20 +01:00

chat_prompts.py

Add nous prompt format

2024-01-19 16:45:37 +01:00

chat.py

Add dyn temp options to chat example

2024-01-30 17:51:59 +01:00

inference.py

Cleanup examples a bit

2024-01-20 10:57:16 +01:00

lora.py

return token probabilities in generator made optional. Change generator examples back to default case

2023-12-24 11:17:29 +00:00

minimal_chat.py

Add minimal chat example

2023-12-31 03:40:56 +01:00

multiple_caches.py

Fix multiple caches not working with 8-bit cache mode

2023-12-17 14:41:21 +01:00

speculative.py

Slight tweaks to SD

2023-12-25 16:54:13 +01:00

streaming.py

Merge branch 'pr-238'

2024-01-20 13:14:21 +01:00

ws_server.py

Update examples (auto GPU split)

2023-10-22 19:32:26 +02:00