turboderp-org/exllamav3
1
0
Fork 0
mirror of https://github.com/turboderp-org/exllamav3.git synced 2026-04-24 16:29:11 +00:00
Code Issues Packages Projects Releases Wiki Activity
729 Commits 3 Branches 30 Tags
1647c653e4500d2c3c9c853d888b9a3245b17ab8
Commit Graph

35 Commits

Author SHA1 Message Date
turboderp
1647c653e4 chat.py: Command help and think mode toggle 2026-03-03 23:15:07 +01:00
turboderp
a6cf34574b chat.py: Limit frequency of markdown renders 2026-03-03 22:46:32 +01:00
turboderp
c8c2e6178c chat.py: Catbench shortcut 2026-03-01 17:57:55 +01:00
turboderp
18b2a23d8a chat.py: Fix error message 2026-03-01 15:10:22 +01:00
turboderp
288a98f5e3 Refactor sampler args for examples 2026-01-11 12:33:27 +01:00
turboderp
6e75e7b151 chat.py: Fix for models with eos_token_id=null 2026-01-04 02:02:10 +01:00
turboderp
e8b77bba4a chat.py: Fix prompt tokens/s display 2025-12-25 23:18:50 +01:00
turboderp
80907797a5 chat.py: Add debug mode 2025-12-25 23:18:25 +01:00
turboderp
d8be5d638f chat.py: Read all stop conditions from config.json 2025-12-10 00:53:45 +01:00
turboderp
7c6b6c473f chat.py: Allow breaking stream with esc 2025-11-13 12:55:32 +01:00
turboderp
0bd0bfa17d chat.py: Token dump feature 2025-11-13 12:54:34 +01:00
turboderp
c3886f0841 chat.py: Don't crash on wrong stop conditions 2025-11-13 12:53:23 +01:00
turboderp
1dff8123a6 chat.py: Better SVG extract 2025-11-13 12:52:46 +01:00
turboderp
fab5da05ce chat.py: Better SVG extraction 2025-11-02 23:54:22 +01:00
turboderp
a358e845c1 chat.py: Add (SVG) save option 2025-11-01 14:51:06 +01:00
turboderp
59e3304da1 chat.py: Add Apertus template 2025-09-04 00:38:51 +02:00
turboderp
40fd9d3857 chat.py: Add Seed-OSS template 2025-08-24 21:40:26 +02:00
turboderp
c1b469c0ea chat.py: Add single-prompt-and-exit option 2025-08-12 18:26:16 +02:00
turboderp
921f0c4155 chat.py: Add Ctrl-C hook for cleaner multiprocess exit 2025-07-29 22:01:45 +02:00
turboderp
e12a1a5d0b chat.py: Add some more commands 2025-07-10 18:32:27 +02:00
turboderp
4f0414a1e9 chat.py: Add SmolLM3 template 2025-07-09 03:24:36 +02:00
turboderp
b2b0980972 chat.py: Fix t/s display 2025-07-07 12:55:03 +02:00
turboderp
ea4ef8dcbb Chat.py: Add stats 2025-06-06 03:43:41 +02:00
turboderp
98964cbdae chat.py: Allow listing supported modes without specifying valid mode 2025-06-05 02:26:00 +02:00
turboderp
769ddb34b0 chat.py: Add some more functionality 2025-05-17 12:33:22 +02:00
turboderp
e0cfb2e93c chat.py: Add copy to clipboard feature 2025-05-11 11:26:48 +02:00
turboderp
a027848ddc Fix top-K float type 2025-05-11 11:15:56 +02:00
turboderp
7488d82c24 chat.py: Add option to suppress think tags 2025-04-29 22:34:32 +02:00
turboderp
fc543509c6 chat.py: Add sampler args 2025-04-27 01:10:07 +02:00
turboderp
10b95addc0 chat.py: Add Reka chat/reasoning template 2025-04-25 01:44:47 +02:00
turboderp
f93b010303 chat.py: Add amnesia mode 2025-04-25 00:48:18 +02:00
turboderp
872e698b8b Refactor chat.py a bit, nicer Markdown streaming (rich.live messes up terminal when scrolling) 2025-04-14 02:57:05 +02:00
turboderp
3129b748ff Support multiline input and simple <think></think> reasoning mode in chat.py 2025-04-13 20:59:28 +02:00
turboderp
4c7b1e2948 Add Markdown support to example chatbot 2025-04-12 03:26:05 +02:00
turboderp
543c4b2771 Initial commit 2025-04-06 14:42:49 +02:00