turboderp-org/exllamav2
1
0
Fork 0
mirror of https://github.com/turboderp-org/exllamav2.git synced 2026-04-20 14:29:28 +00:00
Code Issues Packages Projects Releases Wiki Activity
1,444 Commits 3 Branches 43 Tags
a08ef4f1edd767a2ceefa6f16a17bc9526e95ab0
Commit Graph

42 Commits

Author SHA1 Message Date
turboderp
a72b73fc89 Update README.md (#593) 2024-08-20 01:00:49 +02:00
turboderp
373bcc187e Update benchmarks 2024-08-20 00:48:55 +02:00
turboderp
61e30923e6 Update benchmarks after graphs 2024-08-15 22:59:10 +02:00
turboderp
de05ac696b Add more sh tags 2024-06-08 20:41:34 +02:00
Timon Käch
95c16a8bc8 Make comments real comments (#491) 
Co-authored-by: turboderp <11859846+turboderp@users.noreply.github.com>
 2024-06-08 20:39:44 +02:00
turboderp
5ca51dd5d8 Dynamic generator writeup 2024-06-08 20:26:52 +02:00
turboderp
e4ef7cfef2 Docs for eval scripts 2024-06-08 15:48:20 +02:00
RodriMora
7fad4f3ec2 Added steps to benchmark in README (#488) 
* Added steps to benchmark using the included mmlu script

* Added steps to benchmark using the included mmlu script
 2024-06-06 17:22:57 +02:00
turboderp
e6f230bf06 Update README.md 2024-05-25 22:50:36 +02:00
Thanasis Galianis
9e709085e9 Fix installation step & add multi-GPU explanation 2024-03-18 21:30:36 +02:00
Teresa
c25b530900 quanting community 2024-03-11 22:46:26 -07:00
turboderp
ef5ca7bce8 Update benchmark results 2024-03-11 22:15:34 +01:00
turboderp
5080cbbff2 Update speed benchmark 2024-03-10 19:13:54 +01:00
Saifeddine ALOUI
1de788fb85 Updated README.md to add lollms-webui to supported webuis 
I added a line about lollms-webui who supports exllamav2 via the exllamav2 binding.
 2024-02-25 11:14:37 +01:00
turboderp
c0ddebaaaf Update install instructions, remove V1 benchmark 2024-02-02 16:24:19 +01:00
turboderp
13fe676ac2 Link to bartowski repos 2023-12-31 22:04:33 +01:00
turboderp
79eb742bcf Update README.md 2023-12-16 22:06:44 +01:00
turboderp
b30e920ef4 Update readme 2023-11-23 01:25:06 +01:00
turboderp
a2a1743b3d Update README.md 2023-10-22 20:32:49 +02:00
turboderp
30ab940bd9 Update README.md 2023-10-15 23:46:19 +02:00
turboderp
723bce44d0 Merge speculative generator logic into streaming generator 2023-10-13 23:33:24 +02:00
turboderp
7b5dccb770 Update README.md 2023-10-07 21:54:12 +02:00
turboderp
f54f62de9c Update README.md 2023-10-04 11:12:52 +02:00
Sinan Akkoyun
025385da77 Added chatcode.py to readme 2023-09-29 17:54:10 +02:00
turboderp
9385fefc00 Updated installation instructions 2023-09-27 13:19:22 +02:00
turboderp
0494261f3e Update README.md, some documentation for convert.py 2023-09-18 19:49:33 +02:00
turboderp
1cefef9548 Progress update 2023-09-16 15:22:25 +02:00
turboderp
024ffc5bc6 Update README.md 2023-09-13 04:22:31 +02:00
turboderp
a6f0f9c546 Fix mistake re: context length 2023-09-12 14:38:40 +02:00
turboderp
b1eee8f675 Fix typo 2023-09-12 14:29:33 +02:00
turboderp
dff50819c9 Fix typo 2023-09-12 14:10:41 +02:00
turboderp
38c1d7beeb Update README.md 2023-09-12 12:43:37 +02:00
turboderp
06962ef951 Update README.md 2023-09-12 12:38:08 +02:00
turboderp
f00c4e4933 Update README.md 2023-09-12 11:57:28 +02:00
turboderp
ec3d870a0b Update README.md 2023-09-12 10:04:07 +02:00
turboderp
8e3cd01889 Update README.md 2023-09-12 06:52:04 +02:00
turboderp
c240eb0b70 Update README.md 2023-09-12 06:41:36 +02:00
turboderp
27bccf02d3 Clean up Torch extension script 2023-09-11 07:21:55 +02:00
turboderp
8f9617dd5d Fix image link 2023-09-10 18:58:54 +02:00
turboderp
f3ef397656 Add README.md 2023-09-10 15:42:38 +02:00
turboderp
ddaf503e98 Add README.md 2023-09-10 14:16:53 +02:00
turboderp
03fb9db2e0 Initial commit 2023-08-30 10:54:23 +02:00