turboderp-org/exllamav2
1
0
Fork 0
mirror of https://github.com/turboderp-org/exllamav2.git synced 2026-04-20 14:29:28 +00:00
Code Issues Packages Projects Releases Wiki Activity

typo

Browse Source
This commit is contained in:
turboderp
2024-04-12 23:41:33 +02:00
parent 324404ebe4
commit f99f7894a7
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
doc/qcache_eval.md
View File

@@ -31,7 +31,7 @@ Mixtral 8x7B | 3.5 bpw | **10.27** | 10.41 | 10.39 | **10.32**
-- | 5.0 bpw | **10.02** | 10.16 | 10.15 | **10.04**
Llama2 7B | 4.0 bpw | **11.43** | 11.92 | 11.74 | **11.60**
-- | 5.0 bpw | **11.13** | 11.40 | 11.31 | **11.19**
-- | FP16 | **10.91** | 11.24 | 11.16 | **10.05**
-- | FP16 | **10.91** | 11.24 | 11.16 | **11.05**
### HumanEval