turboderp-org/exllamav2
1
0
Fork 0
mirror of https://github.com/turboderp-org/exllamav2.git synced 2026-04-21 06:48:54 +00:00
Code Issues Packages Projects Releases Wiki Activity

Fix layout

Browse Source
This commit is contained in:
turboderp
2024-03-09 06:01:44 +01:00
parent f7c89f4c51
commit 46b7e6ea47
1 changed files with 2 additions and 2 deletions
Download Patch File Download Diff File Expand all files Collapse all files

4
doc/qcache_eval.md
View File

@@ -64,12 +64,12 @@ Mistral 7B Instruct | 3.0 bpw | 43.3% | 47.0% | +3.7%
-- | 5.0 bpw | 51.2% | 51.2% |
-- | 6.0 bpw | 50.6% | 51.2% | +0.6%
-- | FP16 | 49.4% | 53.0% | +3.6%
Mixtral 8x7B | 4.0 bpw | 59.8% | 62.8% | +3.0%
Gemma 7B | 3.0 bpw | 28.7% | 29.9% | +1.2%
-- | 4.0 bpw | 59.8% | 57.9% | -1.9%
-- | 5.0 bpw | 64.0% | 62.8% | -1.2%
-- | 6.0 bpw | 61.5% | 65.2% | +3.7%
- | FP16 | 64.0% | 60.9% | -3.1%
-- | FP16 | 64.0% | 60.9% | -3.1%
Mixtral 8x7B | 4.0 bpw | 59.8% | 62.8% | +3.0%
### Summarization