Faster iq4_xs_r4 on Zen4

The trick is to simply prepare the Q8 block sums for
blocks of 32 as floats. This brings PP-512 up to 254.6 t/s
from 224 t/s.
This commit is contained in:
Iwan Kawrakow
2024-12-08 15:44:49 +02:00
parent fc701cedd1
commit 5de1cf4885
5 changed files with 54 additions and 25 deletions

View File

@@ -407,6 +407,7 @@ extern "C" {
GGML_TYPE_IQ2_KS = 145,
GGML_TYPE_IQ4_KSS = 146,
GGML_TYPE_Q8_K16 = 147,
GGML_TYPE_Q8_K32 = 148,
GGML_TYPE_Q4_0_R4 = 202,
GGML_TYPE_Q5_0_R4 = 206,