Files
ik_llama.cpp/github-data/pull_requests/144 - Slightly faster IQ4_K_R4 on AVX2_Zen4.md
2025-07-23 13:31:53 +02:00

366 B

🔀 #144 - Slightly faster IQ4_K_R4 on AVX2/Zen4

Author ikawrakow
State Closed
Created 2024-12-16
Updated 2024-12-16

Description

We get PP-512(LLaMA-3.1-8B) = 251 t/s (Ryzen-7950X) or 249 t/s (Ryzen-5975WX), up from 232/227 t/s.