mirror of
https://github.com/ikawrakow/ik_llama.cpp.git
synced 2026-01-26 09:09:50 +00:00
335 B
335 B
🔀 #111 - Use fused mul - unary op also for MoE models
| Author | ikawrakow |
|---|---|
| State | ❌ Closed |
| Created | 2024-10-26 |
| Updated | 2024-10-26 |
Description
This gives us a ~1% speedup for MoE models on CUDA and Metal.