ikawrakow/ik_llama.cpp
1
0
Fork 0
mirror of https://github.com/ikawrakow/ik_llama.cpp.git synced 2026-02-26 08:04:09 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
2dbb3d70bf92b976087cddba4250f06e4849c917
ik_llama.cpp/ggml/include
History
Iwan Kawrakow 6e5d728040 soft_cap_max: initial CPU version of fused softcap + soft_max 
With this vanilla CPU implementation I'm already getting a ~3% speedup
for Gemma-2-9b and a prompt of 8192 tokens.
2024-08-21 13:31:56 +03:00
..
ggml-alloc.h
Merge mainline llama.cpp (#3)
2024-07-27 07:55:01 +02:00
ggml-backend.h
Merge mainline llama.cpp (#3)
2024-07-27 07:55:01 +02:00
ggml-blas.h
Merge mainline llama.cpp (#3)
2024-07-27 07:55:01 +02:00
ggml-cann.h
Merge mainline llama.cpp (#3)
2024-07-27 07:55:01 +02:00
ggml-cuda.h
Merge mainline - Aug 12 2024 (#17)
2024-08-12 15:14:32 +02:00
ggml-kompute.h
Merge mainline llama.cpp (#3)
2024-07-27 07:55:01 +02:00
ggml-metal.h
Merge mainline - Aug 12 2024 (#17)
2024-08-12 15:14:32 +02:00
ggml-rpc.h
Merge mainline llama.cpp (#3)
2024-07-27 07:55:01 +02:00
ggml-sycl.h
Merge mainline llama.cpp (#3)
2024-07-27 07:55:01 +02:00
ggml-vulkan.h
Merge mainline llama.cpp (#3)
2024-07-27 07:55:01 +02:00
ggml.h
soft_cap_max: initial CPU version of fused softcap + soft_max
2024-08-21 13:31:56 +03:00