Iwan Kawrakow 062313dab4 iq3_k: Metal dot product ...

Quite slow: 43 t/s for a 7B model

2024-08-01 09:38:06 +02:00

..

ggml-cann

Merge mainline llama.cpp (#3)

2024-07-27 07:55:01 +02:00

ggml-cuda

iq3_k: faster CUDA dot product

2024-08-01 09:38:06 +02:00

ggml-sycl

Merge mainline llama.cpp (#3)

2024-07-27 07:55:01 +02:00

iqk

iq3_k: NEON

2024-08-01 09:38:06 +02:00

kompute @ 4565194ed7

Merge mainline llama.cpp (#3)

2024-07-27 07:55:01 +02:00

kompute-shaders

Merge mainline llama.cpp (#3)

2024-07-27 07:55:01 +02:00

llamafile

Merge mainline llama.cpp (#3)

2024-07-27 07:55:01 +02:00

vulkan-shaders

Merge mainline llama.cpp (#3)

2024-07-27 07:55:01 +02:00

CMakeLists.txt

Factor out iqk CUDA dot products

2024-08-01 09:38:06 +02:00

ggml-aarch64.c

Merge mainline llama.cpp (#3)

2024-07-27 07:55:01 +02:00

ggml-aarch64.h

Merge mainline llama.cpp (#3)

2024-07-27 07:55:01 +02:00

ggml-alloc.c

Merge mainline llama.cpp (#3)

2024-07-27 07:55:01 +02:00

ggml-backend-impl.h

Merge mainline llama.cpp (#3)

2024-07-27 07:55:01 +02:00

ggml-backend.c

Merge mainline llama.cpp (#3)

2024-07-27 07:55:01 +02:00

ggml-blas.cpp

Merge mainline llama.cpp (#3)

2024-07-27 07:55:01 +02:00

ggml-cann.cpp

Merge mainline llama.cpp (#3)

2024-07-27 07:55:01 +02:00

ggml-common.h

iq3_k: Basics

2024-08-01 09:38:06 +02:00

ggml-cuda.cu

iq3_k: Basics

2024-08-01 09:38:06 +02:00

ggml-impl.h

Merge mainline llama.cpp (#3)

2024-07-27 07:55:01 +02:00

ggml-kompute.cpp

Merge mainline llama.cpp (#3)

2024-07-27 07:55:01 +02:00

ggml-metal.m

iq3_k: Metal dequantize

2024-08-01 09:38:06 +02:00

ggml-metal.metal

iq3_k: Metal dot product

2024-08-01 09:38:06 +02:00

ggml-quants.c

iq3_k: Basics

2024-08-01 09:38:06 +02:00

ggml-quants.h

Merge mainline llama.cpp (#3)

2024-07-27 07:55:01 +02:00

ggml-rpc.cpp

Merge mainline llama.cpp (#3)

2024-07-27 07:55:01 +02:00

ggml-sycl.cpp

Merge mainline llama.cpp (#3)

2024-07-27 07:55:01 +02:00

ggml-vulkan.cpp

Merge mainline llama.cpp (#3)

2024-07-27 07:55:01 +02:00

ggml.c

iq3_k: Basics

2024-08-01 09:38:06 +02:00