Iwan Kawrakow 0137264c6f Adding iq2_bn_r4 ...

This Zen4-only implementation achieves PP-512 = 826 t/s (!!!)
for Bitnet-1.58b-3B, up from 620 t/s for iq2_bn.

2024-12-05 15:18:33 +02:00

..

ggml-alloc.h

Merge mainline llama.cpp (#3)

2024-07-27 07:55:01 +02:00

ggml-backend.h

Bitnet changes (#106)

2024-10-25 13:08:43 +02:00

ggml-blas.h

Merge mainline llama.cpp (#3)

2024-07-27 07:55:01 +02:00

ggml-cann.h

Merge mainline llama.cpp (#3)

2024-07-27 07:55:01 +02:00

ggml-cuda.h

Merge mainline - Aug 12 2024 (#17)

2024-08-12 15:14:32 +02:00

ggml-kompute.h

Merge mainline llama.cpp (#3)

2024-07-27 07:55:01 +02:00

ggml-metal.h

Merge mainline - Aug 12 2024 (#17)

2024-08-12 15:14:32 +02:00

ggml-rpc.h

Merge mainline llama.cpp (#3)

2024-07-27 07:55:01 +02:00

ggml-sycl.h

Merge mainline llama.cpp (#3)

2024-07-27 07:55:01 +02:00

ggml-vulkan.h

Merge mainline llama.cpp (#3)

2024-07-27 07:55:01 +02:00

ggml.h

Adding iq2_bn_r4

2024-12-05 15:18:33 +02:00