Iwan Kawrakow 0137264c6f Adding iq2_bn_r4 ...

This Zen4-only implementation achieves PP-512 = 826 t/s (!!!)
for Bitnet-1.58b-3B, up from 620 t/s for iq2_bn.

2024-12-05 15:18:33 +02:00

..

CMakeLists.txt

Merge mainline llama.cpp (#3)

2024-07-27 07:55:01 +02:00

llama-grammar.cpp

Merge mainline - Aug 12 2024 (#17)

2024-08-12 15:14:32 +02:00

llama-grammar.h

Merge mainline llama.cpp (#3)

2024-07-27 07:55:01 +02:00

llama-impl.h

Time to fix replace_all (#68)

2024-09-28 17:59:47 +03:00

llama-sampling.cpp

Merge mainline llama.cpp (#3)

2024-07-27 07:55:01 +02:00

llama-sampling.h

Merge mainline llama.cpp (#3)

2024-07-27 07:55:01 +02:00

llama-vocab.cpp

Merge mainline - Aug 12 2024 (#17)

2024-08-12 15:14:32 +02:00

llama-vocab.h

Merge mainline - Aug 12 2024 (#17)

2024-08-12 15:14:32 +02:00

llama.cpp

Adding iq2_bn_r4

2024-12-05 15:18:33 +02:00

unicode-data.cpp

Merge mainline llama.cpp (#3)

2024-07-27 07:55:01 +02:00

unicode-data.h

Merge mainline llama.cpp (#3)

2024-07-27 07:55:01 +02:00

unicode.cpp

Merge mainline llama.cpp (#3)

2024-07-27 07:55:01 +02:00

unicode.h

Merge mainline llama.cpp (#3)

2024-07-27 07:55:01 +02:00