Iwan Kawrakow 426a6e685f iq2_kt: CUDA dequantize ...

so we can run perplexity calcs.
As already indicated by rmse, the 2-bit trellis approach is
quite a bit worse than iq2_xxs.

2024-11-21 08:16:41 +02:00

..

CMakeLists.txt

Merge mainline llama.cpp (#3)

2024-07-27 07:55:01 +02:00

llama-grammar.cpp

Merge mainline - Aug 12 2024 (#17)

2024-08-12 15:14:32 +02:00

llama-grammar.h

Merge mainline llama.cpp (#3)

2024-07-27 07:55:01 +02:00

llama-impl.h

Time to fix replace_all (#68)

2024-09-28 17:59:47 +03:00

llama-sampling.cpp

Merge mainline llama.cpp (#3)

2024-07-27 07:55:01 +02:00

llama-sampling.h

Merge mainline llama.cpp (#3)

2024-07-27 07:55:01 +02:00

llama-vocab.cpp

Merge mainline - Aug 12 2024 (#17)

2024-08-12 15:14:32 +02:00

llama-vocab.h

Merge mainline - Aug 12 2024 (#17)

2024-08-12 15:14:32 +02:00

llama.cpp

iq2_kt: CUDA dequantize

2024-11-21 08:16:41 +02:00

unicode-data.cpp

Merge mainline llama.cpp (#3)

2024-07-27 07:55:01 +02:00

unicode-data.h

Merge mainline llama.cpp (#3)

2024-07-27 07:55:01 +02:00

unicode.cpp

Merge mainline llama.cpp (#3)

2024-07-27 07:55:01 +02:00

unicode.h

Merge mainline llama.cpp (#3)

2024-07-27 07:55:01 +02:00