Iwan Kawrakow 2cc6338670 iq2_tn: CUDA ...

For TriLM-3.9B running on RTX-4080 we get PP-512 = 9936 t/s,
TG-128 = 299.2 t/s.

2024-08-06 10:06:39 +03:00

..

cmake

Merge mainline llama.cpp (#3)

2024-07-27 07:55:01 +02:00

include

iq2_tn: TriLM specific 2.0625 bpw quantization

2024-08-05 14:22:05 +03:00

src

iq2_tn: CUDA

2024-08-06 10:06:39 +03:00

.gitignore

Merge mainline llama.cpp (#3)

2024-07-27 07:55:01 +02:00

CMakeLists.txt

Merge mainline llama.cpp (#3)

2024-07-27 07:55:01 +02:00