ikawrakow/ik_llama.cpp
1
0
Fork 0
mirror of https://github.com/ikawrakow/ik_llama.cpp.git synced 2026-01-26 17:20:01 +00:00
Code Issues Packages Projects Releases Wiki Activity
4,149 Commits 672 Branches 1 Tag

Default Branch

main

69fdd041c1 · Remove forgotten unused code · Updated 2026-01-26 12:54:21 +00:00
 ZIP  TAR.GZ

Branches

ik/fix_quantized_k_cache

8957ff4963 · This fixes it · Updated 2024-10-24 10:16:06 +00:00    ikawrakow

4149
3473
 ZIP  TAR.GZ
ik/add_granite

8834177686 · Granite: avoid NaNs on CUDA by scaling Q before K*Q multiplication · Updated 2024-10-22 09:35:05 +00:00    ikawrakow

4149
3472
 ZIP  TAR.GZ
ik/fattn_enable_q6_0

5f3e6faac8 · Enable q6_0 for flash attention · Updated 2024-10-21 13:30:10 +00:00    ikawrakow

4149
3470
 ZIP  TAR.GZ
ik/fattn_enable_iq4_nl

599a2b7806 · Fix typo, which is not really a bug · Updated 2024-10-21 10:12:14 +00:00    ikawrakow

4149
3474
 ZIP  TAR.GZ
ik/bitnet_optional_scales

a3fe796f6c · Bitnet: make the scale tensors optional · Updated 2024-10-19 16:37:33 +00:00    ikawrakow

4149
3467
 ZIP  TAR.GZ
ik/cached_graph

0e76d21b96 · Adding agray3's graph caching approach · Updated 2024-10-18 15:01:08 +00:00    ikawrakow

4149
3465
 ZIP  TAR.GZ
ik/fix_reduce_windows

e732da1f57 · Attempt to blindly fix Windows build failure · Updated 2024-10-18 09:35:47 +00:00    ikawrakow

4149
3465
 ZIP  TAR.GZ
ik/iq4_knn

c4292bf2d9 · iq4_knn: Metal - predictably bad · Updated 2024-10-18 08:48:00 +00:00    ikawrakow

4149
3468
 ZIP  TAR.GZ
ik/iq4_kss

9612cd79d6 · iq4_kss: very slightly faster Metal dot product · Updated 2024-10-16 12:08:15 +00:00    ikawrakow

4149
3473
 ZIP  TAR.GZ
ik/metal_faster_iq4ks

3e0c2519d3 · iq4_ks: faster dot product on Metal · Updated 2024-10-16 11:04:59 +00:00    ikawrakow

4149
3462
 ZIP  TAR.GZ
ik/metal_fix_iq3k

55f91a98f1 · iq3_k: slightly faster Metal dot product · Updated 2024-10-14 07:41:26 +00:00    ikawrakow

4149
3461
 ZIP  TAR.GZ
ik/metal_fix_iq2k

f74905d649 · iq2_k: optimize Metal dot product · Updated 2024-10-13 11:09:53 +00:00    ikawrakow

4149
3461
 ZIP  TAR.GZ
ik/iq2k_experiments

f9f15c27b6 · iq2_ks: faster Metal · Updated 2024-10-13 09:23:14 +00:00    ikawrakow

4149
3470
 ZIP  TAR.GZ
ik/better_model_info

e441c897a4 · Better model info · Updated 2024-10-10 14:38:59 +00:00    ikawrakow

4149
3456
 ZIP  TAR.GZ
ik/iq3_ks

e734e888e1 · iq3_ks: AVX2 · Updated 2024-10-10 07:48:42 +00:00    ikawrakow

4149
3463
 ZIP  TAR.GZ
ik/iq4_k_xxs

f61c37967a · iq3_kl: use iq4_ks instead of iq4_k/iq4_xs · Updated 2024-10-09 09:50:43 +00:00    ikawrakow

4149
3467
 ZIP  TAR.GZ
ik/qstats

df2bd86a31 · WIP · Updated 2024-10-06 06:09:51 +00:00    ikawrakow

4149
3458
 ZIP  TAR.GZ
ik/cleanup_fudge_factors

acaa4869af · Move scale fudge factors to quantization · Updated 2024-10-04 13:14:52 +00:00    ikawrakow

4149
3453
 ZIP  TAR.GZ
ik/cpp_17

a553eb191a · Make the entire project c++17 · Updated 2024-10-04 11:23:21 +00:00    ikawrakow

4149
3453
 ZIP  TAR.GZ
ik/skip_unnecessary_quantize

ed477f1cdc · Do not quantize activations if not necessary also for MoE models · Updated 2024-10-04 08:11:02 +00:00    ikawrakow

4149
3452
 ZIP  TAR.GZ