ikawrakow/ik_llama.cpp
1
0
Fork 0
mirror of https://github.com/ikawrakow/ik_llama.cpp.git synced 2026-03-05 03:20:00 +00:00
Code Issues Packages Projects Releases Wiki Activity
3,728 Commits 738 Branches 1 Tag
8ffad187abbb93b74db8ef813b6fdceec80e02b0
Commit Graph

3 Commits

Author SHA1 Message Date
Kawrakow
f6d5fbdc57 Adding top-n-sigma sampler (#489) 
* Adding top-n-sigma sampler

* Fix typos in XTC PR

* Update README.md for main and server

* More README

* More README

---------

Co-authored-by: Iwan Kawrakow <iwan.kawrakow@gmail.com>
 2025-06-03 17:35:09 +03:00
Kawrakow
ccb265c016 Adding the XTC sampler (#486) 
Co-authored-by: Iwan Kawrakow <iwan.kawrakow@gmail.com>
 2025-06-03 11:32:03 +03:00
Kawrakow
154e0d75fc Merge mainline llama.cpp (#3) 
* Merging mainline - WIP

* Merging mainline - WIP

AVX2 and CUDA appear to work.
CUDA performance seems slightly (~1-2%) lower as it is so often
the case with llama.cpp/ggml after some "improvements" have been made.

* Merging mainline - fix Metal

* Remove check

---------

Co-authored-by: Iwan Kawrakow <iwan.kawrakow@gmail.com>
 2024-07-27 07:55:01 +02:00