Merge mainline llama.cpp (#3)

Browse Source

* Merging mainline - WIP

* Merging mainline - WIP

AVX2 and CUDA appear to work.
CUDA performance seems slightly (~1-2%) lower as it is so often
the case with llama.cpp/ggml after some "improvements" have been made.

* Merging mainline - fix Metal

* Remove check

---------

Co-authored-by: Iwan Kawrakow <iwan.kawrakow@gmail.com>

...

This commit is contained in:

Kawrakow

2024-07-27 07:55:01 +02:00

committed by GitHub

parent 0684c3e9c7

commit 154e0d75fc

612 changed files with 50817 additions and 165936 deletions

Show all changes Ignore whitespace when comparing lines Ignore changes in amount of whitespace Ignore changes in whitespace at EOL

Download Patch File Download Diff File Expand all files Collapse all files

19336

src/llama.cpp Normal file

File diff suppressed because it is too large Load Diff