ikawrakow/ik_llama.cpp
1
0
Fork 0
mirror of https://github.com/ikawrakow/ik_llama.cpp.git synced 2026-04-24 08:29:29 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
3d0112261042b356621e93db3fa4c6798a5d098f
ik_llama.cpp/ggml-opencl.cpp
Howard Su 58970a4c39 Leverage mmap for offloading tensors to GPU (#1597) 
* Rebase to latest

* Show progress

* Add assert to make sure we only allocate temp buffer for non-CPU backend tensor

Co-authored-by: Johannes Gäßler <johannesg@5d6.de>

---------

Co-authored-by: Johannes Gäßler <johannesg@5d6.de>
2023-06-12 14:44:16 +02:00

43 KiB
Raw Blame History

View Raw
Reference in New Issue View Git Blame Copy Permalink