Radoslav Gerganov ccd01bc441 llama : offload to RPC in addition to other backends (#7640) ...

* llama : offload to RPC in addition to other backends

* - fix copy_tensor being called on the src buffer instead of the dst buffer

- always initialize views in the view_src buffer

- add RPC backend to Makefile build

- add endpoint to all RPC object names

* add rpc-server to Makefile

* Update llama.cpp

Co-authored-by: slaren <slarengh@gmail.com>

---------

Co-authored-by: slaren <slarengh@gmail.com>

2024-06-03 20:03:26 +03:00

40 KiB

Raw Blame History

View Raw