0cc4m f030ec1f7a Vulkan Embedding Fix (#7360) ...

* Fix empty Vulkan host buffers

Add fp32 fp16 matmul shader

Fix matmul shader alignment

* Remove deprecated tensor->backend uses

* Fix Vulkan validation errors on embedding models with no offloaded layers

* Fix Vulkan llava segfault when not offloading layers

2024-05-19 17:19:53 +02:00

4.7 MiB

Raw Blame History

View Raw