Kawrakow eaf83865a1 Vision support for Gemma4 (#1635) ...

* WIP: Gemma4 vision

Crashes on the GPU because of rms_norm requiring ne0 to be multiple
of warp_size.
Runs on the CPU, but produces garbage.

* Remove unnecessary assert in CUDA rms_norm

* GLU was not advertised as supported on CUDA

* Still not working

* This seems to work

2026-04-16 17:26:31 +02:00

15 KiB

Raw Blame History

View Raw