Rattus 8423394577 dynamic_vram: Minimize fast path CPU work ...

Move as much as possible inside the not resident if block and cache
the formed weight and bias rather than the flat intermediates. In
extreme layer weight rates this adds up.

2026-02-12 00:29:46 +10:00

41 KiB

Raw Blame History

View Raw