rattus 361b9a82a3 fix pinning with model defined dtype (#12208) ...

pinned memory was converted back to pinning the CPU side weight without
any changes. Fix the pinner to use the CPU weight and not the model defined
geometry. This will either save RAM or stop buffer overruns when the types
mismatch.

Fix the model defined weight caster to use the [ s.weight, s.bias ]
interpretation, as xfer_dest might be the flattened pin now. Fix the detection
of needing to cast to not be conditional on !pin.

2026-02-01 08:42:32 -08:00

856 B

Raw Blame History

View Raw