kingbri c67c9f6d66 Model + Config: Remove low_mem option ...

Low_mem doesn't work in exl2 and it was an experimental option to
begin with. Keep the loading code commented out in case it gets fixed
in the future.

A better alternative is to use 8bit cache which works and helps save
VRAM.

Signed-off-by: kingbri <bdashore3@proton.me>

2023-12-03 01:07:42 -05:00

18 KiB

Raw Blame History

View Raw