ostris/ai-toolkit
1
0
Fork 0
mirror of https://github.com/ostris/ai-toolkit.git synced 2026-01-26 16:39:47 +00:00
Code Issues Packages Projects Releases Wiki Activity
912 Commits 10 Branches 0 Tags
323b4aaf5a65b938065c3114fd44b5e55b1af8ac
Commit Graph

5 Commits

Author SHA1 Message Date
Jaret Burkett
323b4aaf5a Do not copy pin memory if it fails, just move 2025-11-17 18:04:00 +00:00
Jaret Burkett
0d8a33dc16 Offload ARA with the layer if doing layer offloading. Add support to offload the LoRA. Still needs optimizer support 2025-10-21 06:03:27 -06:00
Jaret Burkett
55b8b0e23e Fix issue where ARA was not working when using memory manager 2025-10-07 13:39:44 -06:00
Jaret Burkett
c9f982af83 Add support for using quantized models with ramtorch 2025-10-06 13:46:57 -06:00
Jaret Burkett
4e5707854f Initial support for RamTorch. Still a WIP 2025-10-05 13:03:26 -06:00