Various bug fixes and optimizations for quantized training. Added untested custom adam8bit optimizer. Did some work on LoRM (dont use)

This commit is contained in:
Jaret Burkett
2024-11-20 09:16:55 -07:00
parent 6509ba4484
commit 894374b2e9
7 changed files with 241 additions and 18 deletions

4
.gitignore vendored
View File

@@ -175,4 +175,6 @@ cython_debug/
!/extensions/example
/temp
/wandb
.vscode/settings.json
.vscode/settings.json
.DS_Store
._.DS_Store