turboderp-org/exllamav2
1
0
Fork 0
mirror of https://github.com/turboderp-org/exllamav2.git synced 2026-04-20 14:29:28 +00:00
Code Issues Packages Projects Releases Wiki Activity

Use os.replace to swap checkpoint states in measure.py as well

Browse Source
This commit is contained in:
turboderp
2024-02-01 04:39:34 +01:00
parent a1c8b790f1
commit 735807e800
1 changed files with 1 additions and 2 deletions
Download Patch File Download Diff File Expand all files Collapse all files

3
conversion/measure.py
View File

@@ -516,8 +516,7 @@ def measure_quant(job, save_fn, model):
job["invalid"] = True
save_fn()
os.remove(states_filename)
os.rename(temp_filename, states_filename)
os.replace(temp_filename, states_filename)
job["measurement"] = measurement.copy()
job["last_module_idx"] = index