turboderp-org/exllamav2
1
0
Fork 0
mirror of https://github.com/turboderp-org/exllamav2.git synced 2026-04-20 06:19:00 +00:00
Code Issues Packages Projects Releases Wiki Activity
1,459 Commits 3 Branches 43 Tags
master
Commit Graph

11 Commits

Author SHA1 Message Date
Colin
008a0bb777 Fix converting files with docker command 2024-02-20 19:41:57 -05:00
turboderp
9373d0cda0 Fix for .bin files with shared weights 2024-01-22 16:21:34 +01:00
turboderp
699d127011 Add metadata when converting .bin to .safetensors 2024-01-10 07:05:07 +01:00
turboderp
4ca4476007 Merge pull request #218 from SinanAkkoyun/safetensor-update 
Fixed multi file and wildcard args
 2023-12-31 21:28:30 +01:00
turboderp
2e91239571 New quant optimization procedure 2023-12-08 20:19:57 +01:00
Sinan
71b40c359e Fixed multi file and wildcard args 2023-12-08 16:24:37 +01:00
kingbri
6bfcefe940 Tree: Force utf8 when opening files 
The default encoding on linux is utf8, but Windows uses cp1252 which
isn't compatible with some unicode characters.

Signed-off-by: kingbri <bdashore3@proton.me>
 2023-11-29 19:21:29 -05:00
turboderp
8fcedff041 Update safetensor conversion util to load state_dict to CPU 2023-09-15 08:55:15 +02:00
turboderp
5ccd29c7d6 Simple utility to convert .bin to .safetensors 2023-09-14 08:34:06 +02:00
turboderp
6e14f8802b Unsharding utility 2023-09-11 04:16:42 +02:00
turboderp
8ca9a1896d Add sharding utility 2023-09-10 18:59:05 +02:00