turboderp-org/exllamav2
1
0
Fork 0
mirror of https://github.com/turboderp-org/exllamav2.git synced 2026-03-15 00:07:26 +00:00
Code Issues Packages Projects Releases Wiki Activity

minor changes

Browse Source 
1. added .so file to the ignored list
2. removed 2 unused imports from test_inference.py, which also
   avoided a warning for me that was produced by importing
   pandas
This commit is contained in:
Min Xu
2024-02-02 20:19:02 -08:00
parent c0ddebaaaf
commit 8e13598868
2 changed files with 4 additions and 2 deletions
Download Patch File Download Diff File Expand all files Collapse all files

5
.gitignore vendored
View File

@@ -5,4 +5,7 @@ build/
__pycache__/
.idea
venv
dist
dist
# produced by `pip install -e .`
exllamav2_ext.cpython-312-x86_64-linux-gnu.so

1
test_inference.py
View File

@@ -18,7 +18,6 @@ from exllamav2.mlp import ExLlamaV2MLP
from exllamav2.moe_mlp import ExLlamaV2MoEMLP
import argparse, os, math, time
import pandas, fastparquet
import torch
import torch.nn.functional as F
from conversion.tokenize import get_tokens