mirror of
https://github.com/theroyallab/tabbyAPI.git
synced 2026-03-15 00:07:28 +00:00
Dependencies: Change handling of exllamav2 checks
ExllamaV2 should check for solely exllamav2, otherwise errors don't make sense. Migrate the combined "exl2" computed property to "inference" since those are the required dependencies for minimal inference. Signed-off-by: kingbri <bdashore3@proton.me>
This commit is contained in:
@@ -25,7 +25,7 @@ class DependenciesModel(BaseModel):
|
||||
|
||||
@computed_field
|
||||
@property
|
||||
def exl2(self) -> bool:
|
||||
def inference(self) -> bool:
|
||||
return self.torch and self.exllamav2 and self.flash_attn
|
||||
|
||||
|
||||
|
||||
Reference in New Issue
Block a user