Launch: Make exllamav2 requirement more friendly

Add the ability to use an unsafe config flag if needed and migrate
the exl2 check to a different file within the exl2 backend code.

Signed-off-by: kingbri <bdashore3@proton.me>
This commit is contained in:
kingbri
2024-02-02 22:04:35 -05:00
parent b827bcbb44
commit 1919bf7705
5 changed files with 72 additions and 22 deletions

View File

@@ -125,3 +125,12 @@ def add_logging_args(parser: argparse.ArgumentParser):
type=str_to_bool,
help="Enable generation parameter logging",
)
def add_developer_args(parser: argparse.ArgumentParser):
"""Adds developer-specific arguments"""
developer_group = parser.add_argument_group("developer")
developer_group.add_argument(
"--unsafe-launch", type=str_to_bool, help="Skip Exllamav2 version check"
)