Model: Add vision loading support

Adds the ability to load vision parts of text + image models. Requires
an explicit flag in config because there isn't a way to automatically
determine whether the vision tower should be used.

Signed-off-by: kingbri <bdashore3@proton.me>

endpoints/core/types/model.py

@@ -107,6 +107,7 @@ class ModelLoadRequest(BaseModel):
     cache_mode: Optional[str] = None
     chunk_size: Optional[int] = None
     prompt_template: Optional[str] = None
+    vision: Optional[bool] = None
     num_experts_per_token: Optional[int] = None
 
     # Non-config arguments