[PR #66] [MERGED] First pass at Apple Silicon MPS back end #172

New issue

Closed

opened 2026-10-15 18:05:18 +00:00 by bsakaguchi · 0 comments

bsakaguchi commented

2026-10-15 18:05:18 +00:00

Owner

📋 Pull Request Information

Original PR: https://github.com/SillyTavern/SillyTavern-Extras/pull/66
Author: @majick
Created: 6/28/2023
Status: ✅ Merged
Merged: 6/28/2023
Merged by: @Cohee1207

Base: main ← Head: apple-silicon

📝 Commits (1)

aee5e71 First pass at Apple Silicon MPS back end

📊 Changes

2 files changed (+27 additions, -9 deletions)

View changed files

➕ requirements-silicon.txt (+16 -0)
📝 server.py (+11 -9)

📄 Description

This is a quick hack to get the MPS back end for torch up and running, which adds GPU acceleration for Apple Silicon systems. I've been using it for about a week (primarily without SD, but SD works if you have enough memory). A less fussy requirements-macos.txt is included for convenience to get it up and running.

MPS doesn't work well float16, so there's a tweak to make cuda the special case rather than the other way around.

_{🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.}

## 📋 Pull Request Information **Original PR:** https://github.com/SillyTavern/SillyTavern-Extras/pull/66 **Author:** [@majick](https://github.com/majick) **Created:** 6/28/2023 **Status:** ✅ Merged **Merged:** 6/28/2023 **Merged by:** [@Cohee1207](https://github.com/Cohee1207) **Base:** `main` ← **Head:** `apple-silicon` --- ### 📝 Commits (1) - [`aee5e71`](https://github.com/SillyTavern/SillyTavern-Extras/commit/aee5e71e4562fe5b40f7b571627c5adc9eecde9c) First pass at Apple Silicon MPS back end ### 📊 Changes **2 files changed** (+27 additions, -9 deletions) <details> <summary>View changed files</summary> ➕ `requirements-silicon.txt` (+16 -0) 📝 `server.py` (+11 -9) </details> ### 📄 Description This is a quick hack to get the MPS back end for torch up and running, which adds GPU acceleration for Apple Silicon systems. I've been using it for about a week (primarily without SD, but SD works if you have enough memory). A less fussy `requirements-macos.txt` is included for convenience to get it up and running. MPS doesn't work well float16, so there's a tweak to make cuda the special case rather than the other way around. --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>

bsakaguchi

2026-10-15 18:05:18 +00:00