mirror of
https://github.com/kvcache-ai/ktransformers.git
synced 2026-11-05 01:07:28 +00:00
[GH-ISSUE #1364] Will ktransformer support Intel B50/B60 and the multi-card feature(BattleMatrix)? #916
Labels
No milestone
No project
No assignees
1 participant
Notifications
Due date
No due date set.
Dependencies
No dependencies set.
Reference
kvcache-ai/ktransformers#916
Loading…
Add table
Add a link
Reference in a new issue
No description provided.
Delete branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Originally created by @HashVal on GitHub (Jun 4, 2025).
Original GitHub issue: https://github.com/kvcache-ai/ktransformers/issues/1364
Originally assigned to: @aubreyli on GitHub.
Greetings!
Ktransformer is really a good solution for us to use cheap CPUs instead of GPU(nowadays NVIDIA GPU is really expensive) running llm. Bravo!
I saw social media says that Intel will publish its new B series GPUs, B50 and B60(with 24GB RAM). And Intel has a multi-card feature with B60 called BattleMatrix. See reference here: https://www.intel.com/content/www/us/en/developer/articles/technical/introduction-project-battlematrix.html.
Will ktransformer plan to support B50/B60 cards? Will it support the battlematrix?
@aubreyli commented on GitHub (Jun 5, 2025):
KT has added support for Intel Arc-A series and B-series graphics cards(including B50/B60) via PR #1295 .
And multi-card support(balanced_serve multi-concurrency mode) is in progress - stay tuned for updates, please
@HashVal commented on GitHub (Jun 5, 2025):
Thanks for quick reply and really glad to know B50/B60 are already supported.
Looking forward for your updates :)