mirror of
https://github.com/deepseek-ai/DeepSeek-VL2.git
synced 2026-11-05 01:07:23 +00:00
[GH-ISSUE #118] device=auto 8gpu 2080ti #94
Labels
No labels
pull-request
No milestone
No project
No assignees
1 participant
Notifications
Due date
No due date set.
Dependencies
No dependencies set.
Reference
deepseek-ai/DeepSeek-VL2#94
Loading…
Add table
Add a link
Reference in a new issue
No description provided.
Delete branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Originally created by @Nick280375880 on GitHub (Mar 19, 2025).
Original GitHub issue: https://github.com/deepseek-ai/DeepSeek-VL2/issues/118
I have8 RTX 2080ti GPUs,
raise NotImplementedError(msg)
NotImplementedError: No operator found for
memory_efficient_attention_forwardwith inputs:query : shape=(7, 729, 16, 72) (torch.bfloat16)
key : shape=(7, 729, 16, 72) (torch.bfloat16)
value : shape=(7, 729, 16, 72) (torch.bfloat16)
attn_bias : <class 'NoneType'>
p : 0.0
fa3F@0.0.0is not supported because:requires device with capability > (9, 0) but your GPU has capability (7, 5) (too old)
bf16 is only supported on A100+ GPUs
operator wasn't built - see
python -m xformers.infofor more infoonly head-dim 64,128,256 is supported
fa2F@v2.7.2.post1is not supported because:requires device with capability > (8, 0) but your GPU has capability (7, 5) (too old)
bf16 is only supported on A100+ GPUs
cutlassF-ptis not supported because:bf16 is only supported on A100+ GPUs