mirror of
https://github.com/deepseek-ai/Janus.git
synced 2026-11-05 00:57:18 +00:00
[GH-ISSUE #171] Add an option to disable flash attention for older GPU's #134
Labels
No labels
pull-request
No milestone
No project
No assignees
1 participant
Notifications
Due date
No due date set.
Dependencies
No dependencies set.
Reference
deepseek-ai/Janus#134
Loading…
Add table
Add a link
Reference in a new issue
No description provided.
Delete branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Originally created by @apcameron on GitHub (Feb 14, 2025).
Original GitHub issue: https://github.com/deepseek-ai/Janus/issues/171
When I run generation_inference.py I get the error below.
RuntimeError: FlashAttention only supports Ampere GPUs or newer.
Please add an option to either disable it.
@shootheart commented on GitHub (May 19, 2025):
Same problem. Is there a way to disable it manually?
@hongjx175 commented on GitHub (May 19, 2025):
A simple way is to modify the
config.json