[PR #34] [MERGED] Fix flash_attn import in siglip_vit #131

Closed
opened 2026-10-26 21:12:30 +00:00 by bsakaguchi · 0 comments
Owner

📋 Pull Request Information

Original PR: https://github.com/deepseek-ai/DeepSeek-VL2/pull/34
Author: @Isotr0py
Created: 1/9/2025
Status: ✅ Merged
Merged: 1/16/2025
Merged by: @StevenLiuWen

Base: main ← Head: main


📝 Commits (1)

  • a60e820 fix flash_attn import on old GPU

📊 Changes

1 file changed (+6 additions, -2 deletions)

View changed files

📝 deepseek_vl2/models/siglip_vit.py (+6 -2)

📄 Description

  • FA2 is only available on GPU with cc >= 8.0
  • This PR fix a FA2 import in siglip_vit.py to make inference available on old GPU like V100 and T4.

🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.

## 📋 Pull Request Information **Original PR:** https://github.com/deepseek-ai/DeepSeek-VL2/pull/34 **Author:** [@Isotr0py](https://github.com/Isotr0py) **Created:** 1/9/2025 **Status:** ✅ Merged **Merged:** 1/16/2025 **Merged by:** [@StevenLiuWen](https://github.com/StevenLiuWen) **Base:** `main` ← **Head:** `main` --- ### 📝 Commits (1) - [`a60e820`](https://github.com/deepseek-ai/DeepSeek-VL2/commit/a60e8208bb94ea51cd8ddd2ecf84970b26cfe016) fix flash_attn import on old GPU ### 📊 Changes **1 file changed** (+6 additions, -2 deletions) <details> <summary>View changed files</summary> 📝 `deepseek_vl2/models/siglip_vit.py` (+6 -2) </details> ### 📄 Description - FA2 is only available on GPU with `cc >= 8.0` - This PR fix a FA2 import in `siglip_vit.py` to make inference available on old GPU like V100 and T4. --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>
bsakaguchi 2026-10-26 21:12:30 +00:00
Sign in to join this conversation.
No labels
pull-request
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
deepseek-ai/DeepSeek-VL2#131
No description provided.