mirror of
https://github.com/deepseek-ai/DeepSeek-VL2.git
synced 2026-11-05 01:07:23 +00:00
[GH-ISSUE #45] cannot import name 'LlamaFlashAttention2' from 'transformers.models.llama.modeling_llama' #35
Labels
No labels
pull-request
No milestone
No project
No assignees
1 participant
Notifications
Due date
No due date set.
Dependencies
No dependencies set.
Reference
deepseek-ai/DeepSeek-VL2#35
Loading…
Add table
Add a link
Reference in a new issue
No description provided.
Delete branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Originally created by @panzhzh on GitHub (Jan 31, 2025).
Original GitHub issue: https://github.com/deepseek-ai/DeepSeek-VL2/issues/45
Python version is above 3.10, patching the collections module.
Traceback (most recent call last):
File "/home/pzz/pythoncode/deepseek/vl2_load.py", line 4, in
from deepseek_vl2.models import DeepseekVLV2Processor, DeepseekVLV2ForCausalLM
File "/home/pzz/pythoncode/deepseek/DeepSeek-VL2-main/deepseek_vl2/models/init.py", line 21, in
from .modeling_deepseek_vl_v2 import DeepseekVLV2ForCausalLM
File "/home/pzz/pythoncode/deepseek/DeepSeek-VL2-main/deepseek_vl2/models/modeling_deepseek_vl_v2.py", line 28, in
from .modeling_deepseek import DeepseekV2ForCausalLM
File "/home/pzz/pythoncode/deepseek/DeepSeek-VL2-main/deepseek_vl2/models/modeling_deepseek.py", line 37, in
from transformers.models.llama.modeling_llama import (
ImportError: cannot import name 'LlamaFlashAttention2' from 'transformers.models.llama.modeling_llama' (/home/pzz/miniconda3/lib/python3.12/site-packages/transformers/models/llama/modeling_llama.py). Did you mean: 'LlamaAttention'?
@sgzqc commented on GitHub (Feb 18, 2025):
pip install transformers==4.47.1
@mohayl commented on GitHub (Feb 18, 2025):
does not work
@DenceChen commented on GitHub (Mar 22, 2025):
pip install transformers==4.47.1