mirror of
https://github.com/deepseek-ai/DeepSeek-MoE.git
synced 2026-11-05 00:57:43 +00:00
[GH-ISSUE #24] load erros #22
Labels
No labels
pull-request
WIP
No milestone
No project
No assignees
1 participant
Notifications
Due date
No due date set.
Dependencies
No dependencies set.
Reference
deepseek-ai/DeepSeek-MoE#22
Loading…
Add table
Add a link
Reference in a new issue
No description provided.
Delete branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Originally created by @cooper12121 on GitHub (Feb 25, 2024).
Original GitHub issue: https://github.com/deepseek-ai/DeepSeek-MoE/issues/24
Originally assigned to: @zwd003 on GitHub.
Is the flash_attn library necessary to load your model?,when I load your model,there is error:ImportError: This modeling file requires the following packages that were not found in your environment: flash_attn. Run
pip install flash_attnthank you so much!
@luofuli commented on GitHub (Feb 25, 2024):
cc @zwd003
@zwd003 commented on GitHub (Feb 27, 2024):
you could install flash_attn or load the model with attn_implementation="eager"