mirror of
https://github.com/kvcache-ai/ktransformers.git
synced 2026-11-05 01:07:28 +00:00
[GH-ISSUE #69] Missing pip packages flash_attn and wheel #34
Labels
No milestone
No project
No assignees
1 participant
Notifications
Due date
No due date set.
Dependencies
No dependencies set.
Reference
kvcache-ai/ktransformers#34
Loading…
Add table
Add a link
Reference in a new issue
No description provided.
Delete branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Originally created by @bitbottrap on GitHub (Aug 31, 2024).
Original GitHub issue: https://github.com/kvcache-ai/ktransformers/issues/69
Might want to add those two packages to requirements file.
@UnicornChan commented on GitHub (Sep 3, 2024):
Flash-attn is an optional package, and not all models require it. Additionally, if a precompiled package for flash-attn is not available, it needs to be compiled and installed, which can be very time-consuming. Therefore, flash-attn has not been added to the requirements.
We apologize for the omission of wheel package. We will include it in the next release. We use environments created with conda, which include wheel by default, so we did not encounter this issue.
@bitbottrap commented on GitHub (Sep 3, 2024):
Sound reasoning. Might want to document the possibility of needing flash_attn. Great project!