[GH-ISSUE #108] Is there any analysis on time complexity of MLA? #97

Open
opened 2026-10-26 21:07:52 +00:00 by bsakaguchi · 0 comments
Owner

Originally created by @joeyxin-del on GitHub (Feb 17, 2025).
Original GitHub issue: https://github.com/deepseek-ai/DeepSeek-V2/issues/108

Especially down-projection and up-projection.
Will that lead to a large amount of operations like matrix multiplication?

Originally created by @joeyxin-del on GitHub (Feb 17, 2025). Original GitHub issue: https://github.com/deepseek-ai/DeepSeek-V2/issues/108 Especially down-projection and up-projection. Will that lead to a large amount of operations like matrix multiplication?
Sign in to join this conversation.
No labels
pull-request
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
deepseek-ai/DeepSeek-V2#97
No description provided.