[GH-ISSUE #23] Could you release multi-image understanding evaluation on general multi-image benchmarks?(BLINK, MuirBench, Mantis_eval, MMIU, MIBench, MIRB and etc) #20

Open
opened 2026-10-26 21:10:19 +00:00 by bsakaguchi · 1 comment
Owner

Originally created by @Michael4933 on GitHub (Dec 26, 2024).
Original GitHub issue: https://github.com/deepseek-ai/DeepSeek-VL2/issues/23

Model's multi-image ability is of increasingly vital importance, we are really curious of powerful model Deepseek's multi-image ability!

Originally created by @Michael4933 on GitHub (Dec 26, 2024). Original GitHub issue: https://github.com/deepseek-ai/DeepSeek-VL2/issues/23 Model's multi-image ability is of increasingly vital importance, we are really curious of powerful model Deepseek's multi-image ability!
Author
Owner

@ccx1997 commented on GitHub (Dec 30, 2024):

However, max_position_embeddings=4096 :<

<!-- gh-comment-id:2565291092 --> @ccx1997 commented on GitHub (Dec 30, 2024): However, `max_position_embeddings=4096` :<
Sign in to join this conversation.
No labels
pull-request
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
deepseek-ai/DeepSeek-VL2#20
No description provided.