mirror of
https://github.com/deepseek-ai/DeepSeek-VL.git
synced 2026-11-05 00:47:24 +00:00
[GH-ISSUE #41] What tasks in training for image-text interleaved data? #28
Labels
No labels
enhancement
environment
pull-request
No milestone
No project
No assignees
1 participant
Notifications
Due date
No due date set.
Dependencies
No dependencies set.
Reference
deepseek-ai/DeepSeek-VL#28
Loading…
Add table
Add a link
Reference in a new issue
No description provided.
Delete branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Originally created by @BlueBlueFF on GitHub (Mar 31, 2024).
Original GitHub issue: https://github.com/deepseek-ai/DeepSeek-VL/issues/41
@StevenLiuWen commented on GitHub (Apr 1, 2024):
@BlueBlueFF, we use interleaved image-text data to improve the in-context learning and support the inputs of multiple images with interleaved image-text format for the VL models. Same with other image-text data formats like image caption data, we apply the next token prediction loss only on the text part.