[GH-ISSUE #119] Multi-turn dialogue and multi-image few-shot #89

Open
opened 2026-10-26 21:11:54 +00:00 by bsakaguchi · 1 comment
Owner

Originally created by @Pioneer6gun9 on GitHub (Feb 1, 2025).
Original GitHub issue: https://github.com/deepseek-ai/Janus/issues/119

Could you confirm if the Janus model supports multi-turn conversations and few-shot learning with multiple images? Any details or limitations would be appreciated. Thanks!

Originally created by @Pioneer6gun9 on GitHub (Feb 1, 2025). Original GitHub issue: https://github.com/deepseek-ai/Janus/issues/119 Could you confirm if the Janus model supports multi-turn conversations and few-shot learning with multiple images? Any details or limitations would be appreciated. Thanks!
Author
Owner

@camipower commented on GitHub (Mar 5, 2025):

Same question (for Janus-Pro-7B): Is few-shot with multiple images supported? Would something like the following conversation work? (simplified example):

[
{
"role": "<|System|>",
"content": "\nYour task is to recognize if the provided image is black or white.\n"
},
{
"role": "<|User|>",
"content": "<image_placeholder>\nIs this image black or white?",
"images": [
"black_image.png"
]
},
{
"role": "<|Assistant|>",
"content": "black"
},
{
"role": "<|User|>",
"content": "<image_placeholder>\nIs this image black or white?",
"images": [
"white_image.png"
]
},
{
"role": "<|Assistant|>",
"content": "white"
},
{
"role": "<|User|>",
"content": "<image_placeholder>\nIs this image black or white?",
"images": [
"new_image.png"
]
},
{
"role": "<|Assistant|>",
"content": ""
}
]

<!-- gh-comment-id:2700381230 --> @camipower commented on GitHub (Mar 5, 2025): Same question (for Janus-Pro-7B): Is few-shot with multiple images supported? Would something like the following conversation work? (simplified example): [ { "role": "<|System|>", "content": "\nYour task is to recognize if the provided image is black or white.\n" }, { "role": "<|User|>", "content": "<image_placeholder>\nIs this image black or white?", "images": [ "black_image.png" ] }, { "role": "<|Assistant|>", "content": "black" }, { "role": "<|User|>", "content": "<image_placeholder>\nIs this image black or white?", "images": [ "white_image.png" ] }, { "role": "<|Assistant|>", "content": "white" }, { "role": "<|User|>", "content": "<image_placeholder>\nIs this image black or white?", "images": [ "new_image.png" ] }, { "role": "<|Assistant|>", "content": "" } ]
Sign in to join this conversation.
No labels
pull-request
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
deepseek-ai/Janus#89
No description provided.