[GH-ISSUE #199] Gen.encoder为什么存在 #159

Open
opened 2026-10-26 21:13:11 +00:00 by bsakaguchi · 1 comment
Owner

Originally created by @125jx on GitHub (Mar 13, 2025).
Original GitHub issue: https://github.com/deepseek-ai/Janus/issues/199

Gen.encoder为什么存在?我是一名小白,我觉得根据文字生成图不是只有文字吗?为什么还需要一个Gen.encoder进行图像编码

Originally created by @125jx on GitHub (Mar 13, 2025). Original GitHub issue: https://github.com/deepseek-ai/Janus/issues/199 Gen.encoder为什么存在?我是一名小白,我觉得根据文字生成图不是只有文字吗?为什么还需要一个Gen.encoder进行图像编码
Author
Owner

@HaFred commented on GitHub (Mar 16, 2025):

https://github.com/deepseek-ai/Janus/blob/main/generation_inference.py#L98
During inference, gen_vision_model is only used for decoding generated image tokens into image pixels. Its encoder is only used during training, of which you may find more details in the report.

<!-- gh-comment-id:2727245668 --> @HaFred commented on GitHub (Mar 16, 2025): https://github.com/deepseek-ai/Janus/blob/main/generation_inference.py#L98 During inference, `gen_vision_model` is only used for decoding generated image tokens into image pixels. Its encoder is only used during training, of which you may find more details in the report.
Sign in to join this conversation.
No labels
pull-request
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
deepseek-ai/Janus#159
No description provided.