[GH-ISSUE #3] this model can do audio-to-any too? #2

Closed
opened 2026-10-26 21:09:45 +00:00 by bsakaguchi · 1 comment
Owner

Originally created by @fountaii on GitHub (Oct 18, 2024).
Original GitHub issue: https://github.com/deepseek-ai/Janus/issues/3

im looking to readme and only viewing messages about image generation and view. it can do something with the audio input?

Originally created by @fountaii on GitHub (Oct 18, 2024). Original GitHub issue: https://github.com/deepseek-ai/Janus/issues/3 im looking to readme and only viewing messages about image generation and view. it can do something with the audio input?
Author
Owner

@charlesCXK commented on GitHub (Oct 19, 2024):

Thank you for your attention to our work! The current Janus model validates the feasibility of using different encoding methods for various tasks (pure text understanding, multimodal understanding, visual generation), and then processing them with a single transformer. However, this version of Janus has not been trained on audio data.

<!-- gh-comment-id:2423740487 --> @charlesCXK commented on GitHub (Oct 19, 2024): Thank you for your attention to our work! The current Janus model validates the feasibility of using different encoding methods for various tasks (pure text understanding, multimodal understanding, visual generation), and then processing them with a single transformer. However, this version of Janus has not been trained on audio data.
Sign in to join this conversation.
No labels
pull-request
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
deepseek-ai/Janus#2
No description provided.