[GH-ISSUE #18] Deploy in OpenAI format. #15

New issue

Closed

opened 2026-10-26 21:10:10 +00:00 by bsakaguchi · 2 comments

bsakaguchi commented

2026-10-26 21:10:10 +00:00

Owner

Originally created by @Adenialzz on GitHub (Dec 23, 2024).
Original GitHub issue: https://github.com/deepseek-ai/DeepSeek-VL2/issues/18

Hi, thanks for open-sourcing your great work.

I wonder can deepseek-vl2 be deployed in OpenAI format, so that I can use some constrained decoding library like instructor. I wonder is this possible and how to do?

Originally created by @Adenialzz on GitHub (Dec 23, 2024). Original GitHub issue: https://github.com/deepseek-ai/DeepSeek-VL2/issues/18 Hi, thanks for open-sourcing your great work. I wonder can deepseek-vl2 be deployed in OpenAI format, so that I can use some constrained decoding library like `instructor`. I wonder is this possible and how to do?

bsakaguchi closed this issue

2026-10-26 21:10:10 +00:00

bsakaguchi commented

2026-10-26 21:10:12 +00:00

Author

Owner

@HadiSDev commented on GitHub (Jan 26, 2025):

I have the same question

@HadiSDev commented on GitHub (Jan 26, 2025): I have the same question

bsakaguchi commented

2026-10-26 21:10:12 +00:00

Author

Owner

@Adenialzz commented on GitHub (Jan 28, 2025):

this has been supported by vllm now.

@Adenialzz commented on GitHub (Jan 28, 2025): this has been supported by vllm now.

No labels

pull-request

No milestone

No project

No assignees

1 participant

Notifications

Due date

The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference

deepseek-ai/DeepSeek-VL2#15

No description provided.

Rows
Columns