[GH-ISSUE #22] support gguf so we can use it with ollama llama.cpp #16

Closed
opened 2026-10-26 21:10:57 +00:00 by bsakaguchi · 6 comments
Owner

Originally created by @olumolu on GitHub (Dec 29, 2024).
Original GitHub issue: https://github.com/deepseek-ai/DeepSeek-V3/issues/22

https://github.com/ollama/ollama/issues/8249
Support as fast as possible.

Originally created by @olumolu on GitHub (Dec 29, 2024). Original GitHub issue: https://github.com/deepseek-ai/DeepSeek-V3/issues/22 https://github.com/ollama/ollama/issues/8249 Support as fast as possible.
Author
Owner

@arthurwolf commented on GitHub (Dec 30, 2024):

This would be very useful and very appreciated. What is required to get this working, and can we help?

<!-- gh-comment-id:2564953197 --> @arthurwolf commented on GitHub (Dec 30, 2024): This would be very useful and very appreciated. What is required to get this working, and can we help?
Author
Owner

@nezahatkorkmaz commented on GitHub (Dec 30, 2024):

Yeah can we help

<!-- gh-comment-id:2565209310 --> @nezahatkorkmaz commented on GitHub (Dec 30, 2024): Yeah can we help
Author
Owner

@fr34k8 commented on GitHub (Jan 3, 2025):

glad to help as well! yaihh! \o/

<!-- gh-comment-id:2569368997 --> @fr34k8 commented on GitHub (Jan 3, 2025): glad to help as well! yaihh! \o/
Author
Owner

@ibbcall commented on GitHub (Jan 5, 2025):

Looking forward to it!

<!-- gh-comment-id:2571474709 --> @ibbcall commented on GitHub (Jan 5, 2025): Looking forward to it!
Author
Owner

@olumolu commented on GitHub (Jan 5, 2025):

https://github.com/ggerganov/llama.cpp/pull/11049
Llama cpp already merged

<!-- gh-comment-id:2571505495 --> @olumolu commented on GitHub (Jan 5, 2025): https://github.com/ggerganov/llama.cpp/pull/11049 Llama cpp already merged
Author
Owner

@olumolu commented on GitHub (Jan 14, 2025):

https://ollama.com/library/deepseek-v3
Now this is available in ollama so i am closing this issue

<!-- gh-comment-id:2590361853 --> @olumolu commented on GitHub (Jan 14, 2025): https://ollama.com/library/deepseek-v3 Now this is available in ollama so i am closing this issue
Sign in to join this conversation.
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
deepseek-ai/DeepSeek-V3#16
No description provided.