[GH-ISSUE #949] Feature Request: Context Memory Mode for DeepSeek #572

Closed
opened 2026-10-26 21:23:25 +00:00 by bsakaguchi · 4 comments
Owner

Originally created by @Pomsakar on GitHub (Aug 9, 2025).
Original GitHub issue: https://github.com/deepseek-ai/DeepSeek-V3/issues/949

Currently, DeepSeek models treat each conversation turn as an independent request, relying solely on the provided context.
In long-running sessions, this forces users to repeatedly send large portions of conversation history, which increases token usage and slows down responses.

I propose adding a “Context Memory Mode” — a mechanism that stores conversation embeddings and concise summaries locally or in a vector database. The model would then retrieve and reconstruct relevant context on demand, without resending the entire history.

Benefits:

Significantly reduced token usage in multi-turn conversations.

Faster response times for extended sessions.

More coherent and context-aware replies in long interactions.

Possible Implementation:

Store embeddings for each conversation segment in a local vector store (e.g., FAISS, Milvus).

On each turn, retrieve the top-N most relevant segments and append them to the prompt.

Add an API parameter, e.g., memory_mode=True, to enable or disable this feature.

This enhancement would make DeepSeek more efficient and user-friendly in scenarios such as chatbots, AI assistants, and persistent dialogue applications.

Originally created by @Pomsakar on GitHub (Aug 9, 2025). Original GitHub issue: https://github.com/deepseek-ai/DeepSeek-V3/issues/949 Currently, DeepSeek models treat each conversation turn as an independent request, relying solely on the provided context. In long-running sessions, this forces users to repeatedly send large portions of conversation history, which increases token usage and slows down responses. I propose adding a “Context Memory Mode” — a mechanism that stores conversation embeddings and concise summaries locally or in a vector database. The model would then retrieve and reconstruct relevant context on demand, without resending the entire history. Benefits: Significantly reduced token usage in multi-turn conversations. Faster response times for extended sessions. More coherent and context-aware replies in long interactions. Possible Implementation: Store embeddings for each conversation segment in a local vector store (e.g., FAISS, Milvus). On each turn, retrieve the top-N most relevant segments and append them to the prompt. Add an API parameter, e.g., `memory_mode=True`, to enable or disable this feature. This enhancement would make DeepSeek more efficient and user-friendly in scenarios such as chatbots, AI assistants, and persistent dialogue applications.
bsakaguchi 2026-10-26 21:23:25 +00:00
Author
Owner

@github-actions[bot] commented on GitHub (Sep 9, 2025):

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. If you believe this issue is still relevant, please leave a comment to keep it open. Thank you for your contributions!

<!-- gh-comment-id:3268425099 --> @github-actions[bot] commented on GitHub (Sep 9, 2025): This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. If you believe this issue is still relevant, please leave a comment to keep it open. Thank you for your contributions!
Author
Owner

@0izayoi0 commented on GitHub (Sep 20, 2025):

id like this feature too honestly

<!-- gh-comment-id:3314939898 --> @0izayoi0 commented on GitHub (Sep 20, 2025): id like this feature too honestly
Author
Owner

@github-actions[bot] commented on GitHub (Oct 22, 2025):

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. If you believe this issue is still relevant, please leave a comment to keep it open. Thank you for your contributions!

<!-- gh-comment-id:3430000214 --> @github-actions[bot] commented on GitHub (Oct 22, 2025): This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. If you believe this issue is still relevant, please leave a comment to keep it open. Thank you for your contributions!
Author
Owner

@github-actions[bot] commented on GitHub (Nov 6, 2025):

false

<!-- gh-comment-id:3494213273 --> @github-actions[bot] commented on GitHub (Nov 6, 2025): false
Sign in to join this conversation.
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
deepseek-ai/DeepSeek-V3#572
No description provided.