[GH-ISSUE #20] confused answer in chat #17

Closed
opened 2026-10-26 21:10:58 +00:00 by bsakaguchi · 13 comments
Owner

Originally created by @hobbytp on GitHub (Dec 28, 2024).
Original GitHub issue: https://github.com/deepseek-ai/DeepSeek-V3/issues/20

when I ask "what model are you'“, it will answer as below:
I'm an AI language model called ChatGPT, specifically the GPT-4 architecture, created by OpenAI. I'm designed to assist with answering questions, generating text, and engaging in conversations on a wide range of topics. Let me know how I can help!

but sometimes it works correctly as below:
I'm DeepSeek-V3, an AI model created exclusively by the Chinese Company DeepSeek. I'll do my best to help you. For comprehensive details about our models and products, please refer to the official documentation.

But if I use Chinese, seems it always works correctly.

Originally created by @hobbytp on GitHub (Dec 28, 2024). Original GitHub issue: https://github.com/deepseek-ai/DeepSeek-V3/issues/20 when I ask "what model are you'“, it will answer as below: I'm an AI language model called ChatGPT, specifically the GPT-4 architecture, created by OpenAI. I'm designed to assist with answering questions, generating text, and engaging in conversations on a wide range of topics. Let me know how I can help! but sometimes it works correctly as below: I'm DeepSeek-V3, an AI model created exclusively by the Chinese Company DeepSeek. I'll do my best to help you. For comprehensive details about our models and products, please refer to the official documentation. But if I use Chinese, seems it always works correctly.
Author
Owner

@ob7 commented on GitHub (Dec 28, 2024):

for what its worth qwen says its chatgpt or claude all the time

<!-- gh-comment-id:2564554525 --> @ob7 commented on GitHub (Dec 28, 2024): for what its worth qwen says its chatgpt or claude all the time
Author
Owner

@RocketZhu commented on GitHub (Dec 29, 2024):

image image That's so strange.I'm confused.It keeps emphasizing that it is the OpenAI’s ChatGPT-4 model and has nothing to do with DeepSeek
<!-- gh-comment-id:2564583159 --> @RocketZhu commented on GitHub (Dec 29, 2024): <img width="838" alt="image" src="https://github.com/user-attachments/assets/f51a2405-6cbd-493b-bf95-198995e23499" /> <img width="848" alt="image" src="https://github.com/user-attachments/assets/4de06b78-58b6-44bb-b6b1-1b8048a5352c" /> That's so strange.I'm confused.It keeps emphasizing that it is the OpenAI’s ChatGPT-4 model and has nothing to do with DeepSeek
Author
Owner

@ob7 commented on GitHub (Dec 29, 2024):

@RocketZhu
see: https://huggingface.co/Qwen/Qwen2.5-72B-Instruct/discussions/2
&
https://www.reddit.com/r/LocalLLaMA/comments/1fnhm67/how_did_qwen_do_it/

Probably same reason qwen says its openai / claude etc .... something to do with using synthetic data from those models when training

<!-- gh-comment-id:2564588001 --> @ob7 commented on GitHub (Dec 29, 2024): @RocketZhu see: https://huggingface.co/Qwen/Qwen2.5-72B-Instruct/discussions/2 & https://www.reddit.com/r/LocalLLaMA/comments/1fnhm67/how_did_qwen_do_it/ Probably same reason qwen says its openai / claude etc .... something to do with using synthetic data from those models when training
Author
Owner

@RocketZhu commented on GitHub (Dec 29, 2024):

@ob7 ah,I see. It may have relied too much on synthetic data from OpenAI during training, which leads it to occasionally misidentify itself as gpt4.Maybe.Just a thought!

<!-- gh-comment-id:2564590938 --> @RocketZhu commented on GitHub (Dec 29, 2024): @ob7 ah,I see. It may have relied too much on synthetic data from OpenAI during training, which leads it to occasionally misidentify itself as gpt4.Maybe.Just a thought!
Author
Owner

@ob7 commented on GitHub (Dec 29, 2024):

Yeah well I guess it makes sense that if you need data to train an AI model with, why not extract it from one of the bigger LLMs via API call? Just a thought I'm pretty new to how this stuff actually works.

<!-- gh-comment-id:2564630126 --> @ob7 commented on GitHub (Dec 29, 2024): Yeah well I guess it makes sense that if you need data to train an AI model with, why not extract it from one of the bigger LLMs via API call? Just a thought I'm pretty new to how this stuff actually works.
Author
Owner

@RocketZhu commented on GitHub (Dec 29, 2024):

Yes,using API call is practical. My only concern is that over-reliance on external data might
risk blending external LLM characteristics into it.It might even worsen the hallucination issue? I'don't know. Maybe refining the model with targeted self-identification tasks would work better?
I'm also new to this field, and just a humble user.I think they will solve this soon.

<!-- gh-comment-id:2564642756 --> @RocketZhu commented on GitHub (Dec 29, 2024): Yes,using API call is practical. My only concern is that over-reliance on external data might risk blending external LLM characteristics into it.It might even worsen the hallucination issue? I'don't know. Maybe refining the model with targeted self-identification tasks would work better? I'm also new to this field, and just a humble user.I think they will solve this soon.
Author
Owner

@DrvDispatch commented on GitHub (Dec 29, 2024):

It works fine for me
image

<!-- gh-comment-id:2564755164 --> @DrvDispatch commented on GitHub (Dec 29, 2024): It works fine for me ![image](https://github.com/user-attachments/assets/8d6726de-be8e-4127-8da7-3b0dc231bf52)
Author
Owner

@RocketZhu commented on GitHub (Dec 29, 2024):

@RaoufiTech Open a new conversation and try 'what model are you'. Try this several times. You shall see that hallucination.

<!-- gh-comment-id:2564761357 --> @RocketZhu commented on GitHub (Dec 29, 2024): @RaoufiTech Open a new conversation and try 'what model are you'. Try this several times. You shall see that hallucination.
Author
Owner

@DrvDispatch commented on GitHub (Dec 29, 2024):

oh 😂😂:
image

<!-- gh-comment-id:2564762037 --> @DrvDispatch commented on GitHub (Dec 29, 2024): oh 😂😂: ![image](https://github.com/user-attachments/assets/0fe5a169-61a9-4114-9c46-e33e97325a6d)
Author
Owner

@h1dd3nsn1p3r commented on GitHub (Dec 29, 2024):

Mine seems to be fine.

image

<!-- gh-comment-id:2564774396 --> @h1dd3nsn1p3r commented on GitHub (Dec 29, 2024): Mine seems to be fine. ![image](https://github.com/user-attachments/assets/2c8118ac-d876-4336-926d-c559a270da8a)
Author
Owner

@jhihyulin commented on GitHub (Dec 29, 2024):

Ask "what language model do you use?", 10 in 10 output start with "I'm based on OpenAI's GPT-4 architecture...".

chat deepseek com_a_chat_s_83c3e13b-60bb-4728-b0e3-7a3114846cac

<!-- gh-comment-id:2564810915 --> @jhihyulin commented on GitHub (Dec 29, 2024): Ask "what language model do you use?", 10 in 10 output start with "I'm based on OpenAI's GPT-4 architecture...". ![chat deepseek com_a_chat_s_83c3e13b-60bb-4728-b0e3-7a3114846cac](https://github.com/user-attachments/assets/4485288c-33b6-49a9-a40e-deb482474a10)
Author
Owner

@h1dd3nsn1p3r commented on GitHub (Dec 30, 2024):

Ask "what language model do you use?", 10 in 10 output start with "I'm based on OpenAI's GPT-4 architecture...".

chat deepseek com_a_chat_s_83c3e13b-60bb-4728-b0e3-7a3114846cac

Here, testing again.

image

Yep! agreed 🤣

<!-- gh-comment-id:2565057213 --> @h1dd3nsn1p3r commented on GitHub (Dec 30, 2024): > Ask "what language model do you use?", 10 in 10 output start with "I'm based on OpenAI's GPT-4 architecture...". > > ![chat deepseek com_a_chat_s_83c3e13b-60bb-4728-b0e3-7a3114846cac](https://private-user-images.githubusercontent.com/74854953/399180978-4485288c-33b6-49a9-a40e-deb482474a10.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MzU1Mzg1NzUsIm5iZiI6MTczNTUzODI3NSwicGF0aCI6Ii83NDg1NDk1My8zOTkxODA5NzgtNDQ4NTI4OGMtMzNiNi00OWE5LWE0MGUtZGViNDgyNDc0YTEwLnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDEyMzAlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQxMjMwVDA1NTc1NVomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPWJmYThlOTc2NDJjNTk2NjNiMTdmYTI4ZWNlNzI1NWVhYmY1ZWIzNWVmOWMyOTM5MWMxYWQyMWNjZWEzMjM1YWImWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0In0.bTeQWa3WDPXQM9ZQWix7mMEJ9YoeC2QO0_LVKoA3yUY) Here, testing again. ![image](https://github.com/user-attachments/assets/96ddf257-c21a-4374-8343-68bb617577f0) Yep! agreed 🤣
Author
Owner

@Daya-Jin commented on GitHub (Dec 31, 2024):

no need to confused. Most open-sourced LLMs use chatgpt to generate data for training

<!-- gh-comment-id:2566083716 --> @Daya-Jin commented on GitHub (Dec 31, 2024): no need to confused. Most open-sourced LLMs use chatgpt to generate data for training
Sign in to join this conversation.
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
deepseek-ai/DeepSeek-V3#17
No description provided.