[GH-ISSUE #68] Parameters #52

Open
opened 2026-10-26 21:10:56 +00:00 by bsakaguchi · 0 comments
Owner

Originally created by @Fujiaoji on GitHub (Feb 7, 2025).
Original GitHub issue: https://github.com/deepseek-ai/DeepSeek-VL2/issues/68

Hi, I am wondering how to show the default temperature and top_p for the model.

I think the parameter do_sample if set as False, it means temperature=0? how about the value of top_p? Therefore, can you share how to check the parameters of the model? Thanks

outputs = vl_gpt.language.generate(
                inputs_embeds=inputs_embeds,
                attention_mask=prepare_inputs.attention_mask,
                pad_token_id=tokenizer.eos_token_id,
                bos_token_id=tokenizer.bos_token_id,
                eos_token_id=tokenizer.eos_token_id,
                max_new_tokens=512,
                do_sample=True,
                use_cache=True,
                temperature=0.4,
                top_p=0.9
            )

Thanks

Originally created by @Fujiaoji on GitHub (Feb 7, 2025). Original GitHub issue: https://github.com/deepseek-ai/DeepSeek-VL2/issues/68 Hi, I am wondering how to show the default temperature and top_p for the model. I think the parameter `do_sample` if set as False, it means temperature=0? how about the value of `top_p`? Therefore, can you share how to check the parameters of the model? Thanks ``` outputs = vl_gpt.language.generate( inputs_embeds=inputs_embeds, attention_mask=prepare_inputs.attention_mask, pad_token_id=tokenizer.eos_token_id, bos_token_id=tokenizer.bos_token_id, eos_token_id=tokenizer.eos_token_id, max_new_tokens=512, do_sample=True, use_cache=True, temperature=0.4, top_p=0.9 ) ``` Thanks
Sign in to join this conversation.
No labels
pull-request
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
deepseek-ai/DeepSeek-VL2#52
No description provided.