[GH-ISSUE #8] 示例3代码运行报错 #5

New issue

Closed

opened 2026-10-26 21:01:57 +00:00 by bsakaguchi · 2 comments

bsakaguchi commented

2026-10-26 21:01:57 +00:00

Owner

Originally created by @klmoretti on GitHub (Nov 3, 2023).
Original GitHub issue: https://github.com/deepseek-ai/DeepSeek-Coder/issues/8

from transformers import AutoTokenizer, AutoModelForCausalLM
tokenizer = AutoTokenizer.from_pretrained("./deepseek-coder-1.3b-instruct", trust_remote_code=True)
model = AutoModelForCausalLM.from_pretrained("./deepseek-coder-1.3b-instruct", trust_remote_code=True).cuda()
messages=[
... { 'role': 'user', 'content': "write a quick sort algorithm in python."}
... ]
inputs = tokenizer.apply_chat_template(messages, return_tensors="pt").to(model.device)
Traceback (most recent call last):
File "", line 1, in
AttributeError: 'LlamaTokenizerFast' object has no attribute 'apply_chat_template'

Originally created by @klmoretti on GitHub (Nov 3, 2023). Original GitHub issue: https://github.com/deepseek-ai/DeepSeek-Coder/issues/8 >>> from transformers import AutoTokenizer, AutoModelForCausalLM >>> tokenizer = AutoTokenizer.from_pretrained("./deepseek-coder-1.3b-instruct", trust_remote_code=True) >>> model = AutoModelForCausalLM.from_pretrained("./deepseek-coder-1.3b-instruct", trust_remote_code=True).cuda() >>> messages=[ ... { 'role': 'user', 'content': "write a quick sort algorithm in python."} ... ] >>> inputs = tokenizer.apply_chat_template(messages, return_tensors="pt").to(model.device) Traceback (most recent call last): File "<stdin>", line 1, in <module> AttributeError: 'LlamaTokenizerFast' object has no attribute 'apply_chat_template'

bsakaguchi

2026-10-26 21:01:57 +00:00

closed this issue
added the
ENV
label

bsakaguchi commented

2026-10-26 21:01:58 +00:00

Author

Owner

@DejianYang commented on GitHub (Nov 3, 2023):

please upgrade your transformers to latest version and try again.

@DejianYang commented on GitHub (Nov 3, 2023): please upgrade your transformers to latest version and try again.

bsakaguchi commented

2026-10-26 21:01:58 +00:00

Author

Owner

@soloice commented on GitHub (Nov 5, 2023):

Added https://github.com/deepseek-ai/DeepSeek-Coder/blob/main/requirements.txt

@soloice commented on GitHub (Nov 5, 2023): Added [https://github.com/deepseek-ai/DeepSeek-Coder/blob/main/requirements.txt](https://github.com/deepseek-ai/DeepSeek-Coder/blob/main/requirements.txt)