[GH-ISSUE #114] Tasks Checks failing, "Could not extract reply in 5 attempts." #70

Closed
opened 2026-10-15 18:04:05 +00:00 by bsakaguchi · 3 comments
Owner

Originally created by @fanafo on GitHub (Aug 9, 2023).
Original GitHub issue: https://github.com/SillyTavern/SillyTavern-Extras/issues/114

Running locally. Struggling to get the Objectives plugin to work. When a task check is performed, I get the following error message after a few seconds:
"Could not extract reply in 5 attempts. Try generating again."
In Oobabooga/text-gen-ui log, I see the following with each check:

127.0.0.1 - - [09/Aug/2023 06:03:16] "POST /api/v1/generate HTTP/1.1" 200 -
Output generated in 0.87 seconds (1.15 tokens/s, 1 tokens, context 1767, seed 442926529)
127.0.0.1 - - [09/Aug/2023 06:03:19] "POST /api/v1/generate HTTP/1.1" 200 -
Output generated in 0.77 seconds (3.92 tokens/s, 3 tokens, context 1767, seed 894830108)
127.0.0.1 - - [09/Aug/2023 06:03:23] "POST /api/v1/generate HTTP/1.1" 200 -
Output generated in 0.86 seconds (3.47 tokens/s, 3 tokens, context 1767, seed 196638932)
127.0.0.1 - - [09/Aug/2023 06:03:28] "POST /api/v1/generate HTTP/1.1" 200 -
Output generated in 0.80 seconds (1.25 tokens/s, 1 tokens, context 1767, seed 2105262321)
127.0.0.1 - - [09/Aug/2023 06:03:33] "POST /api/v1/generate HTTP/1.1" 200 -
Output generated in 0.89 seconds (1.12 tokens/s, 1 tokens, context 1767, seed 955783745)
127.0.0.1 - - [09/Aug/2023 06:03:40] "POST /api/v1/generate HTTP/1.1" 200 -

In SillyTavern log, I see the check returning

{ results: [ { text: '\nfalse' } ] }

In SillyTavern Extras:

127.0.0.1 - - [09/Aug/2023 06:03:08] "POST /api/classify HTTP/1.1" 200 -
127.0.0.1 - - [09/Aug/2023 06:03:15] "OPTIONS /api/chromadb/query HTTP/1.1" 200 -
127.0.0.1 - - [09/Aug/2023 06:03:16] "POST /api/chromadb/query HTTP/1.1" 200 -
127.0.0.1 - - [09/Aug/2023 06:03:19] "POST /api/chromadb/query HTTP/1.1" 200 -
127.0.0.1 - - [09/Aug/2023 06:03:22] "OPTIONS /api/chromadb/query HTTP/1.1" 200 -
127.0.0.1 - - [09/Aug/2023 06:03:22] "POST /api/chromadb/query HTTP/1.1" 200 -
127.0.0.1 - - [09/Aug/2023 06:03:27] "POST /api/chromadb/query HTTP/1.1" 200 -
127.0.0.1 - - [09/Aug/2023 06:03:32] "OPTIONS /api/chromadb/query HTTP/1.1" 200 -
127.0.0.1 - - [09/Aug/2023 06:03:33] "POST /api/chromadb/query HTTP/1.1" 200 -
127.0.0.1 - - [09/Aug/2023 06:03:39] "OPTIONS /api/chromadb/query HTTP/1.1" 200 -
127.0.0.1 - - [09/Aug/2023 06:03:40] "POST /api/chromadb/query HTTP/1.1" 200 -

Tried with Python versions 3.10 and 3.11. This isn't something I've tried in previous versions of SillyTavern, so I do not know if it used to work before. I know I'm connected to the Extras server, and summarization is working just fine.

I apologize if that's not enough info, please let me know if there's anything else I should add.

Originally created by @fanafo on GitHub (Aug 9, 2023). Original GitHub issue: https://github.com/SillyTavern/SillyTavern-Extras/issues/114 Running locally. Struggling to get the Objectives plugin to work. When a task check is performed, I get the following error message after a few seconds: "Could not extract reply in 5 attempts. Try generating again." In Oobabooga/text-gen-ui log, I see the following with each check: ``` 127.0.0.1 - - [09/Aug/2023 06:03:16] "POST /api/v1/generate HTTP/1.1" 200 - Output generated in 0.87 seconds (1.15 tokens/s, 1 tokens, context 1767, seed 442926529) 127.0.0.1 - - [09/Aug/2023 06:03:19] "POST /api/v1/generate HTTP/1.1" 200 - Output generated in 0.77 seconds (3.92 tokens/s, 3 tokens, context 1767, seed 894830108) 127.0.0.1 - - [09/Aug/2023 06:03:23] "POST /api/v1/generate HTTP/1.1" 200 - Output generated in 0.86 seconds (3.47 tokens/s, 3 tokens, context 1767, seed 196638932) 127.0.0.1 - - [09/Aug/2023 06:03:28] "POST /api/v1/generate HTTP/1.1" 200 - Output generated in 0.80 seconds (1.25 tokens/s, 1 tokens, context 1767, seed 2105262321) 127.0.0.1 - - [09/Aug/2023 06:03:33] "POST /api/v1/generate HTTP/1.1" 200 - Output generated in 0.89 seconds (1.12 tokens/s, 1 tokens, context 1767, seed 955783745) 127.0.0.1 - - [09/Aug/2023 06:03:40] "POST /api/v1/generate HTTP/1.1" 200 - ``` In SillyTavern log, I see the check returning ``` { results: [ { text: '\nfalse' } ] } ``` In SillyTavern Extras: ``` 127.0.0.1 - - [09/Aug/2023 06:03:08] "POST /api/classify HTTP/1.1" 200 - 127.0.0.1 - - [09/Aug/2023 06:03:15] "OPTIONS /api/chromadb/query HTTP/1.1" 200 - 127.0.0.1 - - [09/Aug/2023 06:03:16] "POST /api/chromadb/query HTTP/1.1" 200 - 127.0.0.1 - - [09/Aug/2023 06:03:19] "POST /api/chromadb/query HTTP/1.1" 200 - 127.0.0.1 - - [09/Aug/2023 06:03:22] "OPTIONS /api/chromadb/query HTTP/1.1" 200 - 127.0.0.1 - - [09/Aug/2023 06:03:22] "POST /api/chromadb/query HTTP/1.1" 200 - 127.0.0.1 - - [09/Aug/2023 06:03:27] "POST /api/chromadb/query HTTP/1.1" 200 - 127.0.0.1 - - [09/Aug/2023 06:03:32] "OPTIONS /api/chromadb/query HTTP/1.1" 200 - 127.0.0.1 - - [09/Aug/2023 06:03:33] "POST /api/chromadb/query HTTP/1.1" 200 - 127.0.0.1 - - [09/Aug/2023 06:03:39] "OPTIONS /api/chromadb/query HTTP/1.1" 200 - 127.0.0.1 - - [09/Aug/2023 06:03:40] "POST /api/chromadb/query HTTP/1.1" 200 - ``` Tried with Python versions 3.10 and 3.11. This isn't something I've tried in previous versions of SillyTavern, so I do not know if it used to work before. I know I'm connected to the Extras server, and summarization is working just fine. I apologize if that's not enough info, please let me know if there's anything else I should add.
Author
Owner

@Cohee1207 commented on GitHub (Aug 9, 2023):

Do you have "trim incomplete sentences" setting enabled? I think it might trim too much from your reply when it receives a reply.

<!-- gh-comment-id:1671316064 --> @Cohee1207 commented on GitHub (Aug 9, 2023): Do you have "trim incomplete sentences" setting enabled? I think it might trim too much from your reply when it receives a reply.
Author
Owner

@fanafo commented on GitHub (Aug 9, 2023):

That was exactly the issue, Cohee, thank you.

<!-- gh-comment-id:1671351126 --> @fanafo commented on GitHub (Aug 9, 2023): That was exactly the issue, Cohee, thank you.
Author
Owner

@Cohee1207 commented on GitHub (Aug 9, 2023):

Updated in staging to fix this for future users. Thanks.
github.com/SillyTavern/SillyTavern@e39e9428b6

<!-- gh-comment-id:1671352278 --> @Cohee1207 commented on GitHub (Aug 9, 2023): Updated in staging to fix this for future users. Thanks. https://github.com/SillyTavern/SillyTavern/commit/e39e9428b616628e10579369d83a1a88307919bf
Sign in to join this conversation.
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
SillyTavern/SillyTavern-Extras#70
No description provided.