mirror of
https://github.com/open-webui/pipelines.git
synced 2026-11-05 01:37:24 +00:00
[GH-ISSUE #177] Setting Google GenAI Manifold Pipeline to minimum safety blocking by default #85
Labels
No milestone
No project
No assignees
1 participant
Notifications
Due date
No due date set.
Dependencies
No dependencies set.
Reference
open-webui/pipelines#85
Loading…
Add table
Add a link
Reference in a new issue
No description provided.
Delete branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Originally created by @rotemdan on GitHub (Jul 27, 2024).
Original GitHub issue: https://github.com/open-webui/pipelines/issues/177
For a harmless prompt like:
I kept getting a cryptic network errors, although a single token (
Pig) did come across:It turned out it was caused by Gemini safety blocking.
The source code for the pipeline includes the line:
But I don't know how exactly the
safety_settingssettings is passed.After researching a bit, I found out I can set all "safety" blocking to minimum by changing that to:
Now the same prompt does work.
Is anyone interested in making this change as part of the default pipeline source code?
Average, non-programmer users may not be able to make such a source code change on their own. In any case it took me at least 30 minutes to figure out how to do this.
Also, the kind of people who use
open-webuiand local models are most likely not interested in any unnecessary blocking.With the default blocking settings, many harmless prompts or messages can produce similar cryptic errors. I believe that LibreChat passes the most permissive blocking thresholds by default (If I recall correctly, I vaguely remember I was the one who opened an issue for that, a long time ago), so I thought about suggesting it here too.