[GH-ISSUE #7] feat: add guardrail example #14

New issue

Closed

opened 2026-10-18 21:01:32 +00:00 by bsakaguchi · 3 comments

bsakaguchi commented

2026-10-18 21:01:32 +00:00

Owner

Originally created by @tjbck on GitHub (May 24, 2024).
Original GitHub issue: https://github.com/open-webui/pipelines/issues/7

(e.g. detect toxicity -> if toxic == True: return "I cannot help you with that")

Originally created by @tjbck on GitHub (May 24, 2024). Original GitHub issue: https://github.com/open-webui/pipelines/issues/7 (e.g. detect toxicity -> if toxic == True: return "I cannot help you with that")

bsakaguchi

2026-10-18 21:01:32 +00:00

closed this issue
added the
good first issue
label

bsakaguchi commented

2026-10-18 21:01:32 +00:00

Author

Owner

@mkhludnev commented on GitHub (May 27, 2024):

Pardon. It might be obvious, but how to detect toxicity? Just a hell bunch of regexps?

@mkhludnev commented on GitHub (May 27, 2024): Pardon. It might be obvious, but how to detect toxicity? Just a hell bunch of regexps?

bsakaguchi commented

2026-10-18 21:01:33 +00:00

Author

Owner

@tjbck commented on GitHub (May 27, 2024):

We could probably use another LLM pipeline (prompt engineering) to detect 😅 or use something like https://github.com/unitaryai/detoxify

@tjbck commented on GitHub (May 27, 2024): We could probably use another LLM pipeline (prompt engineering) to detect 😅 or use something like https://github.com/unitaryai/detoxify

bsakaguchi commented

2026-10-18 21:01:33 +00:00

Author

Owner

@tjbck commented on GitHub (May 29, 2024):

https://github.com/open-webui/pipelines/blob/main/pipelines/examples/detoxify_filter_pipeline.py

@mkhludnev Just added here, feel free to try it out and let me know if you encounter any issues!

@tjbck commented on GitHub (May 29, 2024): https://github.com/open-webui/pipelines/blob/main/pipelines/examples/detoxify_filter_pipeline.py @mkhludnev Just added here, feel free to try it out and let me know if you encounter any issues!