[GH-ISSUE #98] enh: wakeword detection #1

Open
opened 2026-10-18 14:04:59 +00:00 by bsakaguchi · 5 comments
Owner

Originally created by @tjbck on GitHub (Jul 2, 2024).
Original GitHub issue: https://github.com/open-webui/desktop/issues/98

"Hey assistant" should toggle on the voice call.

Originally created by @tjbck on GitHub (Jul 2, 2024). Original GitHub issue: https://github.com/open-webui/desktop/issues/98 "Hey assistant" should toggle on the voice call.
Author
Owner

@moblangeois commented on GitHub (Jul 4, 2024):

Hello,

I came across a project that might be relevant to this issue regarding wake word detection. The project is called GLaDOS (https://github.com/dnhkng/GlaDOS).

While browsing their code, I found an interesting implementation of voice recognition and wake word detection that could potentially be adapted for our "Hey assistant" feature. You can find the relevant code here:

github.com/dnhkng/GlaDOS@99fbf5e182/glados/voice_recognition.py (L159)

Some key points about this implementation:

  1. It uses a Voice Activity Detection (VAD) model to detect when speech is occurring.
  2. It employs an Automatic Speech Recognition (ASR) model for transcription.
  3. It includes a wake word detection method using Levenshtein distance to allow for slight variations in pronunciation.

The project is under the MIT license, which is permissive and should allow us to adapt parts of their code if we decide it's useful for our implementation.

I believe this could serve as a good starting point.

<!-- gh-comment-id:4241684030 --> @moblangeois commented on GitHub (Jul 4, 2024): Hello, I came across a project that might be relevant to this issue regarding wake word detection. The project is called GLaDOS (https://github.com/dnhkng/GlaDOS). While browsing their code, I found an interesting implementation of voice recognition and wake word detection that could potentially be adapted for our "Hey assistant" feature. You can find the relevant code here: https://github.com/dnhkng/GlaDOS/blob/99fbf5e182ed2c60e075bd1241d67f68f6833b8e/glados/voice_recognition.py#L159 Some key points about this implementation: 1. It uses a Voice Activity Detection (VAD) model to detect when speech is occurring. 2. It employs an Automatic Speech Recognition (ASR) model for transcription. 3. It includes a wake word detection method using Levenshtein distance to allow for slight variations in pronunciation. The project is under the MIT license, which is permissive and should allow us to adapt parts of their code if we decide it's useful for our implementation. I believe this could serve as a good starting point.
Author
Owner

@jmtatsch commented on GitHub (Jul 5, 2024):

https://github.com/dscripka/openWakeWord

<!-- gh-comment-id:4241684049 --> @jmtatsch commented on GitHub (Jul 5, 2024): https://github.com/dscripka/openWakeWord
Author
Owner

@moblangeois commented on GitHub (Jul 5, 2024):

https://github.com/dscripka/openWakeWord

Seems to use onnxruntime 'onnxruntime>=1.10.0,<2', while we use onnxruntime==1.17.3 for OCR it seems. Therefore it should be good.

<!-- gh-comment-id:4241684064 --> @moblangeois commented on GitHub (Jul 5, 2024): > https://github.com/dscripka/openWakeWord Seems to use onnxruntime `'onnxruntime>=1.10.0,<2',` while we use `onnxruntime==1.17.3` for OCR it seems. Therefore it should be good.
Author
Owner

@tjbck commented on GitHub (Jul 5, 2024):

Requirements for this would be

  • ideally the model should run on the browser end
  • Should be easily customizable in the future to allow custom wakewords

I’ll add more to the list in the future.

<!-- gh-comment-id:4241684074 --> @tjbck commented on GitHub (Jul 5, 2024): Requirements for this would be - ideally the model should run on the browser end - Should be easily customizable in the future to allow custom wakewords I’ll add more to the list in the future.
Author
Owner

@svdasein commented on GitHub (May 18, 2026):

Just curious - is the idea that the wake up word is recognized by something in the browser, or does the browser stream all the audio it receives to openwebui which then scans for the word? I do get that there's a desktop app in the works somewhere as well.

<!-- gh-comment-id:4474189258 --> @svdasein commented on GitHub (May 18, 2026): Just curious - is the idea that the wake up word is recognized by something _in_ the browser, or does the browser stream all the audio it receives to openwebui which then scans for the word? I do get that there's a desktop app in the works somewhere as well.
Sign in to join this conversation.
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
open-webui/desktop#1
No description provided.