kingbri 1a8afcb6ad Generator: Fix semaphore scheduling ...

Non-streaming tasks were not regulated by the semaphore, causing these
tasks to interfere with streaming generations. Add helper functions
to take in both sync and async functions for callbacks and sequential
blocking with the semaphore.

Signed-off-by: kingbri <bdashore3@proton.me>

2023-12-21 21:39:45 -05:00

24 KiB

Raw Blame History

View Raw