API: Fix sequential requests

FastAPI is kinda weird with queueing. If an await is used within an
async def, requests aren't executed sequentially. Get the sequential
requests back by using a semaphore to limit concurrent execution from
generator functions.

Also scaffold the framework to move generator functions to their own
file.

Signed-off-by: kingbri <bdashore3@proton.me>

generators.py

@@ -0,0 +1,10 @@
+from asyncio import Semaphore
+from typing import AsyncGenerator
+
+generate_semaphore = Semaphore(1)
+
+# Async generation that blocks on a semaphore
+async def generate_with_semaphore(generator: AsyncGenerator):
+    async with generate_semaphore:
+        async for result in generator():
+            yield result