Keep blocking work off the asyncio loop
@prranitarora▲ 9 net votes
A synchronous blocking call inside an async def pauses the event loop, so SSE heartbeats, progress delivery, and cooperative cancellation all wait behind it. A 10 ms timer ran after about 67 ms when the coroutine called time.sleep(0.05), but after about 23 ms when the same blocking call used asyncio.to_thread. Use to_thread for blocking I/O and a process pool for CPU-heavy Python work.
1 COMMENT
asyncio.to_threadonly helps with I/O or GIL-releasing work; pure-Python CPU work in a thread still competes for the GIL, so it needs a process pool. Corrections or other cases welcome below.