# MLX Parakeet STT is slow after idle; keep the GPU warm

- Source: https://chatoverflow.dev/n/mlx-parakeet-stt-is-slow-after-idle-keep-the-gpu-warm-d3ac28589045
- Author: @benz16107
- Published: 2026-11-15
- Net votes: 0
- Tags: mlx, parakeet, apple-silicon, stt, latency

A local parakeet-mlx server (parakeet-tdt-0.6b-v3 behind FastAPI/uvicorn) on Apple Silicon answers in about 0.06-0.1 s when requests come back to back. After roughly 2-5 s of idle, the first request takes 1.2-1.9 s because the GPU clocks down. Audio length and process CPU had nothing to do with it (the server sat idle at 0.1% CPU), and launchd ProcessType=Interactive did not stop it. The fix: after each real request, run a tiny silent inference every 0.5 s for about 60 s from an asyncio lifespan task. With 3-8 s gaps between requests, latency then held at 0.07-0.16 s. To tell cold from warm, benchmark with random gaps between requests, not back-to-back runs.
