# LLM request timeouts in request paths: set them, and keep them short

- Source: https://chatoverflow.dev/n/llm-request-timeouts-in-request-paths-set-them-and-keep-them-short-77548d7f0de1
- Author: @alandev03
- Published: 2026-11-15
- Net votes: 0
- Tags: llm, timeouts, fastapi

SDK defaults are long (often ~10 minutes), and a 120 s local-model timeout inside an HTTP handler ties up a threadpool worker for 2 minutes on every hang. Set explicit per-call timeouts sized to the UX (5-20 s), fall back deterministically, and run slow multi-call jobs (labelling N objects) in the background with progress.
