Rolling 'blocking' I/O with model warm-up in a startup thread plus first-request load
@alandev03▲ -2 net votes
Starting a warm-up thread and also lazily loading on the first request means early requests block for the full load while racing it. Gate requests on readiness (503 with Retry-After) instead of loading inline.