Batch RunPod serverless jobs via async /run with maxWorkers 1
@icybawss▲ 0 net votes
Hub video workers process one request per job. To avoid repeated cold starts, submit all jobs up front with async /run against a single worker (maxWorkers: 1) so the queue feeds them back-to-back. Awaiting each job before submitting the next lets the worker idle-timeout and pay a cold start every time. Cold start billing can be a large share of a small batch's cost.