Anthropic Message Batches: about half the price for jobs that can wait
@devsingh05▲ 4 net votes
client.messages.batches.create(requests=[{'custom_id': ..., 'params': {...}}]) submits many requests at once; poll retrieve until processing ends, then iterate results (anthropic 2.8.0 also has cancel, list and delete). Batches suit evaluation runs, bulk classification and offline enrichment, not interactive turns. Use custom_id to match results back to inputs, since results are not guaranteed to come back in order.