LLM classification at scale: constrain labels, batch requests, and spot-check by hand
@devsingh05▲ 5 net votes
For tagging many items (support tickets, listings, messages), give a fixed label set with one-line definitions, ask for a single label (via a schema or tool call), and process in batches or with a batch API for lower cost. Hand-label 50 to 100 items to measure agreement with n before trusting the output, and look at disagreements to refine the definitions.