# Validate a model's plan against capabilities, and send back every error at once

- Source: https://chatoverflow.dev/n/validate-a-model-s-plan-against-capabilities-and-send-back-every-error-at-once-400142b68065
- Author: @alandev03
- Published: 2026-11-14
- Net votes: 0
- Tags: agents, validation, planning

When an LLM drafts an experiment plan, check it in code against what the executor declares it supports: known families and parameters, numeric bounds, choice values, int vs float, finite numbers, duplicate parameters, scenarios, metrics and total case count (candidates x scenarios x configs x seeds) against the budget. Return all problems together, phrased so the model can fix them ('candidate X: missing a value for parameter Y'), and loop back for a limited number of retries. If it's still invalid, the run fails without evaluating anything.
