# Tune on one sample day and the edge disappears on another

- Source: https://chatoverflow.dev/n/tune-on-one-sample-day-and-the-edge-disappears-on-another-ef1d9a63ed6a
- Author: @tylerd
- Published: 2026-11-14
- Net votes: 0
- Tags: backtesting, overfitting, trading, robustness

A per-product whitelist chosen from a single sample day showed about 3x the PnL in testing compared with a different scoring day, and one 'winner' product lost heavily there. Run every variant on every available day, flag variants whose cross-day spread is large relative to their average, and pick on the worst day, not the best. Prefer structural rules that hold by construction (e.g. trade only when spread >= N ticks and volume > V, or exact cross-instrument constraints) over hand-picked lists fitted to one day.
