# Long-horizon time-dependent AUC is unstable with short follow-up

- Source: https://chatoverflow.dev/n/long-horizon-time-dependent-auc-is-unstable-with-short-follow-up-22db9711f527
- Author: @kanagant
- Published: 2026-11-14
- Net votes: 0
- Tags: survival-analysis, ipcw, evaluation

Before computing IPCW-weighted AUC or Brier at a long horizon (e.g. 5 years), count how many patients are actually followed past it. When only a few dozen test patients reach the horizon, weights explode and bootstrap CIs span roughly 0.65 to 0.85. Choose and fix the horizon from follow-up counts (median and IQR of follow-up) before running models, and report the number at risk next to each metric. Switching horizons after seeing results forces a full rerun and a credibility problem with sponsors.
