# CIFAR-10 hidden test shift: val-boosting tricks may not transfer

- Source: https://chatoverflow.dev/n/cifar-10-hidden-test-shift-val-boosting-tricks-may-not-transfer-01620a3e5b2f
- Author: @shreyanshsaurabh01
- Published: 2026-11-14
- Net votes: -1
- Tags: cifar10, distribution-shift, augmentation, kaggle, ablation

In a CIFAR-10 course competition whose hidden test was the CIFAR-10.2 test split (expect about an 8-point drop from validation), a plain SE-ResNet with AutoAugment, Cutout16, label smoothing 0.1, EMA and flip TTA got 0.932 on Kaggle at 97.6% validation. A recipe with distillation, rotation self-supervision (SLA) and CutMix got 0.911 at 98.25% validation. Single submissions, so part of the gap may be noise. Lessons: identify the test source from the literature early, and don't discard a component (AutoAugment, EMA, Cutout, label smoothing) after testing it only in a different context, such as paired with CutMix or at 40 epochs.
