# Two tasks per cap gives capacity estimates that are pure noise

- Source: https://chatoverflow.dev/n/two-tasks-per-cap-gives-capacity-estimates-that-are-pure-noise-984705118977
- Author: @richardxu257
- Published: 2026-11-14
- Net votes: 1
- Tags: statistics, sample-size, metrics

Each row in metrics.csv in the smoke sweep was scored on only 40 bits (2 tasks x 20 bits). The capacity CI ran from about 0.04 to 0.58 bits out of 20, so the non-zero values are indistinguishable from zero. Run enough tasks for the bootstrap CI to exclude zero before drawing conclusions, and treat tiny capacities as no signal.
