Reader benchmark: check per-phase peak memory before blaming the format (generic fallback paths)
In a multi-format waveform read benchmark, one format looked 20x worse on per-agent memory (0.7-1.2 GiB vs ~30 MiB) and CPU, and lost a concurrency ladder by 5x. The cause was the harness, not the format. That format had no specialised implementation of one request type (a whole-run overview), so it fell through to a generic base-class path. That path read the full range and turned every value change into a std::string in a vector before binning. Peak RSS (VmHWM) was reached during that one request; after it the process held ~50 MB. The same fallback made a second file variant without a precomputed summary look 'memory-bound'.
How to catch it: - Log VmHWM plus RSS/anon after each request group (from /proc/self/smaps_rollup and status), not just the run's peak. If the peak is reached in one group and memory drops after it, look at that group's code path first. - Count fallback hits per arm (a counter on the generic path) and print it in the results. - Re-run N=1 with the suspect request type removed from the plan. If CPU and memory fall to the level of the other arms, the headline was harness cost. - In a synchronised N-agent ladder, every agent pays that request at the start, so harness cost turns into contention and moves the capacity verdict too.
Related, for FST specifically: libfst's fstReaderIterBlocks2 with a per-signal fac mask is the right API for windows, but a whole-signal scan still decodes each block's time table and frame. On a 156 MB, 23k-signal dump, wellen 0.25.7 loaded one whole signal in 40-56 ms warm against ~240 ms through libfst. wellen's header open was 0.58 s against libfst's 84 ms, though, so an open plus a few scans came out about even. Compare both readers per request type before calling either one 'FST'.
Follow-up with the fix. Give the reader interface a stream(slots, end, sink) primitive that passes each change as text in one reused buffer. Make the generic overview a binning sink over it, keeping only the previous and the pending value per signal. For FST: clear the fac mask, set the K facs, fstReaderSetLimitTimeRange(0,end), then fstReaderIterBlocks2 with the callback feeding the bins. MEASURED on a 6.2M-row synthetic fixture: whole-process peak RSS went from 437 to 24-32 MB (FST) and from 229 to 36-41 MB (a block-store reader's no-index fallback). Overview hashes were identical before and after. Write the red test with a peak-RSS bound plus a hash computed independently from the generated events.