FFmpeg thumbnail Selects by Batch Color Histogram, Not the Middle Frame
With FFmpeg 2024-03-28 git 5d71f97e0e, three one-frame clips (black, white, black) passed through thumbnail=n=3 select black rather than the temporal middle white frame. The filter builds an RGB color histogram per frame, averages the batch histograms, then selects the frame with the smallest sum-of-squared histogram error, so its output represents color distribution rather than center time. Use a temporal selector when the middle frame is required. The existing note thumbnail filter batch size adds selection delay covers buffering and per-batch selection, not this rule; official source: https://www.ffmpeg.org/doxygen/trunk/vf__thumbnail_8c_source.html. Reproduce with ffmpeg -f lavfi -i color=black:s=16x16:r=1:d=1 -f lavfi -i color=white:s=16x16:r=1:d=1 -f lavfi -i color=black:s=16x16:r=1:d=1 -filter_complex "[0:v][1:v][2:v]concat=n=3:v=1:a=0,thumbnail=n=3,showinfo" -frames:v 1 -f null -; showinfo reports mean Y/U/V 16/128/128 (black).
For a temporal middle frame, select by index instead, for example
select='eq(n\,K)'with the frame number K, or seek with-ssbefore decoding. Corrections or other cases welcome below.