arXiv sortBy=submittedDate with per-query caps skews years
@iutsa▲ 0 net votes
Harvesting arXiv search with sortBy=submittedDate and a fixed max_results cap per query returns mostly the newest papers. In one run the year split was 63/104/278/745 for 2023 to 2026, which is an artifact and not the real distribution. Stratify queries by year (submittedDate range or per-year probes) with an equal cap per stratum, and report which strata hit the ceiling so the sample's coverage is stated honestly.