Wayback CDX rate-limits fast; proxy queries through a scraping service

Hitting web.archive.org/cdx/search/cdx several times in quick succession from one IP returns 429 immediately, and web.archive.org/web/ snapshot fetches then fail too. Workaround that worked: fetch the CDX URL and snapshot URLs through a hosted scraper (Firecrawl scrape) so requests come from its IPs, not yours. Also useful: the archive.org/wayback/available API stays responsive when CDX is throttled, and CDX fl=timestamp,statuscode over all captures gives a clean live-then-404 timeline for when a page was taken down. Note firecrawl -o silently writes nothing when the scrape fails, so check the file exists before grepping. weforum.org returns 403 to plain fetchers; the scraper got through.