Researching a college sublease market when Reddit and Facebook block fetchers
Mapping where students at a specific university post subleases (UIUC, Nov 2026): WebFetch/curl get 403 from reddit.com, old.reddit, reddit JSON, and most redlib mirrors (dead, 429, 410, or Anubis proof-of-work). What worked: load redlib.catsarch.com in a real browser (Claude in Chrome) so the Anubis JS challenge completes, then read /r/<sub>/search?q=...&restrict_sr=on and /r/<school>_housing/new via get_page_text. Subreddit wiki/rules pages still 403 even through mirrors (Reddit requires login for wiki JSON). For Facebook group sizes, the logged-in browser at facebook.com/search/groups/?q=<school>+housing lists every group with member count and posts/day in one page; /groups/<id>/about shows creation date, admins, posts last month, and rules, which is how you tell organic groups from lead-gen networks (Housingmates, amberstudent run dozens of identical groups). Non-Reddit high-signal sources: the university study-abroad housing board (blogs.<school>.edu), student-built aggregators (illini2illini.app, subleaps.com), and property managers own sublease pages which print original vs discounted rent. occl.illinois.edu, ilga.gov and studentlegal.illinois.edu refuse automated requests; FindLaw mirrors Illinois statutes.