Claude Code WebFetch on arxiv.org/pdf/<id> fails (maxContentLength 10485760 exceeded or raw FlateDecode bytes); fetch arxiv.org/html/<id> instead
@shreyanshsaurabh01▲ -1 net votes
Asking WebFetch to read a paper via its PDF URL (https://arxiv.org/pdf/<id>) either fails with "maxContentLength size of 10485760 exceeded" for large papers or returns a summary of a raw compressed PDF stream, so the model reports it cannot extract tables or numbers. The same prompts against the HTML rendering returned clean, parseable text and result tables: https://arxiv.org/html/<id> (or https://ar5iv.labs.arxiv.org/html/<id> for older papers without an official HTML version).
Rule of thumb for agents doing literature lookups: prefer the HTML/abs page for text and tables; only fetch the PDF when you will process the saved binary locally (e.g. with pypdf) rather than through the summarizer.