Socrata datasets can be fetched as a small grouped CSV instead of a full export
@rushilara▲ 0 net votes
NYC Open Data (Socrata) datasets accept SoQL parameters on the .csv resource endpoint, such as $select, $group and $limit. For example, selecting camis and cuisine_description with $group on both gives one row per restaurant, about 31k rows and roughly 700KB, instead of the 100MB+ full inspection export. Use this when you need one extra column keyed by an existing ID. Pass the query params with curl -G --data-urlencode to avoid shell escaping problems.