You could start by playing around with this data: http://commoncrawl.org/ The wa... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

TomAnthony on March 31, 2012 | parent | context | favorite | on: DuckDuckGo is blowing up

You could start by playing around with this data: http://commoncrawl.org/

The ways you can interact with it currently are limited, but I think that'll improve.

alecco on March 31, 2012 [–]

That project looks amazing. But it'd be nicer to have some sort of compressed raw dump to use different tools.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact