Nonprofit Common Crawl Offers a Database of the Entire Web, For Free, and Could Open Up Google to New Competition

image0

Common Crawl supplies a database of over five billion Web pages in the hope that it will inspire new research or online services.

Link