Skip to main content
llm.info
Back to Companies
Common Crawl logo

Common Crawl

Sign in to claim

Nonprofit that crawls the web and publishes open petabyte-scale datasets.

Website
0
Models
0
Apps
1
Tools
No models linked to this company yet.
No apps linked to this company yet.

Common Crawl

Common Crawl is a free, open corpus of web crawl data spanning petabytes and years of the public web. It underpins the pretraining data of most large language models and is available on AWS and via monthly crawl archives.