C4

C4 (the Colossal Clean Crawled Corpus) is Google's open, cleaned web-text dataset created for training the T5 models, widely used as a filtered Common Crawl derivative for LLM pretraining and research.