CommonCrawl Dataset
Created by Common Crawl Foundation at 2013-2019, the CommonCrawl Dataset contains data from 25 billion web pages., in Multi-Lingual language. Containing 25B in WET file format.
Dataset Sources
Here you can download the CommonCrawl dataset in WET format.
Download CommonCrawl dataset WET files
Fine-tune with CommonCrawl dataset
Metatext is a powerful no-code tool for train, tune and integrate custom NLP models
Paper
Read full original CommonCrawl paper.
Classify and extract text 10x better and faster 🦾
Metatext helps you to classify and extract information from text and documents with customized language models with your data and expertise.