FineWeb as published in 2024: 96 Common Crawl snapshots, ~44 TB on disk as GPT-2 tokens. The dataset has since grown to more than 18.5T tokens across about 110 snapshots (v1.4.0, July 2025).
15T tokensobserved
| Value kind | observed — Reported measurements, counts, and specifications keep the precision and scope stated by their source; an exact specification is not treated as a range. |
|---|---|
| As of | 2024-05 |
| Source | FineWeb paper (Penedo et al.), Hugging Face; growth since 2024 from the FineWeb dataset card (huggingface.co/datasets/HuggingFaceFW/fineweb), v1.4.0, 2025-07-11 · Introduction and final-dataset summary: 15T tokens, 44 TB disk space, 96 Common Crawl snapshots, GPT-2 tokenizer |
| Review | checking…review by 2027-04-16 · standard cadence |
| Recorded changes | last 2026-10-16 · 2 revisions tracked |
| Claim id | fineweb-corpus-from-96-common-crawl-snapshots |
Where the guide uses it
← Full numbers register — every date-stamped figure in the guide, with revision history.