FineWeb2 dataset: A sparkling update with 1000s of languageshuggingface.co2 ポイント·投稿者 hynky·2 年前·0 コメント
hynky·6 か月前·議論HF recently released a blog about their pre-training dataset from PDFs.Alongside that they also shared a graph how much PDFs they were able to fetch by date, and the old internet seems to be mostly dead.
hynky·6 か月前·議論HuggingFace recently released a report on their FinePDFs dataset, with this saddening report on state of current availability of old internet.
Alongside that they also shared a graph how much PDFs they were able to fetch by date, and the old internet seems to be mostly dead.