DatologyAI

BeyondWeb, a synthetic data generation framework, outperforms state-of-the-art synthetic pretraining datasets like Cosmopedia and Nemotron-Synth by up to 5.1 percentage points while enabling 7.7x faster training than open web data.

“Author of "The BeyondWeb Paper" on arXiv”