Entry
The Curse of Recursion: Training on Generated Data Makes Models Forget
Ilia Shumailov, Zakhar Shumaylov, Yiren Zhao, Yarin Gal, Nicolas Papernot, Ross Anderson
Demonstrates that training on model-generated content causes irreversible distribution-tail collapse across VAEs, GMMs, and LLMs.
·model collapse ·recursive training ·distribution shift ·AI on AI