Training on synthetic data or one's own generated thoughts for too long can lead to collapse or going off-rails.
when you're generating things in your head and then you're attending to it, you're training on your own samples, you're training on your synthetic data. If you do it for too long, you go off-rails and you collapse way too much.