

The thing is, AI companies are terrified of model collapse because if they train AI systems on AI output, the model becomes useless.
That’s actually not a fact, more of a possibility. As far as am I aware, reinforcement learning from AI feedback (RLAIF) is currently employed by some of the most capable frontier AI companies; Anthropic openly admits to it, and their models are arguably the best.
A term that is often thrown around nowadays is recursive self-improvement (RSI), and it seems that there are at this time more knowledgeable proponents of RSI for intelligence development than opponents who raise the risk of model collapse.
But yes, training on today’s sloppified public internet would probably only have downsides.


That’s exactly what her attorney is asking for.