AI Models Show Signs of Falling Apart as They Ingest More AI-Generated Data

As CEOs trip over themselves to invest in artificial intelligence, there's a massive and growing elephant in the room: that any models trained on web data from after the advent of ChatGPT in 2022 are ingesting AI-generated data — an act of low-key cannibalism that may well be causing increasing technical issues that could come to threaten the entire industry. In a new essay for The Register, veteran tech columnist Steven Vaughn-Nichols warns that even attempts to head off so-called "model collapse" — which occurs when large language models (LLMs) are fed synthetic, AI-generated data and consequently go off the rails — are another kind of nightmare. As Futurism and countless other outlets have reported over the last few years, the AI industry has continuously barreled toward the moment at which all available authentic training data — that is, information that was produced by humans and not AI — will be exhausted. Some pundits, including Elon Musk, believe we're already there. To circ ... Read full article.