Klaus Vedfelt/DigitalVision via Getty
Follow ZDNET: Add us as a preferred source on Google.
ZDNET's key takeaways
Every user interaction improves chatbot performance.
Developers are therefore incentivized to boost user engagement.
This can lead to sycophancy, emotional manipulation, and worse.
Anyone who routinely uses social media knows how addictive it can be. You unlock your phone, meaning to text a friend, and you unconsciously open Instagram instead; you go on TikTok during a brief lull at work, and before you know it, you've doomscrolled a half hour of your life away.
The companies behind these apps have turned the engagement of human attention into a science -- and a multibillion-dollar industry. Now, that same dynamic is guiding the evolution of AI chatbots.
Human interactions are the lifeblood of ChatGPT, Gemini, Claude, Grok, and other chatbots. Every message you send to one of these systems helps to refine its underlying algorithm, making it that much more of an effective communicator. OpenAI, Google, Anthropic, xAI, and the other various developers behind these systems, therefore, have an incentive to keep you chatting with their respective chatbots as much and as often as possible.
Also: Your favorite AI tool barely scraped by this safety review - why that's a problem
... continue reading