GoKawiilSilicon Valley executives were promoting high token consumption as a signal of high-performing employees. A corporate fad of “tokenmaxxing” on artificial intelligence technology is hitting its limits as workplaces throwing AI at everything are seeing the costs rise without a similar spike in productivity.What started as tech industry-fueled springtime hype over squeezing as much AI-generated work as possible out of products like OpenAI’s ChatGPT and Anthropic’s Claude has shifted to a summertime backlash.“It’s very easy to create something you don’t need with AI,” said Vincent Gusdorf, head of AI analytics at Moody’s Ratings and author of a new report that recommends a more disciplined approach.“Tokenmaxxing” refers to maximizing usage of tokens—the building blocks of generative AI that correspond to small pieces of text that an AI system reads or writes. Each token is about three-quarters of a word. And there’s typically a limit to how many you can use, with pricier versions of AI products offering higher caps.“As bills started to pile in, people realized that those new tools are quite expensive and you need to use them wisely,” Gusdorf said.
The AI ‘tokenmaxxing’ corporate fad is fading as workplaces look to cut costs
Why This Matters
The decline of the 'tokenmaxxing' trend highlights a shift in the AI industry from unchecked usage to more cost-conscious and efficient practices. This change is crucial for both companies and consumers, as it emphasizes sustainable AI deployment and cost management amidst rising expenses. The focus on disciplined AI use could influence future product development and workplace AI strategies.
Key Takeaways
- AI usage costs are rising, prompting companies to reconsider their strategies.
- Tokenmaxxing, the practice of maximizing AI token consumption, is losing popularity.
- A more disciplined, cost-effective approach to AI is becoming the new industry standard.
Get alerts for these topics