GoKawiilThe era of AI tokenmaxxing may be well and truly over. Alongside stories of Amazon cutting its AI leaderboard and an unknown company blowing through $500 million worth of tokens in one month, leaked audio has emerged from consulting firm Accenture as it tries to figure out how to rein in rampant token spend at client companies, 404Media reports.
In leaked audio, Accenture acknowledges that certain trivial tasks being offloaded to AI are causing massive token overspend, especially when agentic AI is part of the mix. The staff in the meeting clearly recognizes that not only is AI spend growing out of control at companies heavily adopting the technology, but that there is very little way to predict how much any tasks would cost, or whether there is real value in using AI to complete them.
Accenture has previously been incredibly bullish on AI, even encouraging employees to use it so much that if they didn't, they risked missing out on promotions. But that seems like a policy destined for the AI history books, as Accenture is now clearly aware that it's overspending on AI, and many of its clients are too.
Latest Videos From Watch full video here:
From tokenmaxxing, to token hoarding
For much of the past year, many companies have charged full speed into an AI-heavy business strategy. Amazon had an AI leaderboard, and Nvidia's CEO Jensen Huang said he'd be alarmed if engineers weren't spending at least 50% of their annual salary on AI tokens.
Anecdotally, I know a number of software developers and data engineers who have been encouraged to use AI as much as they can. They have token limits, but they have been encouraged to use all of them and find new ways to do it, too.
This is leading to runaway token spending, something Accenture is seeing in its client data. Accenture’s agentic AI strategy lead, Justive Kwak, was quoted in the audio saying: "What we’re seeing right now is just rapid escalation in AI token spend [...] as companies start to scale AI, moving from like simple chatbots into use cases that feature agentic workflows and automation and then enterprise-wide deployment of some of these tools like Copilot, Claude Code, and Codex."
This isn't something that will be contained to just a few firms, either, he said. “It’s really not a niche problem. It is a problem that every enterprise will face if they are bullish on AI, if they haven’t already,” he said, adding that token spend was increasing, “exponentially, as more and more people are starting to use AI.”
But that may be starting to change. Amazon canned its AI leaderboard - it's rumored to be the mystery company with a half-billion dollar AI spend in one month - Uber is capping AI use to cut costs, and Axios reported at the end of May that a number of CEOs and companies were switching to more affordable models, and more closely monitoring employee usage.
... continue reading