Skip to content
Tech News
← Back to articles

Unlimited AI tokens aren't unlimited after all as US Army burns through supply

read original more articles
Why This Matters

The US Army's experience with token exhaustion highlights the challenges of scaling AI usage within large organizations, revealing that 'unlimited' access may not be sustainable at high volumes. This development underscores the importance of managing AI resource allocation effectively as government agencies and industries increasingly rely on generative AI tools. For consumers and the tech industry, it signals a need for more efficient AI infrastructure and clearer policies around resource limits.

Key Takeaways

A little over a month after the Department of Defense (DOD) bragged that nearly half of its 3.5 million employees were using AI at work, members of the Army’s Combat Capabilities Development Command (DEVCOM) received an email informing them that they were burning through tokens, and needed to limit use.

“Although the Army CIO announced in May 2026 that they were offering unlimited tokens, by mid-June the Army CIO pool was exhausted of tokens and had to re-establish limits,” the email reads. The email goes on to say that although the Army has chosen to renew token usage at “its current levels,” it’s unclear “if the Army CIO pool will be renewed after 1 Oct.”

The Army uses Ask Sage, a multimodal generative AI platform where users can run different large language models (LLMs), including Alphabet’s Gemini, Meta’s Llama, and OpenAI’s ChatGPT. “Apparently the whole Army burned through the whole year of tokens for just one service,” says an Army employee who spoke to WIRED anonymously because they were not authorized to speak to the press.

Ask Sage is used by the Army to “power its enterprise LLM workspace” and is “accredited for Controlled Unclassified Information.” It is also used by the DOD’s Chief Digital and AI Office (CDAO) for acquisitions. According to the Army’s website, Ask Sage was used to complete tasks like “reclassifying personnel descriptions, which involves defining and aligning job duties, experience and backgrounds.”

The Army employee says that the Army has been pushing its workers to lean into using generative AI. Employees were given an allotment of at least 200,000 tokens per month, according to emails viewed by WIRED, and were automatically allocated more if they burned through their initial allotment. Employees who had signed up for Ask Sage but were not regularly using it would receive emails encouraging them to use more of their allocated tokens.