David Gewirtz/ZDNET
Follow ZDNET: Add us as a preferred source on Google.
ZDNET's key takeaways
OpenAI API spend can rise fast if agents run wild.
Hard limits help stop surprise API bills.
Alerts and rate limits add another layer of protection.
The other night, I woke up in a damp sweat from a strange nightmare. This wasn't my typical nightmares where I'm chased by villagers with pitchforks and torches or flaming skulls (or a combination of both).
No, this was a nightmare in which my AI app decided to spawn hundreds of agents, all of whom were making API calls, racking up an ever-climbing API-usage bill. Rogue AIs overspending on my credit card is a notch better than being eaten by flaming skulls, but it's still not pleasant.
Also: How I stopped a massive WordPress spam attack with 4,700 lines of code in two days - thanks to Codex and Claude
While OpenAI can't help with the flaming skulls, it can help reduce the risk of a nightmare of an inflated API bill. All you need to do is set usage limits on your account. In this article, I'm going to show you how.
... continue reading