Gemini Pro 2.5 is one of only two AIs to crush all my coding tests - and it's free
Published on: 2025-05-16 06:46:35
Elyse Betters Picaro / ZDNET
As part of my AI coding evaluations, I run a standardized series of four programming tests against each AI. These tests are designed to determine how well a given AI can help you program. This is kind of useful, especially if you're counting on the AI to help you produce code. The last thing you want is for an AI helper to introduce more bugs into your work output, right?
Also: The best AI for coding (and what not to use)
Some time ago, a reader reached out to me and asked why I keep using the same tests. He reasoned that the AIs might succeed if they were given different challenges.
This is a fair question, but my answer is also fair. These are super-simple tests. I'm using PHP and JavaScript, which are not exactly challenging languages, and I'm running some scripting queries through the AIs. By using exactly the same tests, we're able to compare performance directly.
One is a request to write a simple WordPress plugin, one is to rewrite a string func
... Read full article.