Sabrina Ortiz/ZDNET
Follow ZDNET: Add us as a preferred source on Google.
ZDNET's key takeaways
Qualcomm launches Snapdragon 8 Elite Gen 5 chipset.
It features the Qualcomm Oryon CPU and next-gen Qualcomm Adreno GPU.
The results include the fastest on-device AI processing.
In the AI-first world we live in, helpful AI features matter more and more to smartphone buyers. As a result, chipsets behind these devices have to become increasingly powerful to support these features, and Qualcomm's new chipset just upped the ante.
In a conversation with Durga Malladi, SVP and GM of technology planning, edge solutions, and data center at Qualcomm, he told me that the Snapdragon 8 Elite Gen 5 supports up to 220 tokens per second when using a 3B parameter small language model. These stats make the Snapdragon 8 Elite Gen 5 the fastest mobile SoC for running reasoning models on-device, compared to other published numbers.
Also: I got a glimpse of future Android smartphones - here are 3 major upgrades you can expect
"If you just think about it, we went from close to 20 to this, it's like a 10x increase in the tokens per second that you get now," said Malladi. "I can't read 200 words per second. None of us can."
... continue reading