Skip to content
Tech News
← Back to articles

Geekbench 6.7 adds Intel BOT detection to spoof out 'unrealistic' CPU scores — Benchmark runs with BOT enabled will be marked as invalid

read original get Geekbench 6.7 Software → more articles
Why This Matters

The addition of Intel's Binary Optimization Tool detection in Geekbench 6.7 highlights the ongoing challenge of ensuring benchmark fairness and accuracy in the face of performance-enhancing technologies. This update helps maintain the integrity of performance comparisons, which is crucial for consumers and industry stakeholders relying on trustworthy data. It underscores the importance of transparency and standardization in benchmarking practices amidst evolving hardware optimizations.

Key Takeaways

Intel's latest Core Ultra 200 Plus (Arrow Lake refresh) and Core Ultra 300 (Panther Lake) chips support a new feature called Binary Optimization Tool (BOT) that improves performance in some apps. We've tested it extensively and found it to be largely consistent, but Geekbench developer Primate Labs says it "paints an unrealistic picture" in terms of daily usage. The latest update, Geekbench 6.7 came out today with BOT detection built-in to ensure benchmark results with it enabled are flagged as invalid.

The saga started last month when Primate Labs first put out a warning against BOT, claiming it can increase Geekbench workload scores by up to 40%. Then, it actually investigated the tool and saw a 5.5% improvement in both multi- and single-core scores. However, some specific tests, like HDR processing, achieved 30% better results with BOT enabled, showing how it can selectively favor certain workloads over others.

(Image credit: Future)

The issue is how biased these performance uplifts can be since BOT isn't supported in every app. Geekbench argues its benchmark is designed to evaluate against a broad range of workloads that accurately represent real-world performance; any test with BOT enabled goes against that by replacing the existing varied code with specifically tuned binaries that only two desktop CPUs (currently) benefit from.

Article continues below

BOT runs a checksum on every executable to identify and compile optimized binaries for it — that's how and why the previous version was affected. It seems BOT doesn't yet have the tuned binaries for Geekbench 6.7, so you'll see no difference in performance. Even when they're ready to apply, runs with BOT enabled will be marked invalid and incomparable to other CPUs in the database.

(Image credit: Intel)

The update also brings some other welcome changes, such as improved SoC identification on Android that now reports the actual model of the chip along with its architecture. Similarly, Geekbench 6.7 will now display the name of RISC-V processors instead of just their ISA string. And lastly, Arm-based Linux systems should be more stable running Geekbench's multi-threaded workloads.

Follow Tom's Hardware on Google News, or add us as a preferred source, to get our latest news, analysis, & reviews in your feeds.