fotograzia/Moment via Getty Images
Follow ZDNET: Add us as a preferred source on Google.
ZDNET's key takeaways
AI is both a cybersecurity threat and a solution.
Benchmarks will test LLMs for real-world cybersecurity tasks.
The suite could help developers build better models.
Overwhelmed with cybersecurity tool options? A new set of benchmark tests aims to help you evaluate them and find the right ones for you.
Also: Navigating AI-powered cyber threats in 2025: 4 expert security tips for businesses
Cybersecurity software firm CrowdStrike has teamed up with Meta to launch a new open-source suite of benchmarks to test the performance of AI models within an organization's security operations center (SOC). Dubbed CyberSOCEval, the suite is designed to help businesses sift through a growing mountain of AI-powered cybersecurity tools to help them hone in on one that's ideally suited for their needs.
"Without clear benchmarks, it's difficult to know which systems, use cases, and performance standards deliver a true AI advantage against real-world attacks," CrowdStrike wrote in a press release.
... continue reading