Nvidia dominates in gen AI benchmarks, clobbering 2 rival AI chips

MLCommons Nvidia's general-purpose GPU chips have once again made a nearly clean sweep of one of the most popular benchmarks for measuring chip performance in artificial intelligence, this time with a new focus on generative AI applications such as large language models (LLMs). There wasn't much competition. Systems put together by SuperMicro, Hewlett Packard Enterprise, Lenovo, and others -- packed with as many as eight Nvidia chips -- on Wednesday took most of the top honors in the MLPerf benchmark test organized by the MLCommons, an industry consortium. Also: With AI models clobbering every benchmark, it's time for human evaluation The test, measuring how fast machines can produce tokens, process queries, or output samples of data -- known as AI inference -- is the fifth installment of the prediction-making benchmark that has been going on for years. This time, the MLCommons updated the speed tests with two tests representing common generative AI uses. One test is how fast the ... Read full article.