Latest Tech News

Stay updated with the latest in technology, AI, cybersecurity, and more

Filtered by: dim Clear Filter

Snapdragon 8 Elite Gen 5’s biggest rival is arriving next week

Hadlee Simons / Android Authority TL;DR MediaTek has announced that its next Dimensity flagship processor will be launched next week. This chip is expected to be the Dimensity 9500 processor. The processor is said to pack a powerful CPU, Mali G1-Ultra graphics, and an NPU with 100 TOPS of performance. Qualcomm will announce the Snapdragon 8 Elite Gen 5 next week, and it’s expected to power a host of flagship Android phones. Now, arch-rival MediaTek has revealed that its own high-end processo

Language models pack billions of concepts into 12k dimensions

In a recent 3Blue1Brown video series on transformer models, Grant Sanderson posed a fascinating question: How can a relatively modest embedding space of 12,288 dimensions (GPT-3) accommodate millions of distinct real-world concepts? The answer lies at the intersection of high-dimensional geometry and a remarkable mathematical result known as the Johnson-Lindenstrauss lemma. While exploring this question, I discovered something unexpected that led to an interesting collaboration with Grant and a

Language Models Pack Billions of Concepts into 12k Dimensions

In a recent 3Blue1Brown video series on transformer models, Grant Sanderson posed a fascinating question: How can a relatively modest embedding space of 12,288 dimensions (GPT-3) accommodate millions of distinct real-world concepts? The answer lies at the intersection of high-dimensional geometry and a remarkable mathematical result known as the Johnson-Lindenstrauss lemma. While exploring this question, I discovered something unexpected that led to an interesting collaboration with Grant and a

Language Models Pack Billions of Concepts into 12,000 Dimensions

In a recent 3Blue1Brown video series on transformer models, Grant Sanderson posed a fascinating question: How can a relatively modest embedding space of 12,288 dimensions (GPT-3) accommodate millions of distinct real-world concepts? The answer lies at the intersection of high-dimensional geometry and a remarkable mathematical result known as the Johnson-Lindenstrauss lemma. While exploring this question, I discovered something unexpected that led to an interesting collaboration with Grant and a

‘Peacemaker’ Went Full ‘Doctor Who’ Explaining How Portal Doors Work

It’s time to see once again what’s new in the world of Christopher Smith in another episode of Peacemaker. Will Chris return in the nick of time to save Eagly from whatever twin-tailed horrors ARGUS has in store for our feathered friend? Will Chris and Harcourt ever become Facebook official? Will we ever figure out why Chris’ “best dimension” appears not to have any non-white people roaming about in the background? Let’s cease with the incessant questions and what awaits Episode four, “Need I S

Decades-Old Waste Barrels Are Creating Toxic Dead Zones off LA’s Coast

Until 1972, the Pacific waters of Southern California served as a dumping ground for hazardous and industrial wastes. More than 50 years later, corroded metal barrels still litter the seafloor off the coast of Los Angeles, and scientists are only beginning to understand the consequences of casually tossing them into the ocean. Images of the barrels first surfaced in 2020, with some of them encircled by mysterious white halos on the seafloor. Experts initially linked the barrels to DDT—a toxic p

How many dimensions is this?

In the past couple of weeks, I’ve been posting about seemingly simple mathematical problems that defy intuition, and where the answers we find on the internet turn out to be shallow or hard to parse. For a taste, you might enjoy the articles on Gödel’s beavers or on infinite decimals. Today, let’s continue by asking a simple question: how many dimensions does a line have? A trained mathematician might blurt out an answer involving vector spaces or open set coverings, but there’s no fun in that.

The maths you need to start understanding LLMs

The maths you need to start understanding LLMs Actually coming up with ideas like GPT-based LLMs and doing serious AI research requires serious maths. But the good news is that if you just want to understand how they work, while it does require some maths, if you studied it at high-school at any time since the 1960s, you did all of the groundwork then: vectors, matrices, and so on. One thing to note -- what I'm covering here is what you need to know to understand inference -- that is, using an

A Random Walk in 10 Dimensions (2021)

Physics in high dimensions is becoming the norm in modern dynamics. It is not only that string theory operates in ten dimensions (plus one for time), but virtually every complex dynamical system is described and analyzed within state spaces of high dimensionality. Population dynamics, for instance, may describe hundreds or thousands of different species, each of whose time-varying populations define a separate axis in a high-dimensional space. Coupled mechanical systems likewise may have hundred

Google is changing how Extra Dim works on the Pixel 10, and it’s so much better

Joe Maring / Android Authority TL;DR The new Pixel 10 series integrates the “Extra Dim” feature directly into the main brightness slider, making it easier to access. This removes the need for a separate toggle, as Extra Dim now automatically activates when the brightness slider is at its minimum. While the feature was tested on older Pixels, it is currently exclusive to the Pixel 10, though it may come to other devices later. Google’s new Pixel 10 series introduces some surprise display upgr

‘Peacemaker’ Finally Gave Its Best Boy His Big Hero Moment

With the season two premiere behind us, it’s time to see what new debaucherous misadventures await John Cena’s Christopher Smith in the second episode of DC Studios’ Peacemaker. Given the explosive finale of the first episode, we’re in for a lot of explanations from our silver-helmeted would-be hero. Episode two, “A Man Is Only as Good as His Bird,” jumps back eight months before the show’s premiere, providing context for why Chris was being surveilled by his ginger-bearded buddy, John Economos

Huge Parts of the North Sea Seabed Are Upside Down, New Study Reveals

In the world of stratigraphy, or rock layers, superficial sediments are usually younger than the deeper ones they settle upon. The North Sea, however, has revealed giant mounds of sand that defy this geological principle on a scale scientists have never seen before. Researchers from Norway and the UK have identified hundreds of sand bodies under the North Sea that seem to have sunk deeper into the ocean’s crust, swapping places with older layers, which floated to the top of the sand structures.

Writing Speed-of-Light Flash Attention for 5090 in CUDA C++

In this post, I will walkthrough how I learned to implement Flash Attention for 5090 in CUDA C++. The main objective is to learn writing attention in CUDA C++, since many features are not available in Triton, such as MXFP8 / NVFP4 MMA for sm120. I also feel this is a natural next step after learning about matmul kernels. Lastly, there are many excellent blogposts on writing fast matmul kernels, but there is none for attention. So I want to take this chance to write up something nicely. Readers

Topics: dim int memory row shared

‘Peacemaker’ Returns, and Wastes No Time Retconning the New DC Universe

With Superman in the books, the time has finally come to see how DC Studios’ rebooted universe will continue with the second season of James Gunn’s John Cena-led TV series, Peacemaker. Even before the show’s release, Peacemaker existed in a unique transitional phase between the old and new DC Universes, leading fans to wonder which elements would carry over and which would be left behind. The answer to that, as gleaned from trailers and the occasional Gunn interview about its premiere being not

Low-Temp 2D Semiconductors: A Chipmaking Shift

Chipmaking giants like Intel, Samsung, and TSMC see a future where key parts of silicon transistors are replaced with semiconductors that are only a few atoms thick. Although they’ve reported progress toward that goal, that future is generally thought to be more than a decade away. Now, a startup spun out of MIT thinks it has cracked the code for making commercial-scale 2D semiconductors and expects chipmakers to have integrated them in advanced chips in half that time. CDimension has developed

‘Peacemaker’ Came to Comic-Con to Tease the End of Its Own Universe

The most in-your-face explanation for what’s going on with Peacemaker in the new DCU can be found outside of San Diego Comic-Con. Simply put—as soon as you walk in past the HBO Max activation marquee for the Peacemaker “Peacefest” in the Gaslamp District, you see a sign that reads, “Relax, it’s a state of emergency; you’re fucked’, dude.” io9 was invited to scope out the space, which allowed for some rocking fun as you walk in through a Quantum Portal into the “altered dimension” of the Peacem

Astronomers Spot Companion Star in Orbit Around Iconic Star Betelgeuse, Confirming Suspicions

In 2024, astronomers surmised that Betelgeuse might have a stellar “buddy.” If this hypothetical companion existed, it would help answer some questions about the red supergiant’s strange glowing patterns. As it turns out, these suspicions were correct. After numerous false signals and empty search results, astronomers with NASA’s Ames Research Center have confirmed that Betelgeuse does, in fact, have a tiny buddy star. The young star, with a mass about 1.5 times that of the Sun, likely exerts s

Time Is Three-Dimensional and Space Is Just a Side Effect, Scientist Says

A fringe new theory suggests that time is the fundamental structure of the physical universe, and space is merely a byproduct. According to Gunther Kletetschka, a geologist — not a physicist, you'll note, but more on that later — from the University of Alaska Fairbanks, time is three-dimensional and the dimensions of space are an emergent property of it, a press release from the university explains. "These three time dimensions are the primary fabric of everything, like the canvas of a paintin

HP Dimension offers sci-fi-style 3D video calls, built on Google Beam

Recap: The dream of a truly sci-fi-style communication device is finally here. Two years after Google revealed its Project Starline video booth, the company announced its rebranding as Google Beam last month. Now, HP has announced the technology will form the basis of the HP Dimension. Before anyone gets excited about the prospect of taking these 3D video calls at home, note that the HP Dimension is an enterprise product with a price to match: $24,999. The device, which HP says is designed to

HP reveals its Google Beam-powered 3D video conferencing device

Recap: The dream of a truly sci-fi-style communication device is finally here. Two years after Google revealed its Project Starline video booth, the company announced its rebranding as Google Beam last month. Now, HP has announced the technology will form the basis of the HP Dimension. Before anyone gets excited about the prospect of taking these 3D video calls at home, note that the HP Dimension is an enterprise product with a price to match: $24,999. The device, which HP says is designed to

The first Google Beam device is the $25,000 HP Dimension

Google's impressive Beam video conferencing technology has finally been integrated into an actual product that will be available for purchase. That's the good news. The bad news? The HP Dimension system is going to cost a whopping $25,000. This is an enterprise product through and through. However, the device certainly looks spiffy. The HP Dimension with Google Beam combines six cameras, a spatial audio system and adaptive lighting to allow for highly immersive virtual meetings. AI wizardry bri

The first Google Beam device can be yours for just $24,999 (Beam license sold separately)

TL;DR HP has revealed the first device with Google Beam 3D video conferencing technology. The HP Dimension with Google Beam will cost $24,999 and doesn’t include a license to use Google Beam. Google revealed its Project Starline 3D video conferencing technology back in 2021, which then got rebranded to Google Beam earlier this year. Now, HP has revealed the first commercial product with this tech, and it’s not cheap. HP announced the HP Dimension with Google Beam today, and it will cost a cra

HP's New AI-Powered 3D Conferencing With Google Beam: Here's What Stands Out

HP has partnered with Google for a new virtual conferencing solution that doesn't need VR headsets or other wearables, called HP Dimension with Google Beam. Instead of glasses, it's a giant 3D-enabled display that sits on a conference desk in front of you and mimics the feeling of interacting with someone just a few feet away. It also costs $25,000. Previously called Project Starline, HP's Dimension with Google Beam promises to be "AI-powered," which refers to algorithms in charge of adjusting