Latest Tech News

Stay updated with the latest in technology, AI, cybersecurity, and more

Filtered by: bandwidth Clear Filter

Memory is slow, Disk is fast – Part 1

TL;DR Hardware got wider, not faster. More cores, more bandwidth, huge vector units — but clocks, IPC, and latency flatlined. Old rules like “memory is faster than disk” are breaking. To go fast today, you have to play the new game. “CPUs keep getting faster every generation” Over the past 20 years or so computer hardware has evolved such that some facts we “know” about computers are wrong. Even among computer scientists, or perhaps especially among computer scientists, intuitions are off tar

How to Think About GPUs

We love TPUs at Google, but GPUs are great too. This chapter takes a deep dive into the world of NVIDIA GPUs – how each chip works, how they’re networked together, and what that means for LLMs, especially compared to TPUs. This section builds on Chapter 2 and Chapter 5 , so you are encouraged to read them first. What Is a GPU? A modern ML GPU (e.g. H100, B200) is basically a bunch of compute cores that specialize in matrix multiplication (called Streaming Multiprocessors or SMs) connected to a

How to Scale Your Model: How to Think About GPUs

We love TPUs at Google, but GPUs are great too. This chapter takes a deep dive into the world of NVIDIA GPUs – how each chip works, how they’re networked together, and what that means for LLMs, especially compared to TPUs. This section builds on Chapter 2 and Chapter 5 , so you are encouraged to read them first. What Is a GPU? A modern ML GPU (e.g. H100, B200) is basically a bunch of compute cores that specialize in matrix multiplication (called Streaming Multiprocessors or SMs) connected to a

PCIe 8.0 announced by the PCI-Sig will double throughput again

The PCI-SIG announced this week that it is not going to stop. Targeting a 2028 release, the PCIe 8.0 specification will double the throughput over PCIe 7.0. With the release, the PCI-SIG also shared two neat charts. PCIe Gen8 Announced by the PCI-SIG Will Double Throughput Again The PCI-SIG has this graphic to show what is happening to I/O bandwidth. It says that the I/O bandwidth is doubling every three years. Something to also keep in mind is that this is very device and interface centric.

PCIe 8.0 Announced by the PCI-Sig Will Double Throughput Again – ServeTheHome

The PCI-SIG announced this week that it is not going to stop. Targeting a 2028 release, the PCIe 8.0 specification will double the throughput over PCIe 7.0. With the release, the PCI-SIG also shared two neat charts. PCIe Gen8 Announced by the PCI-SIG Will Double Throughput Again The PCI-SIG has this graphic to show what is happening to I/O bandwidth. It says that the I/O bandwidth is doubling every three years. Something to also keep in mind is that this is very device and interface centric.

HDMI 2.2 specs are out with ‘Ultra96’, here’s what that means for your setup

The HDMI Forum has officially released version 2.2 of the HDMI specification, bringing support for video resolutions up to 16K at 60Hz and boosting maximum bandwidth to 96Gbps. Alongside the spec, there’s a new cable designation called Ultra96. Here are the details. The nerdy part The HDMI 2.2 spec now supports up to a whopping 16K at 60Hz, and 12K at 120Hz. For uncompressed formats with full 4:4:4 chroma and 10-bit and 12-bit color, it can handle 4K at 240Hz, and 8K at 60Hz. That is thanks t

HDMI 2.2 standard finalized: doubles bandwidth to 96 Gbps, 16K resolution support

What just happened? Following the standard's debut at CES 2025, HDMI 2.2 has now been finalized by the HDMI Forum. The full spec confirms much of what we heard six months ago, including doubling the maximum bandwidth of HDMI 2.1 to 96 Gbps – more than DisplayPort. While using HDMI 2.2 does not require a new connector, taking advantage of all its best features requires a new Ultra96 cable – a reference to its maximum bandwidth. 96Gbps is double the 48Gbps max bandwidth of HDMI 2.1 and is more th

Bandwidth vs. Latency: We Chatted With an Internet Connectivity Expert to Understand the Difference

Having fast, reliable home internet is essential these days for work, school, streaming and browsing. But understanding how much speed you need, or even what "internet speed" even means, can be a daunting task. Bandwidth and latency are two key factors that affect how we perceive the speed of our internet connection. But while you may hear them used together quite often, these two terms have distinct meanings. Understanding what they are and the difference between them can help you troubleshoot

Van Gogh, AMD's Steam Deck APU (2023)

Zen 2’s launch was a defining moment for AMD. For the first time in many, many years, AMD’s single thread performance could go head to head with Intel’s best. Zen 2 also started a trend where AMD brought up to 16 cores to desktop CPUs, giving consumers very strong multithreaded performance without having to buy HEDT platforms. But Zen 2 was also flexible and did a very good job of scaling down to lower power targets. That was especially true when Zen 2 cores were implemented in more power effic

Linux kernel WireGuard can go 'fast' on decent hardware

I'm used to thinking of encryption as a slow thing that can't deliver anywhere near to network saturation, even on basic gigabit Ethernet connections. This is broadly the experience we see with our current VPN servers, which struggle to turn in more than relatively anemic bandwidth with OpenVPN and L2TP, and so for a long time I assumed it would also be our experience with WireGuard if we tried to put anything serious behind it. I'd seen the 2023 Tailscale blog post about this but discounted it

PCIe 7.0 is coming, but not soon, and not for you

The PCIe 7.0 specification has now been released, while many of us are still waiting for PCIe 6.0 to materialize in consumer products. The PCI Special Interest Group (PCI-SIG) announced on Wednesday that PCIe 7.0 is now available to members of its organization, delivering a theoretical maximum bandwidth speed of 512GB per second in both directions, across a x16 connection. “PCIe technology has served as the high-bandwidth, low-latency IO interconnect of choice for over two decades and we are pl