is a reviewer covering laptops and the occasional gadget. He spent over 15 years in the photography industry before joining The Verge as a deals writer in 2021.
Nvidia is announcing its new Personal AI Router (PAIR), a free tool that syncs up your home computers for tackling local AI inference tasks with tools like Ollama and LM Studio.
Let’s get the obvious thing out of the way, despite what its name might imply: PAIR is not a hardware router. It’s open-source software developed by Nvidia that discovers compatible PCs on a network, connects them, and prepares them for crunching numbers on agentic workflows. While the compatible devices are mostly Nvidia GeForce GPUs (PAIR works with RTX 20-series cards and newer, as well as RTX Pro GPUs and DGX Spark systems), Apple’s M4 chips or newer will also work.
The key thing here is that PAIR uses your in-home systems when they’re idle to avoid interfering with other tasks. And this disaggregated system of computers can work in parallel to chew through lots of processing requests — which should be helpful for an agentic workflow that breaks complex tasks into smaller jobs. This should prevent large bottlenecks on a single GPU, and Nvidia says PAIR can adapt as devices join or leave the network — including if a user does something like start playing a game on their desktop PC.
Previous Next
1 / 2 Nvidia PAIR’s graphical interface in action. Image: Nvidia
In a media briefing, Nvidia product manager Seth Schneider painted a picture of a household filled with powerful computers that could be doing much more with PAIR: a dad with both an Nvidia RTX Spark laptop and a DGX Spark desktop, a mom with an RTX 5090 laptop, a daughter with a gaming desktop, and a son with a MacBook Pro. In this incredibly extreme case, Schneider estimates this house has about 165 teraflops of underutilized compute. “It’s truly a treasure trove of free tokens just sitting in homes today,” he says, even when accounting for the electricity costs in the average American home.
Nvidia says PAIR is secured by pairing all devices through a six digit code and then securing the channel via mTLS (Mutual Transport Layer Security), to create an encrypted communication line that’s trusted in both directions between computers. The Nvidia PAIR beta is available today, with support for Windows, Linux, and macOS.
The structure of Nvidia PAIR. Image: Nvidia
PAIR does seem like a clever solution if you already have some beefy computers in your home and you want to run your own local AI. Upon my asking who PAIR is really for, and what kind of setups are actually realistic, Schneider said Nvidia envisions most PAIR users will have something like one MacBook or Windows laptop and one gaming PC.
... continue reading