GoKawiilNew open-source tool rGPU lets PyTorch tensors run on a remote NVIDIA GPU
rGPU is a newly shown project that lets a PyTorch program send tensor operations over TCP to execute on a remote NVIDIA GPU while the application itself keeps running locally. It offers two integration routes: a simple PyTorch 'rgpu' device for programs that opt in, and a CUDA shim that intercepts existing Linux CUDA binaries using libcuda, CUDA Runtime, cuBLAS, cuBLASLt, and cuDNN. Setup involves installing via pip and using an SSH tunnel through the rgpu-run command to connect to the GPU host.