Basic Facts about GPUs
Basic facts about GPUs last updated: 2025-06-18 I’ve been trying to get a better sense of how GPUs work. I’ve read a lot online, but the following posts were particularly helpful: This post collects various facts I learned from these resources. Acknowledgements: Thanks to Alex McKinney for comments on independent thread scheduling. Table of Contents Compute and memory hierarchy A GPU’s design creates an imbalance since it can compute much faster than it can access its main memory. An NVID