Tech News
← Home  ·  All topics

Fp32 Accumulate

1 GoKawiil brief on this topic

Firmware hack unlocks full tensor speed on Nvidia RTX 20/30/40 GPUs

Modders have released firmware exploits that remove Nvidia's artificial half-speed limit on FP32-accumulate matrix math for RTX 20, 30, and 40-series GeForce cards, according to VideoCardz. The unlock lets the RTX 4090 reach double its normal tensor rate and boosts the RTX 3090 Ti's matrix math by up to 80%, though gains vary by card and chatbot token speeds stay roughly the same since those depend on memory bandwidth rather than compute. Three separate projects—gpu-unlock, gpu-unlock-ada, and turing-unlock—provide unofficial Linux kernel modules covering different GPU generations, with experimental Windows builds also in development.