GoKawiiltinygrad
We write and maintain tinygrad, the fastest growing neural network framework
It's extremely simple, and breaks down the most complex networks into 3 OpTypes
But how...where are your CONVs and MATMULs? Read the code to solve this mystery.
Work at tiny corp
tinybox (now shipping)
We sell a computer called the tinybox. It comes in red, green, and soon, exa.
red v2 green v2 blackwell exabox FP16 (FP32 acc) FLOPS 778 TFLOPS 3086 TFLOPS ~1 EXAFLOP GPU Model 4x 9070XT 4x RTX PRO 6000 Blackwell 720x RDNA5 AT0 XL GPU RAM 64 GB 384 GB 25,920 GB GPU RAM bandwidth 2560 GB/s 7168 GB/s 1244 TB/s GPU link bandwidth full fabric PCIe 4.0 x16 full fabric PCIe 5.0 x16 full fabric 400 GbE CPU 32 core AMD EPYC 32 core AMD GENOA 120x 32 core AMD GENOA System RAM 128 GB 192 GB 23,040 GB System RAM bandwidth 204.8 GB/s 460.8 GB/s 55.2 TB/s Disk size 2 TB fast NVMe 4 TB raid + 1 TB boot 480 TB raid Disk read bandwidth 7.3 GB/s 59.3 GB/s 7.1 TB/s Networking 2x 1GbE + OCP3.0 2x 10GbE + OCP3.0 PCIe5 3.2 TB/s scale out Noise < 50 dB, 31 low speed fans 65 db @ 10 meters Power Supply one 1600W, 100V~240V 2x 1600W, 100V~240V 600 kW, 200V~240V BMC AST2500 AST2600 custom Operating System Ubuntu 24.04 Dimensions 12U, 16.25" deep, 60-90 lbs 20x8x8.5 ft, 20,000 lbs Rack? Freestanding or rack mount concrete slab Driver Quality Good Great functions as single GPU SHIPPING IN STOCK - $12,000 IN STOCK - $65,000 coming 2027 - ~$10M
for updates on products and inventory, sign up for the mailing list
FAQ