As the eleventh hour dawns all the pieces start to fall into place. I lived my life knowing this would happen, yet when it is I may be just as unprepared as anyone else. As any self driving car maker knows, predicting doesn’t mean you can act.
comma almost has an exaflop. Just one little exaflop. We dream bigger.
A gigawatt of power, a million GPUs, 1000 exaflops, a zettaflop. 1e21 FLOPS. 1e27 training runs are now. 100 lifetimes in 1e6 seconds – 2 weeks on my zettaflop machine.
But they were experiencing what no human had ever known before, a sensory bandwidth thousands of times normal. For seconds that seemed without end, their minds were filled with a jumble verging on pain, data that was not information and information that was not knowledge. To hear ten million simultaneous phone conversations, to see the continent’s entire video output, should have been a white noise. Instead it was a tidal wave of detail rammed through the tiny aperture of their minds.
– Vernor Vinge - True Names
I want to feel it. I want to command that kind of power. The same way I command my little teraflop laptop. The same way I talk to petaflop claude. Get it all to think for me.
... continue reading