Tech News
← Home  ·  All topics

Gpu Training

1 GoKawiil brief on this topic

Show HN: TurboGPT trains a 22KB byte-level GPT in 13 seconds via CUDA C++

A developer released TurboGPT, an open-source (MIT-licensed) CUDA C++ implementation for training tiny byte-level GPT models. The project's Windows build instructions and CLI usage are documented, and a sample run on a dataset called hn1g reportedly reached 2.52435 bits-per-byte after 1.5 billion training tokens.