GoKawiilRobotics industry grapples with scarce training data as AI scaling model falters
AI language models have advanced largely by training on ever-larger text datasets, with dataset sizes reportedly doubling roughly every six months since the early 2010s, according to Epoch AI. But researchers note there is no equivalent large public corpus of robot training data, unlike the estimated 300 trillion tokens of usable text available for language models. This gap has made sourcing and defining robot training data a central open problem for the field.