Databricks Has a Trick That Lets AI Models Improve Themselves

Databricks, a company that helps big businesses build custom artificial intelligence models, has developed a machine learning trick that can boost the performance of an AI model without the need for clean labelled data. Jonathan Frankle, chief AI scientist at Databricks, spent the past year talking to customers about the key challenges they face in getting AI to work reliably. The problem, Frankle says, is dirty data. ”Everybody has some data, and has an idea of what they want to do,” Frankle says. But the lack of clean data makes it challenging to fine-tune a model to perform a specific task.. “Nobody shows up with nice, clean fine-tuning data that you can stick into a prompt or an [application programming interface],” for a model. Databricks' model could allow companies to eventually deploy their own agents to perform tasks, without data quality standing in the way. The technique offers a rare look at some of the key tricks that engineers are now using to improve the abilities o ... Read full article.