What’s inside the LLM? Ai2 OLMoTrace will ‘trace’ the source

Join our daily and weekly newsletters for the latest updates and exclusive content on industry-leading AI coverage. Learn More Understanding precisely how the output of a large language model (LLM) matches with training data has long been a mystery and a challenge for enterprise IT. A new open-source effort launched this week by the Allen Institute for AI (Ai2) aims to help solve that challenge by tracing LLM output to training inputs. The OLMoTrace tool allows users to trace language model outputs directly back to the original training data, addressing one of the most significant barriers to enterprise AI adoption: the lack of transparency in how AI systems make decisions. OLMo is an acronym for Open Language Model, which is also the name of Ai2’s family of open-source LLMs. On the company’s Ai2 Playground site, users can try out OLMoTrace with the recently released OLMo 2 32B model. The open-source code is also available on GitHub and is freely available for anyone to use. Unlike ... Read full article.