Attendees pass an Amazon Web Services logo during AWS re:Invent 2024, a conference hosted by Amazon Web Services, at The Venetian hotel in Las Vegas on Dec. 3, 2024.
Amazon has found a way to let cloud clients extensively customize generative AI models. The catch is that the system costs $100,000 per year.
The Nova Forge offering from Amazon Web Services gives organizations access to Amazon's AI models in various stages of training so they can incorporate their own data earlier in the process.
Already, companies can fine-tune large language models after they've been trained. The results with Nova Forge will lean more heavily on the data that customers supply. Nova Forge customers will also have the option to refine open-weight models, but training data and computing infrastructure are not included.
Organizations that assemble their own models might end up spending hundreds of millions or billions of dollars, which means using Nova Forge is more affordable, Amazon said.
AWS released its own models under the Nova brand in 2024, but they aren't the first choice for most software developers. A July survey from Menlo Ventures said that by the middle of this year, Amazon-backed Anthropic controlled 32% of the market for enterprise LLMs, followed by OpenAI with 25%, Google with 20% and Meta with 9% — Amazon Nova had a less than 5% share, a Menlo spokesperson said.
The Nova models are available through AWS' Bedrock service for running models on Amazon cloud infrastructure, as are Anthropic's Claude 4.5 models.
"We are a frontier lab that has focused on customers," Rohit Prasad, Amazon head scientist for artificial general intelligence, told CNBC in an interview. "Our customers wanted it. We have invented on their behalf to make this happen."
Nova Forge is also in use by internal Amazon customers, including teams that work on the company's stores and the Alexa AI assistant, Prasad said.
Reddit needed an AI model for moderating content that would be sophisticated about the many subjects people discuss on the social network. Engineers found that a Nova model enhanced with Reddit data through Forge performed better than commercially available large-scale models, Prasad said. Booking.com, Nimbus Therapeutics, the Nomura Research Institute and Sony are also building models with Forge, Amazon said.
... continue reading