Tech News
← Home  ·  All topics

Ai Inference

17 GoKawiil briefs on this topic

AI inference startup Fal valued at $16B after $1.3B funding round

Fal, a San Francisco startup that hosts AI video, image and audio models, raised $1.3 billion in a Series F round led by Bessemer Venture Partners, with Nvidia, Sound Ventures and T. Rowe Price also participating. The deal doubles Fal's valuation to $16 billion from $8 billion in April, and combined with its earlier Sequoia-led Series E, the company has raised $1.65 billion across both rounds. Fal reportedly surpassed $800 million in annualized revenue earlier this year.

Darkbloom warns Mac compute-sharing users of falling token prices cutting earnings

Darkbloom, a network that lets Mac owners rent out idle compute for AI inference, told members that falling AI token prices will shrink their earnings. The company cited data showing Anthropic's price per million tokens fell 77% between May and October 2026, driven by cheaper, more efficient data center hardware. Darkbloom estimates top earners could see monthly income drop from around $160 to roughly $37 as a result.

Altman says local AI use wastes scarce memory chips, favors cloud computing

OpenAI CEO Sam Altman said on the Cheeky Pint podcast that people running AI models locally on personal computers is an inefficient use of the world's limited DRAM supply. He argued that cloud-based inference through hyperscalers achieves better utilization than individual users hoarding memory chips for home use. His remarks came as Intel shares fell nearly 30 percent Friday amid a PC market slowdown that analysts linked partly to AI-driven component shortages.

Nvidia joins $14M Series B funding round for Indian AI startup Simplismart

Simplismart, a four-year-old Bengaluru-based startup, raised $14 million in a Series B round led by Dallas Venture Capital, with participation from Nvidia, Accel, Shastra VC, and Micromax. The all-primary round values the company at roughly $100 million and will support its software that helps businesses run AI models more efficiently on existing computing infrastructure.

Railway urges all users to rotate secrets after suspected breach

Cloud hosting provider Railway detected suspicious activity on systems storing customer environment variables and said an unauthorized third party may have accessed encrypted variables, obtaining decrypted contents in some cases. Railway linked the incident to a broader series of attacks on AI inference providers, who were notified and told to revoke their keys, and it paused deployments platform-wide during its investigation.

WD data shows AI video inference generates 130x hidden storage overhead

Western Digital measured that an 8-second AI-generated video clip delivered to users as a 3.97MB file actually produces over 500MB of backend data, including logs, cached context, renders, backups, and safety records. A WD-sponsored IDC survey of 763 IT decision-makers found nearly 95% reported generative AI increasing their data volumes over the past year, with about 61% seeing growth of 25% or more.

Railway discloses breach exposing customer environment variables

Railway said it detected unauthorized access to systems storing customer environment variables, with an intruder possibly viewing decrypted secrets such as API keys and database credentials for some accounts. The company has paused all deployments during its investigation and is urging all users to rotate environment variables and registry credentials as a precaution, even though it believes impact may be limited to a subset of accounts.

Modal Labs nears $750M round at $15.75B valuation, led by Accel

AI inference infrastructure provider Modal Labs is close to finalizing a $750 million funding round led by Accel, valuing the company at $15.75 billion including the new capital, according to a source familiar with the deal. That figure more than triples Modal's $4.65 billion valuation from a $355 million raise just four months earlier. Modal declined to comment on the report.

Epoch AI: Cost of matching AI performance fell 47% per quarter since 2023

A new Epoch AI report by Emberson and Roodman finds that the price of achieving a given level of AI performance has dropped roughly 47% per quarter over the past three years, a 13-fold annual decline. The report cites OpenAI's o3, which cost about $0.30 per question to score 75% on GPQA Diamond in January 2025, compared with a much newer model reaching similar scores for a fraction of a cent by mid-2026.

Crusoe raises $3.9B at $30.9B valuation to build modular AI data centers

Crusoe, the AI infrastructure firm behind Oracle's giant Abilene, Texas campus, has closed a $3.9 billion funding round led by Atreides Management, Valor Equity Partners and Mubadala, pushing its valuation to roughly $30.9 billion. The company is using the capital to expand into smaller, factory-built facilities called Spark, designed for AI inference rather than massive training clusters.

AI industry shifts focus from training to inference workloads in 2026

Major AI labs have moved their attention from building ever-larger models to running inference—the process of using trained models to generate text, code, and images. This shift is driven by growing real-world use of large language models, the rise of reasoning models that repeatedly reprompt themselves, and autonomous AI agents that run continuously rather than just responding to single queries. Amazon Web Services, for instance, has split inference tasks between its Trainium chips and Cerebras's wafer-scale hardware.

Qualcomm shares jump 4% after AWS data center chip partnership, $4B warrant deal

Qualcomm's stock rose 4% on Tuesday following news that it will supply customized silicon for Amazon Web Services' AI infrastructure, with a focus on inference workloads. As part of the deal, Qualcomm granted Amazon warrants to purchase 25 million shares at $161.26 each, valuing the arrangement at roughly $4 billion.