Tech News
← Home  ·  All topics

Aws Trainium

3 GoKawiil briefs on this topic · RSS for aws trainium

TrnRT open-source inference engine brings GLM-5.3-Flash to AWS Trainium2

RunanywhereAI released TrnRT, an open-source LLM inference engine built for AWS Trainium chips, launched via a Show HN post. It serves an OpenAI-compatible API from a single trn2.48xlarge instance, using fused NKI 'megakernels' per layer and a prefix cache spanning device and host memory, with GLM-5.3-Flash as its first supported model.

Amazon reportedly in talks to buy AI startup Decart for up to $7 billion

Amazon is said to be negotiating an acquisition of Decart, a startup whose DOS software optimizes AI models to run on different chips in weeks instead of months, in a deal valued at as much as $7 billion. Decart also builds Lucy and Oasis, AI models that generate simulated 3D environments for gaming and robotics training. Anthropic had reportedly discussed buying Decart for about $6 billion last month but walked away after due diligence, for reasons that remain unclear.

Enterprises rank non-Nvidia AI chips ahead of Blackwell in evaluation plans

VentureBeat's July VB Pulse survey of 170 AI infrastructure buyers found 39.4% plan to evaluate non-Nvidia accelerators like AWS Trainium, Google TPU, AMD Instinct or Intel Gaudi over the next year, versus 25.3% who plan to evaluate Nvidia's next-gen Blackwell GPUs. Despite this evaluation gap, the share of respondents expecting to switch platforms within three months actually dropped from 38.3% to 28.8%, even as usage and infrastructure activity rose across the board.