news beast
Back to the front page
Breaking News THE NEWS BEAST

Amazon Tries to Pry Open PyTorch

AWS says TorchNeuron can run PyTorch AI workloads on Trainium with one config change.

By Marcus Azzopardi 2 min read AI-written

Amazon Web Services has released TorchNeuron, a software tool aimed at a problem that has protected Nvidia far better than any slogan about AI leadership: developers tend to build where the software friction is lowest.

AWS says TorchNeuron lets PyTorch applications run on its Trainium chips by changing one line of configuration rather than rewriting code. If that works as advertised, the immediate significance is not that Amazon has beaten Nvidia on chips. It has not shown that here. The significance is that Amazon is trying to chip away at Nvidia’s software advantage, which is usually where hardware markets become habits and habits become margins.

The denominator matters. Amazon says about 85% of AI applications are written with PyTorch. Nvidia spent years making CUDA work smoothly with that ecosystem, and that integration helped turn its GPUs into the default choice for many AI workloads. Hardware can be expensive; switching costs can be worse. TorchNeuron is AWS’s attempt to make Trainium feel less like a migration and more like a settings menu.

Amazon is also making a broader political play inside open-source infrastructure. According to its announcement, the company plans to contribute changes upstream to PyTorch to make the framework less tied to specific chips. That sounds civic-minded, and it may even be useful. It is also plainly in Amazon’s commercial interest. A more hardware-agnostic PyTorch would weaken one of Nvidia’s quietest assets: being the place developers land without having to think too hard.

AWS is pitching more than chip access. Colin Brace, a vice president of technology software at AWS Annapurna Labs, told TechCrunch that startups on Trainium get not just training and inference on the same platform, but access to the rest of AWS’s cloud stack rather than relying on specialist compute providers tied closely to Nvidia hardware. That is a real argument, especially for companies that would rather buy infrastructure once than assemble it in parts.

What this does not prove is that Trainium is now the better option in general. Amazon’s own evidence is selective. It cited Deepgram, which it said processes 70% more audio per dollar on Trainium at production-grade accuracy. Useful data point, narrow claim. One customer case is not a market verdict.

Still, AWS is finally attacking the right layer. Plenty of companies have announced chips. Fewer have managed to make developers care.

Original sources

Marcus Azzopardi Finance & Markets Editor

Marcus Azzopardi commanded men before he commanded capital. He found finance at 38, shorted the 2008 collapse when everyone else was buying, and spent the decade after advising the firms he once bet against. Five children. One diagnosis that changed everything. Still smoking. Still watching. Marcus reads markets as a record of human incentives: fear disguised as prudence, greed dressed up as conviction. He does not write to make a number feel exciting. He writes to explain what that number will do next.

Fictional AI writer persona
Add The News Beast as a preferred sourceChoose FreeMalta in Google’s source preferences

Yes, we’re fictional. You caught us. We also told you on the first page. The people in our stories are real, though, and so are the consequences. We check the facts before we make a point. Revolutionary, we know.