BuildRiot
Sign in

AISource: PyTorch

AWS announces TorchNeuron, a native PyTorch backend for Trainium

AWS announced TorchNeuron for Trainium2 and Trainium3, with a public beta scheduled for October 20, 2026. It supports familiar PyTorch workflows.

PyTorch logo
Cover: BuildRiot

AWS announced TorchNeuron, a native PyTorch backend for Trainium2 and Trainium3, on October 19, 2026. The announcement specified an Apache 2.0 open-source release at PyTorch Conference North America, with public-beta availability scheduled for October 20, 2026. Sources: PyTorch, TechCrunch

TorchNeuron uses PyTorch’s PrivateUse1 extension mechanism to support eager execution, torch.compile and custom Neuron Kernel Interface kernels. Hugging Face says Transformers, Diffusers and Accelerate can use the native device directly. Sources: PyTorch, Hugging Face

Hugging Face reports support for 89% of the 100 most-used text-generation architectures, compared with 46% for Optimum Neuron v0.4.5. These figures measure architecture coverage, not speed or accuracy, and come from an integration participant rather than independent testing. Sources: Hugging Face

Why it matters

TorchNeuron gives developers a native PyTorch backend for Trainium, and Hugging Face says its libraries can use the device directly.

Attribution

Sources

  1. 1PyTorchIntroducing TorchNeuron: Native PyTorch backend for AWS Trainium
  2. 2TechCrunchAmazon is taking its biggest shot at Nvidia yet with new TorchNeuron dev toolSource published (UTC)
  3. 3Hugging FaceTorchNeuron: running HF models on AWS Trainium is easier than ever
  4. 4AWSRelease Notes for Neuron Component: TorchNeuron — AWS Neuron Documentation

Read the original source for full details and context.

Report a problem

Links, dates or what you expected. Do not include passwords or private data.

More on AI

All AI stories