AWS announced TorchNeuron, a native PyTorch backend for Trainium2 and Trainium3, on October 19, 2026. The announcement specified an Apache 2.0 open-source release at PyTorch Conference North America, with public-beta availability scheduled for October 20, 2026. Sources: PyTorch, TechCrunch
TorchNeuron uses PyTorch’s PrivateUse1 extension mechanism to support eager execution, torch.compile and custom Neuron Kernel Interface kernels. Hugging Face says Transformers, Diffusers and Accelerate can use the native device directly. Sources: PyTorch, Hugging Face
Hugging Face reports support for 89% of the 100 most-used text-generation architectures, compared with 46% for Optimum Neuron v0.4.5. These figures measure architecture coverage, not speed or accuracy, and come from an integration participant rather than independent testing. Sources: Hugging Face