# TorchNeuron

Amazon released TorchNeuron, an open-source backend that translates PyTorch code into operations executable on AWS Trainium, so PyTorch code already running on other accelerators runs on Trainium with minimal or no code changes. An optional adaptive eager mode groups operations into small graphs that are compiled and cached, approaching fully compiled performance while keeping eager mode's debugging experience. For evaluation, AI agents swept Hugging Face repositories to identify 841 representative models covering the range of architectures, and tens of thousands of tensor shapes were distilled for tuning and benchmarking.

Amazon released TorchNeuron, an open-source backend that translates PyTorch code into operations executable on AWS Trainium, so PyTorch code already running on other accelerators runs on Trainium with minimal or no code changes. An optional adaptive eager mode groups operations into small graphs that are compiled and cached, approaching fully compiled performance while keeping eager mode's debugging experience. For evaluation, AI agents swept Hugging Face repositories to identify 841 representative models covering the range of architectures, and tens of thousands of tensor shapes were distilled for tuning and benchmarking.

Running Hugging Face models on AWS Trainium now rests on a different foundation: TorchNeuron, a native PyTorch backend, exposes Neuron chips as an ordinary device with eager execution, torch.compile and native distributed APIs, replacing the PyTorch XLA-based optimum-neuron. By Hugging Face's comparison, out-of-the-box support among the 100 most-used text-generation architectures rises from 46% with Optimum Neuron v0.4.5 to 89%. The backend enters public beta on October 20, 2026.

Running Hugging Face models on AWS Trainium now rests on a different foundation: TorchNeuron, a native PyTorch backend, exposes Neuron chips as an ordinary device with eager execution, torch.compile and native distributed APIs, replacing the PyTorch XLA-based optimum-neuron. By Hugging Face's comparison, out-of-the-box support among the 100 most-used text-generation architectures rises from 46% with Optimum Neuron v0.4.5 to 89%. The backend enters public beta on October 20, 2026.

AWS released TorchNeuron, a native PyTorch backend for Trainium chips, so model code, libraries and tools run without Neuron-specific adaptation. Previously, using Hugging Face models on Trainium required Neuron-specific software and configuration; now the device is simply pointed at neuron. It registers the device through PyTorch's PrivateUse1 extension point, supports eager, torch.compile and custom NKI kernels across Trainium2 and Trainium3, and ships as an Apache 2.0 public Beta on Oct. 20.

AWS released TorchNeuron, a native PyTorch backend for Trainium chips, so model code, libraries and tools run without Neuron-specific adaptation. Previously, using Hugging Face models on Trainium required Neuron-specific software and configuration; now the device is simply pointed at neuron. It registers the device through PyTorch's PrivateUse1 extension point, supports eager, torch.compile and custom NKI kernels across Trainium2 and Trainium3, and ships as an Apache 2.0 public Beta on Oct. 20.