# AWS Trainium

Amazon released TorchNeuron, an open-source backend that translates PyTorch code into operations executable on AWS Trainium, so PyTorch code already running on other accelerators runs on Trainium with minimal or no code changes. An optional adaptive eager mode groups operations into small graphs that are compiled and cached, approaching fully compiled performance while keeping eager mode's debugging experience. For evaluation, AI agents swept Hugging Face repositories to identify 841 representative models covering the range of architectures, and tens of thousands of tensor shapes were distilled for tuning and benchmarking.

Amazon released TorchNeuron, an open-source backend that translates PyTorch code into operations executable on AWS Trainium, so PyTorch code already running on other accelerators runs on Trainium with minimal or no code changes. An optional adaptive eager mode groups operations into small graphs that are compiled and cached, approaching fully compiled performance while keeping eager mode's debugging experience. For evaluation, AI agents swept Hugging Face repositories to identify 841 representative models covering the range of architectures, and tens of thousands of tensor shapes were distilled for tuning and benchmarking.

Running Hugging Face models on AWS Trainium now rests on a different foundation: TorchNeuron, a native PyTorch backend, exposes Neuron chips as an ordinary device with eager execution, torch.compile and native distributed APIs, replacing the PyTorch XLA-based optimum-neuron. By Hugging Face's comparison, out-of-the-box support among the 100 most-used text-generation architectures rises from 46% with Optimum Neuron v0.4.5 to 89%. The backend enters public beta on October 20, 2026.

Running Hugging Face models on AWS Trainium now rests on a different foundation: TorchNeuron, a native PyTorch backend, exposes Neuron chips as an ordinary device with eager execution, torch.compile and native distributed APIs, replacing the PyTorch XLA-based optimum-neuron. By Hugging Face's comparison, out-of-the-box support among the 100 most-used text-generation architectures rises from 46% with Optimum Neuron v0.4.5 to 89%. The backend enters public beta on October 20, 2026.