# Neuron Kernel Interface

Amazon released TorchNeuron, an open-source backend that translates PyTorch code into operations executable on AWS Trainium, so PyTorch code already running on other accelerators runs on Trainium with minimal or no code changes. An optional adaptive eager mode groups operations into small graphs that are compiled and cached, approaching fully compiled performance while keeping eager mode's debugging experience. For evaluation, AI agents swept Hugging Face repositories to identify 841 representative models covering the range of architectures, and tens of thousands of tensor shapes were distilled for tuning and benchmarking.

Amazon released TorchNeuron, an open-source backend that translates PyTorch code into operations executable on AWS Trainium, so PyTorch code already running on other accelerators runs on Trainium with minimal or no code changes. An optional adaptive eager mode groups operations into small graphs that are compiled and cached, approaching fully compiled performance while keeping eager mode's debugging experience. For evaluation, AI agents swept Hugging Face repositories to identify 841 representative models covering the range of architectures, and tens of thousands of tensor shapes were distilled for tuning and benchmarking.

AWS released TorchNeuron, a native PyTorch backend for Trainium chips, so model code, libraries and tools run without Neuron-specific adaptation. Previously, using Hugging Face models on Trainium required Neuron-specific software and configuration; now the device is simply pointed at neuron. It registers the device through PyTorch's PrivateUse1 extension point, supports eager, torch.compile and custom NKI kernels across Trainium2 and Trainium3, and ships as an Apache 2.0 public Beta on Oct. 20.

AWS released TorchNeuron, a native PyTorch backend for Trainium chips, so model code, libraries and tools run without Neuron-specific adaptation. Previously, using Hugging Face models on Trainium required Neuron-specific software and configuration; now the device is simply pointed at neuron. It registers the device through PyTorch's PrivateUse1 extension point, supports eager, torch.compile and custom NKI kernels across Trainium2 and Trainium3, and ships as an Apache 2.0 public Beta on Oct. 20.