Meta moves GPU execution control into Triton: TLX lets production training and inference orchestrate warp groups directly
Meta released Triton Low-Level Extensions (TLX), which lets engineers explicitly orchestrate warp groups, asynchronous data movement and cluster execution while keeping Triton's programming model. Modern GPU features such as warp specialization, tensor memory and cluster execution were previously either hidden behind compiler abstractions or required large amounts of architecture-specific CUDA code. TLX is already in production across Meta's recommendation training, recommendation inference and large-scale LLM pretraining, where GEM training reached 20-25% end-to-end MFU on several thousand NVIDIA Blackwell GPUs.