Unite-Audio jointly trains audio representation learning with latent flow matching, reaching competitive text-to-audio generation with a compact model
The work introduces Unite-Audio, which jointly learns continuous audio representations and latent flow matching for text-to-audio generation; by coupling reconstruction with self-supervised generative prediction it lets the generative objective directly shape the latent space, and it applies Flow-GRPO post-training to improve text-conditioned generation; experiments show competitive text-to-audio performance with a compact latent flow model, and ablation studies confirm the benefit of jointly learning the audio representation and the generative model.