SAW conditions surgical video diffusion on four lightweight signals, cutting CD-FVD to 199.19 and lifting rare-action F1 from 20.93% to 43.14%
The work proposes Surgical Action World (SAW), which reformulates video-to-video diffusion as trajectory-conditioned surgical action synthesis conditioned only on four lightweight signals—a language prompt, a reference first frame, a tissue affordance mask, and 2D tool-tip trajectories—fine-tunes LTX-Video on a custom-curated dataset of 12,044 laparoscopic clips with a depth consistency loss, reaches CD-FVD 199.19 (vs. 546.82 for SurgSora) and FVD 224.28 on held-out test data, and demonstrates that augmenting rare actions with generated videos improves action recognition on real test data (clipping F1 20.93% to 43.14%; cutting 0.00% to 8.33%) plus initial feasibility of rendering tool-tissue interaction videos from simulator-derived trajectories.