Skip to main content
Search

# Synthetic Data Generation

12 related articles

Subscribe to updates
  1. arXiv

    Humanoid HALO learns perceptive whole-body motion in simulation, then hits 91% over 360 trials in six unmapped real homes

    Humanoids asked to sit down or walk to a named object need paired supervision mapping pixels and free-form language to whole-body joint commands, and that data has so far come from teleoperation or wearable capture, where an hour of data costs at least an hour of human time. HALO moves data generation into simulation, synthesizing egocentric vision-language-motion episodes across a thousand procedurally generated homes, then uses a layered stack that splits a free-form request into subtasks, generates five-second whole-body motion plans, and executes them with a perceptive tracker. Without seeing a real home in training, it transfers zero-shot to six unscanned, unmapped real homes, succeeding in 91% of 360 trials.

  2. World models move to closed loop: a Transfer-Auto reference run on four GPUs returns seven 720p videos and 99 LiDAR sweeps

    NVIDIA has packaged world-foundation-model training, optimization and inference into Cosmos Framework, with agent-callable skills and checkpoints that run out of the box. Developers previously had to fit a model to their own sensors, action space and data, then get it into an application, two separate rework efforts. The released Cosmos 3 Nano simulation recipes cover driving, robotics and surgery: a Transfer-Auto reference run on four GPUs returns seven 720p videos and 99 LiDAR sweeps, while Sim-Auto, distilled into a causal few-step model, generates observations step by step from driving-policy input and returns them to the policy for closed-loop evaluation.

  3. arXiv

    Instruction tuning on 0.5% of the data: QSGS cuts redundancy with a graph cut and matches full-data Mistral-7B

    For targeted instruction-tuning data selection, QSGS organizes candidate examples by gradient similarity into a graph and applies a submodular graph cut that pulls the subset toward the target task while penalizing internal redundancy, then adds gradient-guided synthesis to fill directions the pool cannot cover. On MMLU, BBH and TydiQA across Llama-2, Llama-3 and Mistral, QSGS at a 0.5% budget (1,350 of 270,000 examples) matches or exceeds full-data performance on Mistral-7B and beats the strongest baseline on every benchmark.

  4. Meitei Mayek handwriting recognition stops slicing words into characters: whole-word reading cuts synthetic test word errors to 1.57%

    Handwritten Meitei Mayek has been recognised one character at a time, yet its most frequent confusions depend on where a character sits in a word. Training words are composed from isolated character images and read whole by a convolutional encoder, a bidirectional LSTM and CTC, giving 0.24% character and 1.57% word error on 5,000 synthetic test words; on 100 unseen real words written on a tablet by one native writer, character error is 2.96% and word error 16.0%.

  5. arXiv

    System identification stops modeling one plant at a time: matching only the input signal cuts a stirred-tank reactor's prediction error from 1.249 to 0.242

    A meta model pre-trained offline on synthetic Wiener-Hammerstein systems predicts a new system's output zero-shot from a short input-output context, matches state-of-the-art accuracy on nonlinear identification benchmarks, and cuts an out-of-distribution continuous stirred tank reactor's prediction error from 1.249 to 0.242 by adapting only the input side.

  6. arXiv

    Single-image scene mesh generation with adaptive chunks and explicit 2D–3D conditioning outperforms all baselines on indoor and outdoor reconstruction

    The work redesigns the object-centric 3D generator Trellis 2 with adaptive chunks that scale with camera distance, explicit 2D–3D conditioning that lifts image features onto observed surfaces while distinguishing free space from occluded regions, and supervision from about 4,000 synthesized outdoor scenes, generating a complete scene mesh from a single image and outperforming all baselines in geometric accuracy and perceptual quality on Tanks and Temples, ScanNet++, and 121 in-the-wild images.

  7. arXiv

    ToolRACER generates 5.6K conversation trajectories with 66% failure-prone scenarios via three-agent emulation and four-stage validation, lifting fine-tuned Qwen3-4B to 39.20% macro Pass@1 on τ-bench

    The authors present ToolRACER, a three-stage synthetic data pipeline coordinating user, assistant, and tool emulation agents that injects user-originated and environment-originated adversarial behaviors, validates traces through four evaluators plus a refinement loop, and yields ToolRACERBench: six domains, 55 personas, 5.6K trajectories with about 66% failure-prone scenarios; models fine-tuned on it improve end-to-end agentic accuracy on τ-bench, BFCLv3, and ACEBench over baseline training sets.

  8. arXiv

    InvestigationWorlds builds a legal investigation environment from 100 real federal rulings, and the best model solves only one-third of cases

    The authors introduce InvestigationWorlds: they retrieve 100 real U.S. federal civil cases with decided summary judgment motions from PACER and use an attorney-validated generation pipeline to synthesize role-tagged documents around the original record, so that one corpus admits multiple coherent but incompatible factual readings of which only one matches the court-adopted hypothesis; evaluating six frontier agents on 100 cases, they find agents often commit to incorrect hypotheses despite retrieving relevant evidence, with the highest case-solved rate only 33.3%.

  9. ServiceNow CoreAI's AutoSynthData turns failure diagnoses into enterprise-agent training tasks, lifting Gemma's Pass@1 by 7.2 points on EnterpriseOps Gym

    ServiceNow CoreAI introduces AutoSynthData, which uses a target model's failures and a stronger teacher's successes to locate capability gaps and then generates and validates new executable tasks (system specification, user prompt, verifier); on the Hybrid domain of EnterpriseOps Gym, with Gemma-4-26B-A4B-it as target and Qwen3.8-27B as teacher, it generated 2,000 samples in about 18 hours, and after fine-tuning the best checkpoint (epoch 5) raised mean Pass@1 by 7.2 percentage points (a 35% relative improvement), lifted verifier success from 63.01% to 68.55%, and closed 59% of the original Pass@1 gap between Gemma and the reference model; on ITSM, with DeepSeek-V4.1-Flash as teacher, it generated 1,994 samples in 66 hours and raised mean Pass@1 from 18.77% to 27.18%.

  10. arXiv

    Prompt2Skill builds skills automatically from a single natural-language task description, averaging a 36.1% relative gain across four benchmarks and five models

    Prompt2Skill is a multi-agent framework that, from a natural-language task description alone, has a Data Agent derive a task specification and build a proxy data pool through retrieval, adaptation, and synthesis, and a Skill Agent refine the skill in a closed loop of execution feedback, reflective editing, and paired statistical screening, improving over direct prompting by 36.1% and over off-the-shelf skills by 83.0% on average across question answering, reading comprehension, spreadsheet manipulation, and mathematical reasoning with five open-source and commercial target models, without significant regressions.