Skip to main content
Search

# Task Synthesis

4 related articles

Subscribe to updates
  1. arXiv

    Agents stop waiting for an external teacher: ClawLoop has them write tasks, diagnose failures, and retrain in the same sandbox

    ClawLoop closes task synthesis, training, and failure diagnosis into one loop so harness-based agents improve without an external teacher model, beating the one-shot ClawGym pipeline on SkillsBench, Claw-Eval-Live, and ClawGym-Bench.

  2. arXiv

    GraphForge synthesizes 2,169 trajectories from evidence graphs over real files, lifting Qwen3.6-27B from 1380.0 to 1445.7 GDPVal Elo

    GraphForge is an evidence-graph framework that starts from O*NET occupation seeds, crawls real files into a workspace, builds an evidence graph over their relations, and compiles that graph into task statements and rubrics, with an initial rollout and a revision agent checking executability; fine-tuning Qwen3.6-27B on 2,169 trajectories brings GDPVal to 1445.7 (+65.7) under OpenHands and Workspace-Bench-Lite and SpreadsheetBench II to 63.7 (+7.7) and 24.0 (+13.7) under Claude Code, with the same data also improving Qwen3.6-35B-A3B.

  3. arXiv

    SkillGym turns 184k community skills into verifiable training environments, and its 9B fine-tuned model beats a 397B untrained model on two benchmarks

    SkillGym proposes an automatic pipeline that crawls skills from the internet and keeps those whose workflows run reproducibly offline, uses a builder-reviewer agent system to construct skill-critical tasks across four reasoning structures each with a reference solution and an executable verifier, then collects successful trajectories from three teacher models and four agent harnesses for supervised finetuning, improving six models from 2B to 122B parameters on 22 of 24 comparisons across four skill-use benchmarks, with the 9B model outperforming Qwen3.5-397B-A17B on the SkillGym test set and SkillEval and raising the rate of reading the relevant skill from 28% to 96%.

  4. arXiv

    Skill2Env synthesizes 2,963 executable environments from skills, and 1.5K fine-tuning trajectories lift a 35B agent from 36.6 to 45.0 across seven benchmarks

    Skill2Env is a capability-oriented framework that curates skills from public skill libraries, uses reusable difficulty patterns and task blueprints to jointly synthesize task instructions, execution substrates, workspaces, and rubric-based evaluators, and iteratively hardens tasks using solver execution evidence, yielding 2,963 executable tasks; supervised fine-tuning of Qwen3.6-35B-A3B on 1.5K high-scoring trajectories from these environments raises the unweighted average across seven agent benchmarks from 36.6 to 45.0.

You’re all caught up