Skip to main content
Search

# Task completion

4 related articles

Subscribe to updates
  1. Recorded GUI operations become agent tools: 33/33 core points on three SaaS instances, against 8, 8 and 18 for raw code

    Recording real graphical-interface operations, parameterizing them into a frozen workflow and handing that to an agent can cover more business requirements than letting the agent write code directly. On three complete-task instances of one SaaS business family, the frozen workflow reached 33/33 local core points while raw code reached 8, 8 and 18; on two prospectively fixed instances the tool agents finished in six and five model calls, against 121 and 70 for raw code. Every attempt still failed whole-task acceptance, and collateral state preservation remains unknown.

  2. arXiv

    Robot manipulation policy stops leaning on pretraining alone: Axiom-0 reaches 62.32% success on RoboCasa365

    Axiom-0 uses hierarchical self-refinement to improve both the vision-language model's internal representations and the conditioning before action generation, reaching 62.32% overall success on RoboCasa365, 4.22 percentage points above the highest published leaderboard score of 58.1% from Paimon-0.

  3. AI readiness tracks clinical tasks, not specialties: 330-task scoring finds task category explains ten times more variance

    Whether a medical specialty is ready for AI depends more on which clinical tasks it contains than on its name. A framework scored 330 clinical tasks, 15 for each of 22 specialties drawn from the American Board of Medical Specialties list, on six dimensions: codifiability, data-structure dependence, transferability of decision authority, physical dependence, clinical governability and specialty centrality, each on a three-point scale, then aggregated them into a Medical Specialty AI Readiness (MSAIR) score. Task category explained 71.6% of adjusted R² versus 6.4% for specialty; documentation scored highest on average (2.874) and emergency decision making lowest (1.639), while specialty means spanned only 2.010 to 2.543.

  4. Stanford HAI

    Medical AI aces licensing exams but finishes under half the chart work: two execution-grounded benchmarks point the same way

    Medical AI evaluation is shifting from answering questions to acting inside real work environments. Near-perfect licensing exam scores said nothing about whether a model can carry a task across records, documents and software systems. Using an EHR sandbox and simulated payer portals, the best agents completed 46% and 36.3% of clinical and administrative tasks on a single attempt, mostly losing information between steps.

You’re all caught up