Skip to main content
Search

# Evidence Contract

4 related articles

Subscribe to updates
  1. arXiv

    Customer-support guidance without a re-ranker: a portable skill hits 99.2% procedural equivalence on 132 real cases

    A portable skill with no model weights, made of a natural-language operating manual and deterministic scripts, produced guidance procedurally equivalent to human-approved answers on 99.2% of 132 real customer-support cases, with 83.3% evidence sufficiency.

  2. arXiv

    A coronary agent now shows its evidence before its answer: the gate passes 76.7%, and rejects half of reference lesions

    Panvascular intervention research is starting to write traceability into an agent's output contract: ScienceBuddy-PV fixes a shared convolutional model on the public ARCADE coronary angiography benchmark and evaluates only an evidence gate and action audit, where the gate accepts 76.7% of stenosis-frame candidates against 100% for a score-only comparator. On the locked test set, stenosis Dice is 0.231 and AUROC is 0.957 at a pixel prevalence of 0.00975, while reference lesion candidates are accepted 44.3% and rejected 55.7% of the time. The result is an image-level technical validation; recursive harness optimization and model learning remain protocols rather than executed experiments.

  3. arXiv

    TGMS uses plan and evidence contracts to make database-agent plans rejectable and claims checkable

    The work proposes two enforceable contracts for LLM agents over databases: a plan contract that statically checks plan structure, result-field references, and grounded identifiers before execution, and an evidence contract that records belief state, completeness, and provenance so claims can be verified; in TGMS, result-field checking turns invalid references into repairable rejections, completeness propagation detects truncated-count failures in all 15 controlled cases, and claim gating leaves none of 199 emitted answers with an unsupported gated claim at the cost of 21 fewer answers.

  4. arXiv

    EIO-Agents proposes an evidence-to-decision semantic layer and portable evaluation record, deriving a reproducible BLOCK from 243 claims

    EIO-Agents introduces an open specification with two layers: the Evaluation Intelligence Ontology (EIO) defines typed evidence, versioned behavioral predicates with evidence contracts, claims, witness rules, and proof status, while the Portable Evaluation Record (PER) preserves one evaluation's evidence-to-decision chain as a canonical, content-addressed record; in a reference credit-underwriting evaluation, 243 claims project, validate, and explain to a BLOCK decision, whereas an identical capped score in another record yields REVIEW because its proxy observation did not reproduce.

You’re all caught up