Skip to main content
Search

# TAE (Trust-AI-Eval)

2 related articles

Subscribe to updates
  1. arXiv

    Evaluation runs already leave per-question records: an audit layer reuses them and finds MMStar image zero-gain above a permutation null

    An audit layer added to VLMEvalKit reuses saved per-question outputs from completed evaluations plus one text-only rerun, and on MMStar measures a 20.2% zero-gain share that still exceeds an item-matched permutation null.

  2. arXiv

    Evolved LLM features lift credit-risk classification from chance to 69.0% and expose zero-shot single-class bias

    The authors propose an evolutionary framework in which an LLM iteratively generates and refines natural-language binary features (rubrics), an LLM scores each sample against them, and the resulting vectors train a transparent classifier such as logistic regression; across AG News, GoEmotions, and HELOC, evolved features beat single-shot rubrics by +2.9 pp on average and outperform zero-shot LLM classification on two of three tasks, with the zero-shot LLM reaching only 50.7% on HELOC (near chance with a strong single-class bias) while evolved features reach 69.0% with balanced, auditable predictions.

You’re all caught up