Skip to main content
Search

# decision model

15 related articles

Subscribe to updates
  1. OpenRouter Blog

    OpenRouter tests three routes to structured LLM output: 209 of 216 replies met a strict schema, and all 7 misses came from one provider that ignores it

    OpenRouter compared three ways to get reliable JSON out of models, using 24 messy support messages across nine models that support structured outputs: send a strict JSON Schema, force a single tool call, or switch to a decision model that only returns labels. Across the nine models, 209 of 216 replies matched a strict schema, and all 7 misses came from one provider that ignores the schema; asking for JSON only in the prompt produced 18 failures, each from a code fence. For GLM 5.3 FlashX, which only supports tools, forcing the tool call gave 22 valid outputs out of 24, against 0 when the schema was sent directly.

  2. NaceAI

    Decision models skip the generated answer: Drex Max scores 67.52 on a public decision suite and answers in 183 ms

    Drex turns choosing into a single forward pass: given a context, a question and a set of options, the model returns a probability for every option instead of parsing text written by a large model. Drex Max, the largest of four open decision models, scores 67.52 on the public Decision Index 0.4.1 suite against 60.70 for Jev 1.14.0, and drops less than a point when private tests are added. On Decision Bench v4 with raw image input it is statistically tied with d3-turbo and GPT-6 Sol, answering a typical request in 183 ms.

  3. Hugging Face turns decisions into an interface: models return option probabilities instead of generating text

    Hugging Face has defined a common interface for decision models: given a state and a set of typed questions, a model returns option probabilities, an ordered score or a true/false probability without generating text token by token. Previously such structured judgments relied on prompting a large language model for JSON, on fixed-label classifiers, or on zero-shot classification. Transformers adds DecisionPipeline and related classes, llama.cpp serves the same /v1/systemone endpoint, and compatible autoregressive models can score answer options without producing text.

  4. Hugging Face makes decisions a model output: no token-by-token text, just option probabilities

    Hugging Face has fixed a common interface for decision models: given a state and several typed questions, the model returns option probabilities, an ordered score or a yes/no probability without generating any text. Previously such structured judgments relied on an LLM emitting JSON, sometimes backed by constrained decoding, or on fixed-label and zero-shot classifiers. Transformers, llama.cpp and a Hub tag now follow the same contract, and compatible autoregressive language models can use the interface without retraining.

  5. NaceAI

    Drex Max scores 67.6 on the public Decision Index and returns a visual decision in 183 ms

    Nace released Drex Max, a decision model that reads screenshots, screencasts, scanned documents, charts or photos and, given a set of typed questions, returns a probability for every supplied option in one forward pass. A computer-use agent can face about thirty such small decisions in a single task, and each one previously meant sending a screenshot to a large frontier model and waiting seconds; Drex Max scores 67.6 on the public Decision Index 0.4.0 against 61.3 for Drex v2.0, with a median API latency of 183 ms and $0.06 per 1,000 decisions.

  6. NaceAI

    Drex opens four decision models that score every option in one pass, answering a typical request in 183 ms

    Drex replaces asking a large model to generate text and parsing an answer with a single forward pass that scores each supplied option. The largest of the four open models, Drex Max, scores 67.52 on the public Decision Index 0.4.1 suite against 60.70 for Jev 1.14.0, and drops less than a point when private tests are added. On Decision Bench v4 it is statistically tied with d3-turbo and GPT-6 Sol and 1.6 points behind Claude Opus 5.5, while answering a typical request in 183 ms.

  7. Genoria AI releases Operon-S1, splitting judgment out of the agent loop: flipping option order moves about 6% of answers, down from about 37%

    Genoria AI, under BGI Group's MGI, released Operon-S1, which pulls key judgments out of a biomedical AI agent's execution loop and has a lightweight judgment model flag and review them at 13 decision points while ProtoPilot still plans and runs the analysis. On 750 multiple-choice questions not used in that training round, flipping only the option order changed about 6% of answers, down from about 37%; with the untrained initial LAYA version, SeqQA cost fell 5.8%, but scores on the separate seqqa2 sequence-reasoning test dropped about 1.3 percentage points.

  8. Baseten

    A 2B decision model returns one token in 20 ms: joey-1 costs a tenth of mammoth-1 per million tokens

    Base Labs released joey-1, a 2B decision model that answers label-style calls such as routing a ticket or flagging a message by returning a single token and a calibrated probability in one forward pass, instead of generating text. At production scale it serves the average 2,000-token request at a P50 end-to-end latency of 20 ms, about 2.5x faster than elephant-1 at 49 ms, and at $0.01 per million tokens it costs a tenth of mammoth-1.

  9. Baseten

    Decision models skip text generation: mammoth-1 tops 208 models, elephant-1 leads the 9B class

    Baseten's research lab released two open-source decision models, mammoth-1 (27B) and elephant-1 (9B), which return a probability distribution over every possible answer instead of generating text. mammoth-1 ranks first among 208 decision models on the Jev Decision Index 0.4, while elephant-1 is tied for eighth there and is the leading 9B decision model, and is tied for first with d1-ultra on the separate Artificial Analysis Decision Index. Both were post-trained from Qwen3.5-9B and Qwen3.5-27B on 6.21 million decision-making examples, are free to try for a week on Baseten Model APIs, and are open-source on Hugging Face.

  10. NaceAI

    Agents stop paging through files: Drex for Search picks the spot first, cutting steps 62% and input tokens 56% across 529 questions

    When an AI agent needs an answer from a real folder of reports, ledgers and contracts, it searches, opens a file, reads pages and searches again, sometimes for twenty or thirty steps. Drex for Search moves that decision earlier: before the agent reads anything, the decision model Drex decides which folder, file and page can hold the answer, and inside a spreadsheet which table and column, so the agent reads only those places and returns the source. Across 6 professional-work benchmarks and 529 questions, coding agents using it took 62% fewer steps and 56% fewer input tokens, raised accuracy from 63.1% to 67.1%, and cut median time per question from 80.8 s to 35.5 s.