# LLM Council

On 783 de-identified free-text mammography, hip-knee-ankle and brain MR reports, an LLM Council of three general small models plus a chairman reached 83.56% overall accuracy, below the medically trained MedGemma 4B at 88.72%, with the gap driven mainly by hip-knee-ankle classification. A single council member, Qwen3-4B-2507, reached the highest accuracy at 91.69%, above both the council and MedGemma, while the council needed four model calls per report and about 2.44 times MedGemma's peak GPU memory.

On 783 de-identified free-text mammography, hip-knee-ankle and brain MR reports, an LLM Council of three general small models plus a chairman reached 83.56% overall accuracy, below the medically trained MedGemma 4B at 88.72%, with the gap driven mainly by hip-knee-ankle classification. A single council member, Qwen3-4B-2507, reached the highest accuracy at 91.69%, above both the council and MedGemma, while the council needed four model calls per report and about 2.44 times MedGemma's peak GPU memory.