Khabre branded placeholder image

health

LLM Confidence Was Often Overstated on Neurology Questions

A medRxiv preprint tested eight general-purpose large language models on 100 neurology board-style questions. Confidence estimates were often too high, while agreement across repeated answers best distinguished correct from incorrect responses.

Khabre branded placeholder image

health

On-premise medical AI agent uses consistency to triage diagnoses

A Nature Medicine study describes a fully on-premise clinical AI agent that combines diagnostic reasoning with repeated-run consistency checks. On a seven-disease benchmark, the system retained 98.9% accuracy among cases selected for autonomous handling at a defined consistency threshold, while routing the rest for review.

Khabre branded placeholder image

health

LLM tested for bias assessment in neurology reviews

A medRxiv preprint evaluated a large-language-model pipeline for assessing risk of bias in neurological prognosis studies. Agreement with original human assessments was limited, while a small comparison suggested a similar level of agreement to that between human raters.