MedScribe
Citation frequency 2/3
- What does it measure?
- Vals AI's medical-documentation test: checks whether the AI can read a doctor–patient conversation and write a clinical note in the standard SOAP format.
- Who evaluates it, and how?
- An AI judge grades each note against 100 rubrics built by medical scribes and clinicians. The transcripts are synthetic conversations generated from de-identified clinical notes.
- Reading the score
- Scores run from 0 to 100%. Higher is better. The top models are bunched around 90%, so gaps are small. Vals reports that the AI judge agreed with the majority human opinion 80.5% of the time.
Top score91.4%
Models tested76
Scoring basisHigher is better
Last updated2026.11.19
Model release date
Which AI gives the writing and literature answers people prefer most?Arena Writing, Literature & Language
Gemini 4 Carbon🥇
Gemini 4 Carbon🥇Arena Writing, Literature & Language
Gemini 4 Carbon🥇Which AI do people prefer most in long conversations?Arena Multi-turn
Gemini 4 Carbon🥇
Gemini 4 Carbon🥇Arena Multi-turn
Gemini 4 Carbon🥇Can it read people's feelings and respond well in hard conversations?EQ-Bench 4
Claude Opus 5🥇
Claude Opus 5🥇EQ-Bench 4
Claude Opus 5🥇
Can it turn a doctor–patient conversation into an accurate medical record?
MedScribe
- 🥇AnthropicClaude Opus 5.591.4%
- 🥈AnthropicClaude Fable 5.191.3%
- 🥉AnthropicClaude Sonnet 5.591.1%
- #4AnthropicClaude Opus 591.0%
- #5InklingInkling 2 Small90.2%
- #6MetaMuse Spark 1.2Reasoning effort: Extra High90.1%
- #7AnthropicClaude Haiku 5.589.5%
- #8SpaceXSIGrok 4.7Reasoning effort: Extra High89.4%
- #9MetaMuse WonderReasoning effort: Max89.3%
- #10Z.aiGLM 5.3 FlashReasoning effort: Max88.9%
- #11MetaMuse Spark 1.1Reasoning effort: Extra High88.9%
- #12Z.aiGLM 5.3Reasoning effort: Max88.8%
- #13AnthropicClaude Fable 588.5%
- #14XiaomiMiMo-V2.6-Pro88.3%
- #15Moonshot AIKimi K3Reasoning effort: Max88.0%
- #16OpenAIGPT-6 AstraReasoning effort: Max87.9%
- #17GoogleGemini 4 ArgonReasoning effort: High87.4%
- #18MiniMaxMiniMax M387.3%
- #19SpaceXSIGrok 4.5Reasoning effort: High86.9%
- #20OpenAIGPT-5.5Reasoning effort: Extra High86.9%
- #21AnthropicClaude Opus 4.686.7%
- #22SpaceXSIGrok 4.6Reasoning effort: High86.5%
- #23OpenAIGPT-6.1 SolReasoning effort: Max86.5%
- #24MetaMuse Spark85.9%
- #25AnthropicClaude Opus 4.885.8%
- #26DeepSeekDeepSeek V4.1 FlashReasoning effort: High85.5%
- #27AnthropicClaude Opus 4.5Reasoning effort: Thinking85.3%
- #28XiaomiMiMo-V2.6-Flash85.3%
- #29OpenAIGPT-5.6 SolReasoning effort: Max85.2%
- #30AnthropicClaude Haiku 4.5Reasoning effort: Thinking85.2%
- #31AnthropicClaude Sonnet 4.584.5%
- #32GoogleGemini 3.8 FlashReasoning effort: High84.5%
- #33OpenAIGPT-5.6 LunaReasoning effort: Max84.4%
- #34GoogleGemini 3.7 FlashReasoning effort: High83.9%
- #35XiaomiMiMo V2.5 Pro83.7%
- #36OpenAIGPT-6 LunaReasoning effort: Max83.7%
- #37OpenAIGPT-5Reasoning effort: High83.7%
- #38TencentHy483.6%
- #39Z.aiGLM 5.283.5%
- #40GoogleGemini 2.5 FlashReasoning effort: Thinking83.0%
- #41AnthropicClaude Opus 4.783.0%
- #42OpenAIGPT-5.6 TerraReasoning effort: Extra High82.9%
- #43OpenAIGPT-6 SolReasoning effort: Max82.0%
- #44OpenAIGPT-5 MiniReasoning effort: High80.6%
- #45Mistral AIMistral Large 4Reasoning effort: High80.4%
- #46DeepSeekDeepSeek V4 FlashReasoning effort: High80.4%
- #47DeepSeekDeepSeek V4 ProReasoning effort: Max80.2%
- #48MiniMaxMiniMax M2.779.9%
- #49GoogleGemini 3.6 FlashReasoning effort: High79.7%
- #50AlibabaQwen3.7 Max79.4%
- #51SpaceXSIGrok 4.1 Fast (Reasoning)78.7%
- #52Moonshot AIKimi K2.678.1%
- #53OpenAIGPT-5.4Reasoning effort: Extra High77.5%
- #54SpaceXSIGrok 4.1 Fast77.5%
- #55OpenAIGPT-5.4 NanoReasoning effort: High77.1%
- #56AlibabaQwen3.6 Plus77.0%
- #57GoogleGemini 3.5 FlashReasoning effort: High76.6%
- #58Moonshot AIKimi K2.5Reasoning effort: Thinking76.4%
- #59GoogleGemini 3.1 ProReasoning effort: High76.1%
- #60AnthropicClaude Sonnet 576.1%
- #61GoogleGemini 2.5 Flash Lite75.8%
- #62SpaceXSIGrok 4.374.4%
- #63AnthropicClaude Opus 4.1Reasoning effort: Thinking73.9%
- #64GoogleGemini 2.5 Pro73.6%
- #65OpenAIGPT-5 NanoReasoning effort: High72.9%
- #66AnthropicClaude Sonnet 472.4%
- #67Z.aiGLM-5.172.3%
- #68XiaomiMiMo V2.572.2%
- #69GoogleGemini 3.5 Flash-LiteReasoning effort: High70.9%
- #70GoogleGemini 3 FlashReasoning effort: High69.9%
- #71Mistral AIMistral Medium 3.5Reasoning effort: High67.7%
- #72PoolsideLaguna M.165.9%
- #73GoogleGemini 3.1 Flash LiteReasoning effort: High63.9%
- #74SpaceXSIGrok 4.20 (Reasoning)63.4%
- #75MetaLlama 4 Maverick54.2%
- #76MetaLlama 4 Scout50.6%
Top 7 near 91.4% · hard to separate the best · Half of models ≤ 83.6%
The "harness" is the agent program the AI used to carry out the task. The same model can score very differently depending on its harness and reasoning effort.