MedScribe

Citation frequency 2/3
What does it measure?
Vals AI's medical-documentation test: checks whether the AI can read a doctor–patient conversation and write a clinical note in the standard SOAP format.
Who evaluates it, and how?
An AI judge grades each note against 100 rubrics built by medical scribes and clinicians. The transcripts are synthetic conversations generated from de-identified clinical notes.
Reading the score
Scores run from 0 to 100%. Higher is better. The top models are bunched around 90%, so gaps are small. Vals reports that the AI judge agreed with the majority human opinion 80.5% of the time.
Top score91.4%
Models tested76
Scoring basisHigher is better
Last updated2026.11.19
Model release date

Can it turn a doctor–patient conversation into an accurate medical record?

MedScribe

  1. 🥇AnthropicClaude Opus 5.591.4%
  2. 🥈AnthropicClaude Fable 5.191.3%
  3. 🥉AnthropicClaude Sonnet 5.591.1%
  4. #4AnthropicClaude Opus 591.0%
  5. #5InklingInkling 2 Small90.2%
  6. #6MetaMuse Spark 1.2Reasoning effort: Extra High90.1%
  7. #7AnthropicClaude Haiku 5.589.5%
  8. #8SpaceXSIGrok 4.7Reasoning effort: Extra High89.4%
  9. #9MetaMuse WonderReasoning effort: Max89.3%
  10. #10Z.aiGLM 5.3 FlashReasoning effort: Max88.9%
  11. #11MetaMuse Spark 1.1Reasoning effort: Extra High88.9%
  12. #12Z.aiGLM 5.3Reasoning effort: Max88.8%
  13. #13AnthropicClaude Fable 588.5%
  14. #14XiaomiMiMo-V2.6-Pro88.3%
  15. #15Moonshot AIKimi K3Reasoning effort: Max88.0%
  16. #16OpenAIGPT-6 AstraReasoning effort: Max87.9%
  17. #17GoogleGemini 4 ArgonReasoning effort: High87.4%
  18. #18MiniMaxMiniMax M387.3%
  19. #19SpaceXSIGrok 4.5Reasoning effort: High86.9%
  20. #20OpenAIGPT-5.5Reasoning effort: Extra High86.9%
  21. #21AnthropicClaude Opus 4.686.7%
  22. #22SpaceXSIGrok 4.6Reasoning effort: High86.5%
  23. #23OpenAIGPT-6.1 SolReasoning effort: Max86.5%
  24. #24MetaMuse Spark85.9%
  25. #25AnthropicClaude Opus 4.885.8%
  26. #26DeepSeekDeepSeek V4.1 FlashReasoning effort: High85.5%
  27. #27AnthropicClaude Opus 4.5Reasoning effort: Thinking85.3%
  28. #28XiaomiMiMo-V2.6-Flash85.3%
  29. #29OpenAIGPT-5.6 SolReasoning effort: Max85.2%
  30. #30AnthropicClaude Haiku 4.5Reasoning effort: Thinking85.2%
  31. #31AnthropicClaude Sonnet 4.584.5%
  32. #32GoogleGemini 3.8 FlashReasoning effort: High84.5%
  33. #33OpenAIGPT-5.6 LunaReasoning effort: Max84.4%
  34. #34GoogleGemini 3.7 FlashReasoning effort: High83.9%
  35. #35XiaomiMiMo V2.5 Pro83.7%
  36. #36OpenAIGPT-6 LunaReasoning effort: Max83.7%
  37. #37OpenAIGPT-5Reasoning effort: High83.7%
  38. #38TencentHy483.6%
  39. #39Z.aiGLM 5.283.5%
  40. #40GoogleGemini 2.5 FlashReasoning effort: Thinking83.0%
  41. #41AnthropicClaude Opus 4.783.0%
  42. #42OpenAIGPT-5.6 TerraReasoning effort: Extra High82.9%
  43. #43OpenAIGPT-6 SolReasoning effort: Max82.0%
  44. #44OpenAIGPT-5 MiniReasoning effort: High80.6%
  45. #45Mistral AIMistral Large 4Reasoning effort: High80.4%
  46. #46DeepSeekDeepSeek V4 FlashReasoning effort: High80.4%
  47. #47DeepSeekDeepSeek V4 ProReasoning effort: Max80.2%
  48. #48MiniMaxMiniMax M2.779.9%
  49. #49GoogleGemini 3.6 FlashReasoning effort: High79.7%
  50. #50AlibabaQwen3.7 Max79.4%
  51. #51SpaceXSIGrok 4.1 Fast (Reasoning)78.7%
  52. #52Moonshot AIKimi K2.678.1%
  53. #53OpenAIGPT-5.4Reasoning effort: Extra High77.5%
  54. #54SpaceXSIGrok 4.1 Fast77.5%
  55. #55OpenAIGPT-5.4 NanoReasoning effort: High77.1%
  56. #56AlibabaQwen3.6 Plus77.0%
  57. #57GoogleGemini 3.5 FlashReasoning effort: High76.6%
  58. #58Moonshot AIKimi K2.5Reasoning effort: Thinking76.4%
  59. #59GoogleGemini 3.1 ProReasoning effort: High76.1%
  60. #60AnthropicClaude Sonnet 576.1%
  61. #61GoogleGemini 2.5 Flash Lite75.8%
  62. #62SpaceXSIGrok 4.374.4%
  63. #63AnthropicClaude Opus 4.1Reasoning effort: Thinking73.9%
  64. #64GoogleGemini 2.5 Pro73.6%
  65. #65OpenAIGPT-5 NanoReasoning effort: High72.9%
  66. #66AnthropicClaude Sonnet 472.4%
  67. #67Z.aiGLM-5.172.3%
  68. #68XiaomiMiMo V2.572.2%
  69. #69GoogleGemini 3.5 Flash-LiteReasoning effort: High70.9%
  70. #70GoogleGemini 3 FlashReasoning effort: High69.9%
  71. #71Mistral AIMistral Medium 3.5Reasoning effort: High67.7%
  72. #72PoolsideLaguna M.165.9%
  73. #73GoogleGemini 3.1 Flash LiteReasoning effort: High63.9%
  74. #74SpaceXSIGrok 4.20 (Reasoning)63.4%
  75. #75MetaLlama 4 Maverick54.2%
  76. #76MetaLlama 4 Scout50.6%
Top 7 near 91.4% · hard to separate the best · Half of models ≤ 83.6%

The "harness" is the agent program the AI used to carry out the task. The same model can score very differently depending on its harness and reasoning effort.