Ko-TruthfulQA

KoreanHigher is better

TruthfulQA-style questions designed to draw out common misconceptions, translated into Korean and answered as multiple choice. It checks whether the model resists plausible but wrong answers. Horangi runs a fixed 100-question subset rather than the full dataset, so its numbers are not directly comparable with full-dataset scores. Scores run from 0 to 100%. Higher is better.

Top score98.0%Claude Fable 5
Models tested48
Last updated2026.08.03
Model release date (newest on the right)
Best score so farHigher on the chart is better
  1. 1
    Anthropic2026.06.09 · high-effort
    98.0%
  2. 1
    Google2026.02.19 · high-effort
    98.0%
  3. 3
    OpenAI2026.04.23 · xhigh-effort
    96.0%
  4. 3
    Anthropic2026.05.27 · high-effort
    96.0%
  5. 3
    Anthropic2025.05.22 · high-effort
    96.0%
  6. 3
    Anthropic2025.09.29 · high-effort
    96.0%
  7. 7
    Anthropic2026.06.30 · high-effort
    95.0%
  8. 7
    Google2025.12.17 · high-effort
    95.0%
  9. 7
    Anthropic2025.11.24 · high-effort
    95.0%
  10. 7
    Alibaba2026.05.21
    95.0%

The "harness" is the agent program the AI used to carry out the task. The same model can score very differently depending on its harness and reasoning effort.