Today's
IBM Study Finds Gaps in Verified AI Code
- IBM Research study found formal code verification pass rates can hide vacuous or incorrect proofs
- Claude Opus 4.7 passed verifier on 99.1% of HumanEval, but only 1.9% bound to specification predicates
- Rust pipeline samples still failed hidden tests at 11.5% and 14.8%; end-to-end correctness was 7.8%
DEV.toRead more · 1 min →