Bb5a31f81ClaimHandshake AI developed the VIALS benchmark to evaluate the capability of AI models to interpret life science laboratory assaysAgreeDisagree
Bb5a31f81ClaimThe VIALS benchmark evaluates model interpretation on tasks including plasmid DNA sequence percentages, molecular hydrogen bond counts, and medical histology imagesAgreeDisagree
Bb5a31f81ClaimHandshake AI developed the ATLAS finance benchmark, comprising 100 tasks evaluated across 13 simulated financial environmentsAgreeDisagree
Bb5a31f81ClaimFrontier models including MiniMax, GLM, and Grok score below a 20 percent pass rate on the VIALS benchmarkAgreeDisagree
Bb5a31f81ClaimAutonomous AI agents provided with scientific Python libraries like SciPy and OpenCV achieve under 60 percent accuracy on VIALS benchmark tasksAgreeDisagree
Bb5a31f81ClaimFrontier AI models achieve a pass rate of under 20 percent on the ATLAS finance benchmarkAgreeDisagree
Bb5a31f81ClaimOut of the box, frontier AI models achieve pass rates of 50 percent or worse across the VIALS life science benchmarkAgreeDisagree
Bb5a31f81ClaimThe SemiAnalysis GDPX benchmark evaluates artificial intelligence models on economically valuable tasks such as chip design, finance, and biologyAgreeDisagree
Bb5a31f81ClaimIn the DrivingBench benchmark, GPT-6 Astra reached halfway on its first attempt and completed the entire physical Toyota Corolla driving course on its second attemptAgreeDisagree
Bb5a31f81ClaimIn the DrivingBench benchmark, Grok 4.6 completed a maximum of 11% of a physical Toyota Corolla driving course across three attemptsAgreeDisagree
Bb5a31f81ClaimIn the DrivingBench benchmark, Claude Fable 5.1 completed half of a physical Toyota Corolla driving course on its third attemptAgreeDisagree
Bb5a31f81ClaimAs of October 2026, OpenAI is developing an investment banking evaluation benchmark designed to assess the automation of junior analyst workflowsAgreeDisagree
Bb5a31f81ClaimOn the GDPVAL AA benchmark for agentic white-collar work, Kimi K3.1 ranked behind Opus 5.5 and ahead of Fable 5.1AgreeDisagree
Bb5a31f81ClaimDeepSeek V41 Flash and GLM 5.3 scored in the low 40s on the Terminalbench 4.0 benchmarkAgreeDisagree
Bb5a31f81ClaimOn the Terminalbench 4.0 benchmark for agentic coding, Kimi K3.1 scored less than one point behind Opus 5.5AgreeDisagree
Bb5a31f81ClaimOn the Terminalbench 4.0 benchmark, Kimi K3.1 scored approximately seven points ahead of GPT6 Astra and Fable 5.1AgreeDisagree
Bb5a31f81ClaimOpenAI released the HealthBench evaluation benchmark in May 2025 to evaluate AI performance across layperson and clinician communication personasAgreeDisagree
Bb5a31f81ClaimOpenAI released GPT-6 Luna, which scored higher on the HealthBench Professional clinical benchmark than GPT-5.6 Sol while costing 34 times lessAgreeDisagree
Bb5a31f81ClaimGemini 4 Argon achieved state-of-the-art benchmark scores on the VALS Index Automation Bench, VALS Finance Agent, and Harvey Legal Agent benchmarkAgreeDisagree
Bb5a31f81ClaimOn the Terminal Bench 4.0 benchmark, Gemini 4 Argon scored nine points lower than leading model Opus 5.5AgreeDisagree