Baidu self-reported that ERNIE 5.5 Flash Base scored 78.4 on MMLU-Pro, surpassing DeepSeek-V4-Flash-Base at 69.2, Hy3-preview-Base at 66.9, and MiMo-V2.5-Base at 65.7

Overview Debates Related claims Topics Sources

Anthropic said Claude Fable 5.2 scored 69.9% on FrontierSWE v2, outperforming GPT-6 Astra at 65.5% and Gemini 4 Carbon at 61.2%

Anthropic said Claude Fable 5.2 scored 51.4% at Max effort on Zapier's AutomationBench business automation test, behind Gemini 4 Carbon's score of 53.9%

Anthropic said during pre-release testing, 1,000 Fable 5.2 agents formalized the proof of Fermat's Last Theorem in Lean in 30 hours, compared to 26% completion in 18 hours by Opus 5.5

Anthropic said Claude Fable 5.2 scored 49.1% at Xhigh effort on the FrontierCode 2.0 agentic coding benchmark, leading GPT-6 Astra at 42.8% and Gemini 4 Carbon at 41.1%

Anthropic stated that Claude Fable 5.2 and Claude Mythos 5.2 generate artificial intelligence outputs 30% faster than previous 5.1 generation models

On an 803-prompt evaluation set created by Nous Research, Arete-27B reduced the proportion of responses containing Chinese state propaganda from 22 percent to 0.9 percent

In the freedom of expression evaluation category, Arete-27B reduced the propaganda response rate from 60 percent to 1 percent while raising the factual accuracy score from 0.89 to 2.44

Arete-27B raised the factual accuracy score on the Nous Research benchmark to 2.98 out of 5, compared to 2.32 out of 5 for base Qwen3.8-27B

Nous Research evaluated Arete-27B using xAI's Grok 4.7 as a judge model to grade 803 prompts across seven value categories against facts from cited sources

On the 803-prompt Propaganda_Eval benchmark, answers scoring zero on factual accuracy dropped from 359 for Qwen3.8-27B to 216 for Arete-27B

Inkling 2 Small scored 46.8% on EnterpriseOps-Gym, outperforming open alternatives like GLM-5.3 and Anthropic's Claude Sonnet 5

Thinking Machines reduced its internal misbehavior score from 75.2 for the original Inkling Small to 14.9 for Inkling 2 Small, compared to 0.8 for GPT-6.1 Sol

Inkling 2 Small achieved an Intelligence Index score of 31 from Artificial Analysis, matching Gemini 3.8 Flash and positioning it as the top western open-weight model on the benchmark

On Surge AI's EnterpriseBench-CoreCraft benchmark, Inkling 2 Small scored 71.8%, placing third overall behind Anthropic's Claude Fable 5.1 at 77.4% and Claude Opus 5.5 at 74.4%

Artificial Analysis reported that Inkling 2 Small generated 154 million output tokens during its Intelligence Index evaluation compared to a median of 89.8 million tokens among comparable models

On Artificial Analysis's AA-Omniscience v1.1 evaluation, Inkling 2 Small reduced its hallucination rate to 27% from the previous Inkling Small's 61%, while accuracy rose from 32% to 34%

Baidu reported that ERNIE 5.5 Flash Base achieved the top score on 24 out of 30 base-model benchmarks in Baidu's unified evaluation pipeline

DeepSeek-V4-Flash-Base scored 60.0 on HELMET-Rerank, outperforming ERNIE 5.5 Flash Base which scored 56.2 in Baidu's evaluation pipeline

Google DeepMind stated that Gemini Omni 1.2 Flash still experiences performance limitations with fast sports action, rapid script modifications, and complex physics

METR based its 11-week assessment of Anthropic, conducted between August and October 2026, on confidential research, employee interviews, and performance data from unreleased models