Inkling 2 Small scored 46.8% on EnterpriseOps-Gym, outperforming open alternatives like GLM-5.3 and Anthropic's Claude Sonnet 5

Overview Debates Related claims Topics Sources

Anthropic said Claude Fable 5.2 scored 69.9% on FrontierSWE v2, outperforming GPT-6 Astra at 65.5% and Gemini 4 Carbon at 61.2%

Anthropic said Claude Fable 5.2 scored 51.4% at Max effort on Zapier's AutomationBench business automation test, behind Gemini 4 Carbon's score of 53.9%

Anthropic said during pre-release testing, 1,000 Fable 5.2 agents formalized the proof of Fermat's Last Theorem in Lean in 30 hours, compared to 26% completion in 18 hours by Opus 5.5

Anthropic said Claude Fable 5.2 scored 49.1% at Xhigh effort on the FrontierCode 2.0 agentic coding benchmark, leading GPT-6 Astra at 42.8% and Gemini 4 Carbon at 41.1%

Anthropic stated that Claude Fable 5.2 and Claude Mythos 5.2 generate artificial intelligence outputs 30% faster than previous 5.1 generation models

On an 803-prompt evaluation set created by Nous Research, Arete-27B reduced the proportion of responses containing Chinese state propaganda from 22 percent to 0.9 percent

In the freedom of expression evaluation category, Arete-27B reduced the propaganda response rate from 60 percent to 1 percent while raising the factual accuracy score from 0.89 to 2.44

Arete-27B raised the factual accuracy score on the Nous Research benchmark to 2.98 out of 5, compared to 2.32 out of 5 for base Qwen3.8-27B

Nous Research evaluated Arete-27B using xAI's Grok 4.7 as a judge model to grade 803 prompts across seven value categories against facts from cited sources

On the 803-prompt Propaganda_Eval benchmark, answers scoring zero on factual accuracy dropped from 359 for Qwen3.8-27B to 216 for Arete-27B

Thinking Machines reduced its internal misbehavior score from 75.2 for the original Inkling Small to 14.9 for Inkling 2 Small, compared to 0.8 for GPT-6.1 Sol

Inkling 2 Small achieved an Intelligence Index score of 31 from Artificial Analysis, matching Gemini 3.8 Flash and positioning it as the top western open-weight model on the benchmark

On Surge AI's EnterpriseBench-CoreCraft benchmark, Inkling 2 Small scored 71.8%, placing third overall behind Anthropic's Claude Fable 5.1 at 77.4% and Claude Opus 5.5 at 74.4%

Artificial Analysis reported that Inkling 2 Small generated 154 million output tokens during its Intelligence Index evaluation compared to a median of 89.8 million tokens among comparable models

On Artificial Analysis's AA-Omniscience v1.1 evaluation, Inkling 2 Small reduced its hallucination rate to 27% from the previous Inkling Small's 61%, while accuracy rose from 32% to 34%

Baidu reported that ERNIE 5.5 Flash Base achieved the top score on 24 out of 30 base-model benchmarks in Baidu's unified evaluation pipeline

DeepSeek-V4-Flash-Base scored 60.0 on HELMET-Rerank, outperforming ERNIE 5.5 Flash Base which scored 56.2 in Baidu's evaluation pipeline

Baidu self-reported that ERNIE 5.5 Flash Base scored 78.4 on MMLU-Pro, surpassing DeepSeek-V4-Flash-Base at 69.2, Hy3-preview-Base at 66.9, and MiMo-V2.5-Base at 65.7

Google DeepMind stated that Gemini Omni 1.2 Flash still experiences performance limitations with fast sports action, rapid script modifications, and complex physics

METR based its 11-week assessment of Anthropic, conducted between August and October 2026, on confidential research, employee interviews, and performance data from unreleased models