DeepSeek-V4-Flash performed well among open-source models evaluated on Leash Bio's chemical exploration benchmark

Overview Debates Related claims Topics

In Leash Bio's benchmark experiments, certain language model agents selected molecules that contradicted the agents' own stated structure-activity relationship hypotheses

Claude Sonnet 5.5 achieved strong performance on Leash Bio's chemical exploration benchmark

On the GDPVAL AA benchmark for agentic white-collar work, Kimi K3.1 ranked behind Opus 5.5 and ahead of Fable 5.1

Claude Sonnet 5 exhibited high operational costs and low performance on Leash Bio's chemical exploration benchmark

In Artificial Analysis testing, Kimi K3.1 scored 64 on the Cyber Index

Leash Bio evaluates agent exploration strategies on structure-activity relationship tasks within fully pre-measured chemical landscapes

Solve 6.1 demonstrated high performance on Leash Bio's chemical exploration benchmark

Ramp data showed Claude Opus 5.5 captured 35.1% of token share and 34.4% of business spend across tracked models

Moonshot released Kimi K3.1 Pro as the first model update to the Kimi K3 family

Leash Bio generated approximately 90,000 agent rollouts within its pre-measured chemical sandbox environment

On the Artificial Analysis Cyber Index, Kimi K3.1 scored 11 percentage points higher than DeepSeek V41 Flash

Artificial Analysis determined that Kimi K3.1 consumes 14% more tokens per task than Kimi K3

Removing molecular structure data from language model context causes agent decision quality to degrade on chemical exploration tasks

On the Artificial Analysis Cyber Index, Kimi K3.1 scored five percentage points lower than the Daybreak Blue partner program version of GPT6 SOL

Moonshot priced Kimi K3.1 at the same per-token rate as Sonnet 5.5 and GPT6 SOL

Moonshot instructed influencers to promote Kimi K3.1 as matching Opus 5.5 performance at one-fifth the cost

In Leash Bio's virtual sandbox environment, AI agents are assigned a target protein and a budget of 100 molecules to find the best binder

Moonshot's open-weight Kimi K3 model had 2.8 trillion parameters upon its July release

DeepSeek V41 Flash and GLM 5.3 scored in the low 40s on the Terminalbench 4.0 benchmark

In independent evaluations by Artificial Analysis, Kimi K3.1 scored 55 on the Intelligence Index, ranking fourth behind Opus 5.5, Sonnet 5.5, and Muse