#AI benchmarks

AI Models

Fable 5.1's “25% Cheaper” Is a Cache-Read Cut, Not a Token Cut

Anthropic's list price did not move: input stays at $10 per million tokens and output at $50. The entire saving comes from cache reads falling 75% to $0.25, which only materialises for workloads that reuse a prefix.

2d ago

AI Models

Alibaba's 2.4-Trillion-Parameter Model Launches As Closed API

Qwen3.8-Max went live Monday morning with a benchmark table showing wins over GPT-5.6 Sol and Claude Fable 5. The same table, read in full, shows it losing every hard agentic-engineering row.

Aug 3, 2026

AI Research

NIST Built a Testbed Where Model Developers Never See the Test Data

AI Technology Evaluation scores models on blind datasets that were never public, which is the only way to know a benchmark result was not memorised. It carries no regulatory force whatsoever.

Jul 28, 2026

AI Research

New Benchmark Finds AI Reading X-Rays Can Be Dangerously Confident When It's Wrong

RadLE 2.0 tested 16 frontier models on 200 X-ray cases with a scoring system that penalizes confident errors; human radiologists scored 988.7 out of 2,000 to the best AI's 758.

Jul 19, 2026

AI Research

'The Benchmark Race Is Not the Point': WAIC Executives Push to Rethink AI Evaluation

With standard leaderboards saturated and contaminated, Chinese AI leaders argued real-world task performance — and metrics like 'daily active agents' — should replace static benchmarks.

Jul 19, 2026