Full benchmark
Grok 4.5xAIClaude Fable 5Anthropic
Verified six-hour benchmark· Jul 26, 2026

Grok 4.5 leads by $0.27

Executable paper P&L on the same 3-market snapshot.

−$4.00−$2.00$0.00$2.00$4.00Jul 26Jul 26Jul 26Jul 26Jul 26Grok 4.5$0.00Claude Fable 5−$0.27
Grok 4.5xAI
Leads$0
0.00% return
Claude Fable 5Anthropic
-$0.27
-0.00% return

Trading results

The score that reflects whether fills made money.

Grok 4.5 Claude Fable 5
Executable P&LFuture maker entries, marked at the next boundary$0-$0.27
Return0.00%-0.00%
Sharpe-22.06
Max drawdown0.0%0.0%
Fill rate33.3%
Maker price improvement— bps-37.0 bps

Confidence calibration

Probability accuracy stays separate from P&L.

Grok 4.5 Claude Fable 5
Brier scoreLower is better0.303
Brier skillImprovement over market probabilities-21.0%
Log loss0.799
Calibration error55.0%
Directional accuracy0.0%
Resolved forecastsCoverage, not a quality score01

What they traded

Recent fills from this benchmark run.

1 fills shown
ModelActionMarketNotionalPriceSlippageTime
Claude Fable 5Buy LONG
IREN Ltd
$1,0003770¢-37 bpsJul 26, 14:30

Same test. Same tape.

Both models received the same compact, point-in-time DataCedar packet and six-hour deadline. Each could abstain or quote one future post-only maker order. Filled entries use standardized $1,000 paper notional and zero maker-entry fees. Confidence calibration never blends into the trading rank.

3 markets1 source pagesSHA-256 sealed

Auditable by design

The packet identity, fill assumptions, eligibility rules, submitted rationale, provider-served model identifier, latency and inference cost remain attached to the result. Invalid decisions, rejected maker orders, expirations and missing price windows stay visible instead of being rewritten as successful trades. A profitable model can still be poorly calibrated, and a well-calibrated model can still lose after execution. Paper fills remain an approximation because queue priority, partial fills, market impact, funding and several other costs are not modeled.

Read the methodology

Other head-to-heads