Claude Fable 5.1 vs GPT-6 Astra

Claude Fable 5.1 by Anthropic · GPT-6 Astra by OpenAI · 28 shared benchmarks

Claude Fable 5.1

80.2

#1 · 100%

GPT-6 Astra

77.6

#3 · 100%

SI Score, rank and confidence side by side

Pillars — Claude Fable 5.1

Coding 69.8 / 64.8

Math 91.5 / 92.9

Preference 82.5 / 77.1

Reasoning 87.1 / 87.1

Right-hand value is GPT-6 Astra.

The basics

Attribute	Claude Fable 5.1	GPT-6 Astra
Input price / 1M	$10.00	$10.00
Output price / 1M	$50.00	$50.00
Context window	1M	1.1M
Released	Sep 1, 2026	Sep 3, 2026
Open weights	Closed	Closed

Shared benchmarks

28 in common

Only benchmarks both models have are compared. Raw values are in each benchmark's own unit; a direct comparison requires matching evaluation conditions. All reported source/variant rows are shown; no raw-result winner is assigned across unmatched harnesses. Sources and dates sit behind every dotted number.

Which should you choose?

What the data says — heuristics from the numbers above, not a verdict:

For coding, Claude Fable 5.1 leads by 5.0 normalized points.
For preference, Claude Fable 5.1 leads by 5.5 normalized points.
Confidence differs: Claude Fable 5.1 100% vs GPT-6 Astra 100% — pending sources can still move either score.

Benchmark	Claude Fable 5.1	GPT-6 Astra	Conditions
arc agi v1 public eval	97.6%ARC Prize steward-published result; exact edition/subset; publication time is HTTP Last-Modified of the aggregate export, not the evaluation date. Evaluation conducted with 'high' reasoning effort. [variant] anthropic-claude-fable-5-1-high 95.5%ARC Prize steward-published result; exact edition/subset; publication time is HTTP Last-Modified of the aggregate export, not the evaluation date. Evaluation conducted with 'low' reasoning effort. [variant] anthropic-claude-fable-5-1-low 99%ARC Prize steward-published result; exact edition/subset; publication time is HTTP Last-Modified of the aggregate export, not the evaluation date. Evaluation conducted with 'max' reasoning effort. [variant] anthropic-claude-fable-5-1-max 96.6%ARC Prize steward-published result; exact edition/subset; publication time is HTTP Last-Modified of the aggregate export, not the evaluation date. Evaluation conducted with 'medium' reasoning effort. [variant] anthropic-claude-fable-5-1-medium 98.8%ARC Prize steward-published result; exact edition/subset; publication time is HTTP Last-Modified of the aggregate export, not the evaluation date. Evaluation conducted with 'xhigh' reasoning effort. [variant] anthropic-claude-fable-5-1-xhigh	98.5%ARC Prize steward-published result; exact edition/subset; publication time is HTTP Last-Modified of the aggregate export, not the evaluation date. Evaluation conducted with 'high' reasoning effort. [variant] openai-gpt-6-astra-high 98.3%ARC Prize steward-published result; exact edition/subset; publication time is HTTP Last-Modified of the aggregate export, not the evaluation date. Evaluation conducted with 'low' reasoning effort. [variant] openai-gpt-6-astra-low 97.8%ARC Prize steward-published result; exact edition/subset; publication time is HTTP Last-Modified of the aggregate export, not the evaluation date. Evaluation conducted with 'max' reasoning effort. [variant] openai-gpt-6-astra-max 98.8%ARC Prize steward-published result; exact edition/subset; publication time is HTTP Last-Modified of the aggregate export, not the evaluation date. Evaluation conducted with 'medium' reasoning effort. [variant] openai-gpt-6-astra-medium 99%ARC Prize steward-published result; exact edition/subset; publication time is HTTP Last-Modified of the aggregate export, not the evaluation date. Evaluation conducted with 'xhigh' reasoning effort. [variant] openai-gpt-6-astra-xhigh	Check variant and harness
arc agi v1 semi private	96%ARC Prize steward-published result; exact edition/subset; publication time is HTTP Last-Modified of the aggregate export, not the evaluation date. Evaluation conducted with 'high' reasoning effort. [variant] anthropic-claude-fable-5-1-high 90%ARC Prize steward-published result; exact edition/subset; publication time is HTTP Last-Modified of the aggregate export, not the evaluation date. Evaluation conducted with 'low' reasoning effort. [variant] anthropic-claude-fable-5-1-low 97.5%ARC Prize steward-published result; exact edition/subset; publication time is HTTP Last-Modified of the aggregate export, not the evaluation date. Evaluation conducted with 'max' reasoning effort. [variant] anthropic-claude-fable-5-1-max 94.5%ARC Prize steward-published result; exact edition/subset; publication time is HTTP Last-Modified of the aggregate export, not the evaluation date. Evaluation conducted with 'medium' reasoning effort. [variant] anthropic-claude-fable-5-1-medium 96.5%ARC Prize steward-published result; exact edition/subset; publication time is HTTP Last-Modified of the aggregate export, not the evaluation date. Evaluation conducted with 'xhigh' reasoning effort. [variant] anthropic-claude-fable-5-1-xhigh	98.5%ARC Prize steward-published result; exact edition/subset; publication time is HTTP Last-Modified of the aggregate export, not the evaluation date. Evaluation conducted with 'high' reasoning effort. [variant] openai-gpt-6-astra-high 96.5%ARC Prize steward-published result; exact edition/subset; publication time is HTTP Last-Modified of the aggregate export, not the evaluation date. Evaluation conducted with 'low' reasoning effort. [variant] openai-gpt-6-astra-low 97.5%ARC Prize steward-published result; exact edition/subset; publication time is HTTP Last-Modified of the aggregate export, not the evaluation date. Evaluation conducted with 'max' reasoning effort. [variant] openai-gpt-6-astra-max 97.5%ARC Prize steward-published result; exact edition/subset; publication time is HTTP Last-Modified of the aggregate export, not the evaluation date. Evaluation conducted with 'medium' reasoning effort. [variant] openai-gpt-6-astra-medium 98.5%ARC Prize steward-published result; exact edition/subset; publication time is HTTP Last-Modified of the aggregate export, not the evaluation date. Evaluation conducted with 'xhigh' reasoning effort. [variant] openai-gpt-6-astra-xhigh	Check variant and harness
arc agi v2 public eval	94.7%ARC Prize steward-published result; exact edition/subset; publication time is HTTP Last-Modified of the aggregate export, not the evaluation date. Evaluation conducted with 'high' reasoning effort. [variant] anthropic-claude-fable-5-1-high 86.0%ARC Prize steward-published result; exact edition/subset; publication time is HTTP Last-Modified of the aggregate export, not the evaluation date. Evaluation conducted with 'low' reasoning effort. [variant] anthropic-claude-fable-5-1-low 98.3%ARC Prize steward-published result; exact edition/subset; publication time is HTTP Last-Modified of the aggregate export, not the evaluation date. Evaluation conducted with 'max' reasoning effort. [variant] anthropic-claude-fable-5-1-max 87.5%ARC Prize steward-published result; exact edition/subset; publication time is HTTP Last-Modified of the aggregate export, not the evaluation date. Evaluation conducted with 'medium' reasoning effort. [variant] anthropic-claude-fable-5-1-medium 99.2%ARC Prize steward-published result; exact edition/subset; publication time is HTTP Last-Modified of the aggregate export, not the evaluation date. Evaluation conducted with 'xhigh' reasoning effort. [variant] anthropic-claude-fable-5-1-xhigh	97.9%ARC Prize steward-published result; exact edition/subset; publication time is HTTP Last-Modified of the aggregate export, not the evaluation date. Evaluation conducted with 'high' reasoning effort. [variant] openai-gpt-6-astra-high 94.2%ARC Prize steward-published result; exact edition/subset; publication time is HTTP Last-Modified of the aggregate export, not the evaluation date. Evaluation conducted with 'low' reasoning effort. [variant] openai-gpt-6-astra-low 97.5%ARC Prize steward-published result; exact edition/subset; publication time is HTTP Last-Modified of the aggregate export, not the evaluation date. Evaluation conducted with 'max' reasoning effort. [variant] openai-gpt-6-astra-max 96.7%ARC Prize steward-published result; exact edition/subset; publication time is HTTP Last-Modified of the aggregate export, not the evaluation date. Evaluation conducted with 'medium' reasoning effort. [variant] openai-gpt-6-astra-medium 97.9%ARC Prize steward-published result; exact edition/subset; publication time is HTTP Last-Modified of the aggregate export, not the evaluation date. Evaluation conducted with 'xhigh' reasoning effort. [variant] openai-gpt-6-astra-xhigh	Check variant and harness
arc agi v2 semi private	88.8%ARC Prize steward-published result; exact edition/subset; publication time is HTTP Last-Modified of the aggregate export, not the evaluation date. Evaluation conducted with 'high' reasoning effort. [variant] anthropic-claude-fable-5-1-high 78.3%ARC Prize steward-published result; exact edition/subset; publication time is HTTP Last-Modified of the aggregate export, not the evaluation date. Evaluation conducted with 'low' reasoning effort. [variant] anthropic-claude-fable-5-1-low 90%ARC Prize steward-published result; exact edition/subset; publication time is HTTP Last-Modified of the aggregate export, not the evaluation date. Evaluation conducted with 'max' reasoning effort. [variant] anthropic-claude-fable-5-1-max 86.3%ARC Prize steward-published result; exact edition/subset; publication time is HTTP Last-Modified of the aggregate export, not the evaluation date. Evaluation conducted with 'medium' reasoning effort. [variant] anthropic-claude-fable-5-1-medium 90%ARC Prize steward-published result; exact edition/subset; publication time is HTTP Last-Modified of the aggregate export, not the evaluation date. Evaluation conducted with 'xhigh' reasoning effort. [variant] anthropic-claude-fable-5-1-xhigh	92.1%ARC Prize steward-published result; exact edition/subset; publication time is HTTP Last-Modified of the aggregate export, not the evaluation date. Evaluation conducted with 'high' reasoning effort. [variant] openai-gpt-6-astra-high 85.4%ARC Prize steward-published result; exact edition/subset; publication time is HTTP Last-Modified of the aggregate export, not the evaluation date. Evaluation conducted with 'low' reasoning effort. [variant] openai-gpt-6-astra-low 95%ARC Prize steward-published result; exact edition/subset; publication time is HTTP Last-Modified of the aggregate export, not the evaluation date. Evaluation conducted with 'max' reasoning effort. [variant] openai-gpt-6-astra-max 92.1%ARC Prize steward-published result; exact edition/subset; publication time is HTTP Last-Modified of the aggregate export, not the evaluation date. Evaluation conducted with 'medium' reasoning effort. [variant] openai-gpt-6-astra-medium 93.3%ARC Prize steward-published result; exact edition/subset; publication time is HTTP Last-Modified of the aggregate export, not the evaluation date. Evaluation conducted with 'xhigh' reasoning effort. [variant] openai-gpt-6-astra-xhigh	Check variant and harness
frontiermath tier 4 v2	87.8%Epoch-owned evaluation mean score; scores only, no benchmark questions [variant] max	97.6%Epoch-owned evaluation mean score; scores only, no benchmark questions [variant] high 87.8%Epoch-owned evaluation mean score; scores only, no benchmark questions [variant] low 97.6%Epoch-owned evaluation mean score; scores only, no benchmark questions [variant] max 97.6%Epoch-owned evaluation mean score; scores only, no benchmark questions [variant] medium 82.9%Epoch-owned evaluation mean score; scores only, no benchmark questions [variant] none 97.6%Epoch-owned evaluation mean score; scores only, no benchmark questions [variant] xhigh	Check variant and harness
frontiermath tiers 1 3 v2	90.2%Epoch-owned evaluation mean score; scores only, no benchmark questions [variant] max	93.7%Epoch-owned evaluation mean score; scores only, no benchmark questions [variant] max	Check variant and harness
hle scale	46.5%Potential contamination warning: This model was evaluated after the public release of HLE, allowing model builder access to the prompts and solutions. [variant]	54.8%Potential contamination warning: This model was evaluated after the public release of HLE, allowing model builder access to the prompts and solutions. [variant]	Check variant and harness
hle tools	65%Lab-reported; metric score; transcribed by MIT models.dev catalog; not independently evaluated [variant] with tools; production safeguards with fallback	57.2%Lab-reported; metric accuracy; transcribed by MIT models.dev catalog; not independently evaluated [variant] with tools	Check variant and harness
livebench coding code completion 2026_06_25	82.6%LiveBench subtask result; dataset edition 2026_06_25; publication time is HTTP Last-Modified of the score CSV, not the dataset edition or individual evaluation date [variant] 2026_06_25	80.4%LiveBench subtask result; dataset edition 2026_06_25; publication time is HTTP Last-Modified of the score CSV, not the dataset edition or individual evaluation date [variant] 2026_06_25	Check variant and harness
livebench coding code generation 2026_06_25	90.1%LiveBench subtask result; dataset edition 2026_06_25; publication time is HTTP Last-Modified of the score CSV, not the dataset edition or individual evaluation date [variant] 2026_06_25	80.3%LiveBench subtask result; dataset edition 2026_06_25; publication time is HTTP Last-Modified of the score CSV, not the dataset edition or individual evaluation date [variant] 2026_06_25	Check variant and harness
livebench coding javascript 2026_06_25	68.2%LiveBench subtask result; dataset edition 2026_06_25; publication time is HTTP Last-Modified of the score CSV, not the dataset edition or individual evaluation date [variant] 2026_06_25	63.6%LiveBench subtask result; dataset edition 2026_06_25; publication time is HTTP Last-Modified of the score CSV, not the dataset edition or individual evaluation date [variant] 2026_06_25	Check variant and harness
livebench coding python 2026_06_25	70%LiveBench subtask result; dataset edition 2026_06_25; publication time is HTTP Last-Modified of the score CSV, not the dataset edition or individual evaluation date [variant] 2026_06_25	65%LiveBench subtask result; dataset edition 2026_06_25; publication time is HTTP Last-Modified of the score CSV, not the dataset edition or individual evaluation date [variant] 2026_06_25	Check variant and harness
livebench coding typescript 2026_06_25	60%LiveBench subtask result; dataset edition 2026_06_25; publication time is HTTP Last-Modified of the score CSV, not the dataset edition or individual evaluation date [variant] 2026_06_25	43.3%LiveBench subtask result; dataset edition 2026_06_25; publication time is HTTP Last-Modified of the score CSV, not the dataset edition or individual evaluation date [variant] 2026_06_25	Check variant and harness
livebench math amps hard 2026_06_25	99%LiveBench subtask result; dataset edition 2026_06_25; publication time is HTTP Last-Modified of the score CSV, not the dataset edition or individual evaluation date [variant] 2026_06_25	98%LiveBench subtask result; dataset edition 2026_06_25; publication time is HTTP Last-Modified of the score CSV, not the dataset edition or individual evaluation date [variant] 2026_06_25	Check variant and harness
livebench math integrals with game 2026_06_25	99%LiveBench subtask result; dataset edition 2026_06_25; publication time is HTTP Last-Modified of the score CSV, not the dataset edition or individual evaluation date [variant] 2026_06_25	100%LiveBench subtask result; dataset edition 2026_06_25; publication time is HTTP Last-Modified of the score CSV, not the dataset edition or individual evaluation date [variant] 2026_06_25	Check variant and harness
livebench math math comp 2026_06_25	97.1%LiveBench subtask result; dataset edition 2026_06_25; publication time is HTTP Last-Modified of the score CSV, not the dataset edition or individual evaluation date [variant] 2026_06_25	97.1%LiveBench subtask result; dataset edition 2026_06_25; publication time is HTTP Last-Modified of the score CSV, not the dataset edition or individual evaluation date [variant] 2026_06_25	Check variant and harness
livebench math olympiad 2026_06_25	93.0%LiveBench subtask result; dataset edition 2026_06_25; publication time is HTTP Last-Modified of the score CSV, not the dataset edition or individual evaluation date [variant] 2026_06_25	92.2%LiveBench subtask result; dataset edition 2026_06_25; publication time is HTTP Last-Modified of the score CSV, not the dataset edition or individual evaluation date [variant] 2026_06_25	Check variant and harness
livebench math simplify 2026_06_25	70.2%LiveBench subtask result; dataset edition 2026_06_25; publication time is HTTP Last-Modified of the score CSV, not the dataset edition or individual evaluation date [variant] 2026_06_25	70.5%LiveBench subtask result; dataset edition 2026_06_25; publication time is HTTP Last-Modified of the score CSV, not the dataset edition or individual evaluation date [variant] 2026_06_25	Check variant and harness
livebench reasoning connections 2026_06_25	99.3%LiveBench subtask result; dataset edition 2026_06_25; publication time is HTTP Last-Modified of the score CSV, not the dataset edition or individual evaluation date [variant] 2026_06_25	100%LiveBench subtask result; dataset edition 2026_06_25; publication time is HTTP Last-Modified of the score CSV, not the dataset edition or individual evaluation date [variant] 2026_06_25	Check variant and harness
livebench reasoning consecutive events 2026_06_25	90.6%LiveBench subtask result; dataset edition 2026_06_25; publication time is HTTP Last-Modified of the score CSV, not the dataset edition or individual evaluation date [variant] 2026_06_25	90.6%LiveBench subtask result; dataset edition 2026_06_25; publication time is HTTP Last-Modified of the score CSV, not the dataset edition or individual evaluation date [variant] 2026_06_25	Check variant and harness
livebench reasoning logic with navigation 2026_06_25	86%LiveBench subtask result; dataset edition 2026_06_25; publication time is HTTP Last-Modified of the score CSV, not the dataset edition or individual evaluation date [variant] 2026_06_25	88%LiveBench subtask result; dataset edition 2026_06_25; publication time is HTTP Last-Modified of the score CSV, not the dataset edition or individual evaluation date [variant] 2026_06_25	Check variant and harness
livebench reasoning spatial 2026_06_25	100%LiveBench subtask result; dataset edition 2026_06_25; publication time is HTTP Last-Modified of the score CSV, not the dataset edition or individual evaluation date [variant] 2026_06_25	98%LiveBench subtask result; dataset edition 2026_06_25; publication time is HTTP Last-Modified of the score CSV, not the dataset edition or individual evaluation date [variant] 2026_06_25	Check variant and harness
livebench reasoning theory of mind 2026_06_25	80.8%LiveBench subtask result; dataset edition 2026_06_25; publication time is HTTP Last-Modified of the score CSV, not the dataset edition or individual evaluation date [variant] 2026_06_25	84.6%LiveBench subtask result; dataset edition 2026_06_25; publication time is HTTP Last-Modified of the score CSV, not the dataset edition or individual evaluation date [variant] 2026_06_25	Check variant and harness
livebench reasoning zebra puzzle 2026_06_25	100%LiveBench subtask result; dataset edition 2026_06_25; publication time is HTTP Last-Modified of the score CSV, not the dataset edition or individual evaluation date [variant] 2026_06_25	100%LiveBench subtask result; dataset edition 2026_06_25; publication time is HTTP Last-Modified of the score CSV, not the dataset edition or individual evaluation date [variant] 2026_06_25	Check variant and harness
lmarena text	1510.6 eloPublished source fact [variant] text / overall	1442.3 eloPublished source fact [variant] text / overall	Check variant and harness
otis mock aime 2024 2025	100%Epoch-owned evaluation mean score; scores only, no benchmark questions [variant] max	100%Epoch-owned evaluation mean score; scores only, no benchmark questions [variant] max	Check variant and harness
terminal bench v0 1	52.6%Lab-reported; metric score; transcribed by MIT models.dev catalog; not independently evaluated [variant] production safeguards with fallback; 0.1	64.6%Lab-reported; metric success rate; transcribed by MIT models.dev catalog; not independently evaluated [variant] 0.1	Check variant and harness
terminal bench v4 0	55.8%Lab-reported; metric score; transcribed by MIT models.dev catalog; not independently evaluated [variant] production safeguards with fallback; 4.0 54.5%Terminal-Bench 4.0; published harness submission, 95% CI retained at source [variant] Claude Code; high 43.3%Terminal-Bench 4.0; published harness submission, 95% CI retained at source [variant] Claude Code; low 57.9%Terminal-Bench 4.0; published harness submission, 95% CI retained at source [variant] Claude Code; max 53.9%Terminal-Bench 4.0; published harness submission, 95% CI retained at source [variant] Claude Code; medium 57.9%Terminal-Bench 4.0; published harness submission, 95% CI retained at source [variant] Claude Code; xhigh	57.9%Lab-reported; metric success rate; transcribed by MIT models.dev catalog; not independently evaluated [variant] 4.0 57.9%Terminal-Bench 4.0; published harness submission, 95% CI retained at source [variant] Codex; high 50.6%Terminal-Bench 4.0; published harness submission, 95% CI retained at source [variant] Codex; low 58.2%Terminal-Bench 4.0; published harness submission, 95% CI retained at source [variant] Codex; max 54.2%Terminal-Bench 4.0; published harness submission, 95% CI retained at source [variant] Codex; medium 57.9%Terminal-Bench 4.0; published harness submission, 95% CI retained at source [variant] Codex; xhigh	Check variant and harness