Claude Opus 4: Price, Context, Benchmarks, and Release Details
54.8
SI Score (method si-v2-absolute-shrinkage-1)
#78 of 115 ranked
96% confidence 96 percent, High confidence — 4 of 7 expected sources in
Coverage 76% of expected source weight · 100% confidence at 80% coverage
Pillar breakdown
Coding (weight 40 percent) 71.1
Math (weight 15 percent) 70.8
Preference (weight 15 percent) 69.6
Reasoning (weight 30 percent) 22.6
Pillar weights: reasoning 30% · math 15% · coding 40% · preference 15%. Benchmark results use fixed 0–100 scales before averaging; incomplete evidence is shrunk toward 50.
Facts
- Input price / 1M
- not yet reported
- Output price / 1M
- not yet reported
- Context window
- 200Kmodels.devPublished source fact
Retrieved Oct 8, 2026 · MIT
Open source ↗ - Max output
- 32Kmodels.devPublished source fact
Retrieved Oct 8, 2026 · MIT
Open source ↗ - Released
- May 22, 2025models.devPublished source fact
Retrieved Oct 8, 2026 · MIT
Open source ↗ - Open weights
- Nomodels.devPublished source fact
Retrieved Oct 8, 2026 · MIT
Open source ↗ - License
- not yet reported
- Input modalities
- text, image, pdfmodels.devPublished source fact
Retrieved Oct 8, 2026 · MIT
Open source ↗
Benchmark results
23 results| Benchmark | Raw result | Normalized (0–100) | Pillar |
|---|---|---|---|
| aider polyglot | 72%Aider polyglotPublished source fact [variant] Aider polyglot; 225 cases; 2 attemptsPublished May 25, 2025
Retrieved Oct 8, 2026 · Apache-2.0 Open source ↗ | 72.0 | coding |
| arc agi v1 public eval | 35.5%ARC PrizeARC Prize steward-published result; exact edition/subset; publication time is HTTP Last-Modified of the aggregate export, not the evaluation date. [variant] claude-opus-4-20250514Published Oct 6, 2026
Retrieved Oct 8, 2026 · factual citation Open source ↗ | 35.5 | reasoning |
| arc agi v1 public eval | 54.3%ARC PrizeARC Prize steward-published result; exact edition/subset; publication time is HTTP Last-Modified of the aggregate export, not the evaluation date. [variant] claude-opus-4-20250514-thinking-16kPublished Oct 6, 2026
Retrieved Oct 8, 2026 · factual citation Open source ↗ | 54.3 | reasoning |
| arc agi v1 public eval | 43.3%ARC PrizeARC Prize steward-published result; exact edition/subset; publication time is HTTP Last-Modified of the aggregate export, not the evaluation date. [variant] claude-opus-4-20250514-thinking-1kPublished Oct 6, 2026
Retrieved Oct 8, 2026 · factual citation Open source ↗ | 43.3 | reasoning |
| arc agi v1 public eval | 45.6%ARC PrizeARC Prize steward-published result; exact edition/subset; publication time is HTTP Last-Modified of the aggregate export, not the evaluation date. [variant] claude-opus-4-20250514-thinking-8kPublished Oct 6, 2026
Retrieved Oct 8, 2026 · factual citation Open source ↗ | 45.6 | reasoning |
| arc agi v1 semi private | 22.5%ARC PrizeARC Prize steward-published result; exact edition/subset; publication time is HTTP Last-Modified of the aggregate export, not the evaluation date. [variant] claude-opus-4-20250514Published Oct 6, 2026
Retrieved Oct 8, 2026 · factual citation Open source ↗ | 22.5 | reasoning |
| arc agi v1 semi private | 35.7%ARC PrizeARC Prize steward-published result; exact edition/subset; publication time is HTTP Last-Modified of the aggregate export, not the evaluation date. [variant] claude-opus-4-20250514-thinking-16kPublished Oct 6, 2026
Retrieved Oct 8, 2026 · factual citation Open source ↗ | 35.7 | reasoning |
| arc agi v1 semi private | 27%ARC PrizeARC Prize steward-published result; exact edition/subset; publication time is HTTP Last-Modified of the aggregate export, not the evaluation date. [variant] claude-opus-4-20250514-thinking-1kPublished Oct 6, 2026
Retrieved Oct 8, 2026 · factual citation Open source ↗ | 27.0 | reasoning |
| arc agi v1 semi private | 30.7%ARC PrizeARC Prize steward-published result; exact edition/subset; publication time is HTTP Last-Modified of the aggregate export, not the evaluation date. [variant] claude-opus-4-20250514-thinking-8kPublished Oct 6, 2026
Retrieved Oct 8, 2026 · factual citation Open source ↗ | 30.7 | reasoning |
| arc agi v2 public eval | 1.3%ARC PrizeARC Prize steward-published result; exact edition/subset; publication time is HTTP Last-Modified of the aggregate export, not the evaluation date. [variant] claude-opus-4-20250514Published Oct 6, 2026
Retrieved Oct 8, 2026 · factual citation Open source ↗ | 1.3 | reasoning |
| arc agi v2 public eval | 3.3%ARC PrizeARC Prize steward-published result; exact edition/subset; publication time is HTTP Last-Modified of the aggregate export, not the evaluation date. [variant] claude-opus-4-20250514-thinking-16kPublished Oct 6, 2026
Retrieved Oct 8, 2026 · factual citation Open source ↗ | 3.3 | reasoning |
| arc agi v2 public eval | 0.4%ARC PrizeARC Prize steward-published result; exact edition/subset; publication time is HTTP Last-Modified of the aggregate export, not the evaluation date. [variant] claude-opus-4-20250514-thinking-1kPublished Oct 6, 2026
Retrieved Oct 8, 2026 · factual citation Open source ↗ | 0.4 | reasoning |
| arc agi v2 public eval | 2.5%ARC PrizeARC Prize steward-published result; exact edition/subset; publication time is HTTP Last-Modified of the aggregate export, not the evaluation date. [variant] claude-opus-4-20250514-thinking-8kPublished Oct 6, 2026
Retrieved Oct 8, 2026 · factual citation Open source ↗ | 2.5 | reasoning |
| arc agi v2 semi private | 1.3%ARC PrizeARC Prize steward-published result; exact edition/subset; publication time is HTTP Last-Modified of the aggregate export, not the evaluation date. [variant] claude-opus-4-20250514Published Oct 6, 2026
Retrieved Oct 8, 2026 · factual citation Open source ↗ | 1.3 | reasoning |
| arc agi v2 semi private | 8.6%ARC PrizeARC Prize steward-published result; exact edition/subset; publication time is HTTP Last-Modified of the aggregate export, not the evaluation date. [variant] claude-opus-4-20250514-thinking-16kPublished Oct 6, 2026
Retrieved Oct 8, 2026 · factual citation Open source ↗ | 8.6 | reasoning |
| arc agi v2 semi private | 0%ARC PrizeARC Prize steward-published result; exact edition/subset; publication time is HTTP Last-Modified of the aggregate export, not the evaluation date. [variant] claude-opus-4-20250514-thinking-1kPublished Oct 6, 2026
Retrieved Oct 8, 2026 · factual citation Open source ↗ | 0.0 | reasoning |
| arc agi v2 semi private | 4.5%ARC PrizeARC Prize steward-published result; exact edition/subset; publication time is HTTP Last-Modified of the aggregate export, not the evaluation date. [variant] claude-opus-4-20250514-thinking-8kPublished Oct 6, 2026
Retrieved Oct 8, 2026 · factual citation Open source ↗ | 4.5 | reasoning |
| gpqa diamond | 69.2%Epoch AI BenchmarkingEpoch-owned evaluation mean score; scores only, no benchmark questions [variant] Published May 22, 2025
Retrieved Oct 8, 2026 · CC-BY Open source ↗ | 69.2 | reasoning |
| hle scale | 10.7%Humanity’s Last ExamPotential contamination warning: This model was evaluated after the public release of HLE, allowing model builder access to the prompts and solutions. [variant] Published May 24, 2025
Retrieved Oct 8, 2026 · factual citation Open source ↗ | 10.7 | reasoning |
| lmarena text | 1365.7 eloLMArena / ArenaPublished source fact [variant] text / overallPublished Oct 2, 2026
Retrieved Oct 8, 2026 · CC-BY-4.0 Open source ↗ | 69.6 | preference |
| math level 5 | 85.0%Epoch AI BenchmarkingEpoch-owned evaluation mean score; scores only, no benchmark questions [variant] Published May 22, 2025
Retrieved Oct 8, 2026 · CC-BY Open source ↗ | 85.0 | math |
| otis mock aime 2024 2025 | 42.2%Epoch AI BenchmarkingEpoch-owned evaluation mean score; scores only, no benchmark questions [variant] Published May 22, 2025
Retrieved Oct 8, 2026 · CC-BY Open source ↗ | 42.2 | math |
| swe bench verified | 70.7%Epoch AI BenchmarkingEpoch-owned evaluation mean score; scores only, no benchmark questions [variant] Published Feb 6, 2026
Retrieved Oct 8, 2026 · CC-BY Open source ↗ | 70.7 | coding |
Normalization uses fixed absolute 0–100 scales for each unit, independently of other models that have a result on each benchmark. Coverage and evidence breadth still affect the composite; compare the evaluation conditions before reading a small score gap as decisive. “lab-reported” marks the provider's own published figure.
Sources: in and pending
in Reported (4)
- ARC Prize · arrived Oct 8, 2026
- Epoch AI Benchmarking · arrived Oct 8, 2026
- Humanity’s Last Exam · arrived Oct 8, 2026
- LMArena / Arena · arrived Oct 8, 2026
pending Awaiting (3)
- Official model cards via models.dev · carries 4% of expected weight
- LiveBench · carries 13% of expected weight
- Terminal-Bench · carries 6% of expected weight
The confidence % rises as pending sources publish. Some sources never cover some models — that is why 100% confidence arrives at 80% of expected weight, not at full coverage.