DeepSeek V4 Flash 0731: Price, Context, Benchmarks, and Release Details
61.0
SI Score (method si-v2-absolute-shrinkage-1)
#56 of 115 ranked
69% confidence 69 percent, Medium confidence — 4 of 7 expected sources in
Coverage 55% of expected source weight · 100% confidence at 80% coverage
Pillar breakdown
Coding (weight 40 percent) 59.7
Math (weight 15 percent) 71.3
Preference (weight 15 percent) —
Reasoning (weight 30 percent) 82.9
Pillar weights: reasoning 30% · math 15% · coding 40% · preference 15%. Benchmark results use fixed 0–100 scales before averaging; incomplete evidence is shrunk toward 50.
Facts
- Input price / 1M
- not yet reported
- Output price / 1M
- not yet reported
- Context window
- 1Mmodels.devPublished source fact
Retrieved Oct 8, 2026 · MIT
Open source ↗ - Max output
- 384Kmodels.devPublished source fact
Retrieved Oct 8, 2026 · MIT
Open source ↗ - Released
- Jul 31, 2026models.devPublished source fact
Retrieved Oct 8, 2026 · MIT
Open source ↗ - Open weights
- YesHugging Face HubPublic Hub repo with weight files; gating/repo upload date is not release date
Retrieved Oct 8, 2026 · factual metadata; model-specific licenses
Open source ↗ - License
- mitHugging Face HubPublished source fact
Retrieved Oct 8, 2026 · factual metadata; model-specific licenses
Open source ↗ - Input modalities
- textmodels.devPublished source fact
Retrieved Oct 8, 2026 · MIT
Open source ↗ - Popularity rank
- #8 by usageOpenRouter rankingsPublished source fact; tokens processed; page default period; excludes catalog and endpoint statistics
Retrieved Oct 8, 2026 · CC-BY-4.0
Open source ↗
Benchmark results
33 results| Benchmark | Raw result | Normalized (0–100) | Pillar |
|---|---|---|---|
| arc agi v1 public eval | 92.5%ARC PrizeARC Prize steward-published result; exact edition/subset; publication time is HTTP Last-Modified of the aggregate export, not the evaluation date. Evaluation conducted with 'high' reasoning effort. [variant] deepseek-v4-flash-0731-highPublished Oct 6, 2026
Retrieved Oct 8, 2026 · factual citation Open source ↗ | 92.5 | reasoning |
| arc agi v1 public eval | 93%ARC PrizeARC Prize steward-published result; exact edition/subset; publication time is HTTP Last-Modified of the aggregate export, not the evaluation date. Evaluation conducted with 'low' reasoning effort. [variant] deepseek-v4-flash-0731-lowPublished Oct 6, 2026
Retrieved Oct 8, 2026 · factual citation Open source ↗ | 93.0 | reasoning |
| arc agi v1 public eval | 94.8%ARC PrizeARC Prize steward-published result; exact edition/subset; publication time is HTTP Last-Modified of the aggregate export, not the evaluation date. Evaluation conducted with 'max' reasoning effort. [variant] deepseek-v4-flash-0731-maxPublished Oct 6, 2026
Retrieved Oct 8, 2026 · factual citation Open source ↗ | 94.8 | reasoning |
| arc agi v1 semi private | 87%ARC PrizeARC Prize steward-published result; exact edition/subset; publication time is HTTP Last-Modified of the aggregate export, not the evaluation date. Evaluation conducted with 'high' reasoning effort. [variant] deepseek-v4-flash-0731-highPublished Oct 6, 2026
Retrieved Oct 8, 2026 · factual citation Open source ↗ | 87.0 | reasoning |
| arc agi v1 semi private | 84%ARC PrizeARC Prize steward-published result; exact edition/subset; publication time is HTTP Last-Modified of the aggregate export, not the evaluation date. Evaluation conducted with 'low' reasoning effort. [variant] deepseek-v4-flash-0731-lowPublished Oct 6, 2026
Retrieved Oct 8, 2026 · factual citation Open source ↗ | 84.0 | reasoning |
| arc agi v1 semi private | 89%ARC PrizeARC Prize steward-published result; exact edition/subset; publication time is HTTP Last-Modified of the aggregate export, not the evaluation date. Evaluation conducted with 'max' reasoning effort. [variant] deepseek-v4-flash-0731-maxPublished Oct 6, 2026
Retrieved Oct 8, 2026 · factual citation Open source ↗ | 89.0 | reasoning |
| arc agi v2 public eval | 59.9%ARC PrizeARC Prize steward-published result; exact edition/subset; publication time is HTTP Last-Modified of the aggregate export, not the evaluation date. Evaluation conducted with 'high' reasoning effort. [variant] deepseek-v4-flash-0731-highPublished Oct 6, 2026
Retrieved Oct 8, 2026 · factual citation Open source ↗ | 59.9 | reasoning |
| arc agi v2 public eval | 47.4%ARC PrizeARC Prize steward-published result; exact edition/subset; publication time is HTTP Last-Modified of the aggregate export, not the evaluation date. Evaluation conducted with 'low' reasoning effort. [variant] deepseek-v4-flash-0731-lowPublished Oct 6, 2026
Retrieved Oct 8, 2026 · factual citation Open source ↗ | 47.4 | reasoning |
| arc agi v2 public eval | 63.9%ARC PrizeARC Prize steward-published result; exact edition/subset; publication time is HTTP Last-Modified of the aggregate export, not the evaluation date. Evaluation conducted with 'max' reasoning effort. [variant] deepseek-v4-flash-0731-maxPublished Oct 6, 2026
Retrieved Oct 8, 2026 · factual citation Open source ↗ | 63.9 | reasoning |
| arc agi v2 semi private | 56.0%ARC PrizeARC Prize steward-published result; exact edition/subset; publication time is HTTP Last-Modified of the aggregate export, not the evaluation date. Evaluation conducted with 'high' reasoning effort. [variant] deepseek-v4-flash-0731-highPublished Oct 6, 2026
Retrieved Oct 8, 2026 · factual citation Open source ↗ | 56.0 | reasoning |
| arc agi v2 semi private | 46.0%ARC PrizeARC Prize steward-published result; exact edition/subset; publication time is HTTP Last-Modified of the aggregate export, not the evaluation date. Evaluation conducted with 'low' reasoning effort. [variant] deepseek-v4-flash-0731-lowPublished Oct 6, 2026
Retrieved Oct 8, 2026 · factual citation Open source ↗ | 46.0 | reasoning |
| arc agi v2 semi private | 61.4%ARC PrizeARC Prize steward-published result; exact edition/subset; publication time is HTTP Last-Modified of the aggregate export, not the evaluation date. Evaluation conducted with 'max' reasoning effort. [variant] deepseek-v4-flash-0731-maxPublished Oct 6, 2026
Retrieved Oct 8, 2026 · factual citation Open source ↗ | 61.4 | reasoning |
| frontiermath tier 4 v2 | 24.4%Epoch AI BenchmarkingEpoch-owned evaluation mean score; scores only, no benchmark questions [variant] maxPublished Aug 2, 2026
Retrieved Oct 8, 2026 · CC-BY Open source ↗ | 24.4 | math |
| frontiermath tiers 1 3 v2 | 57.5%Epoch AI BenchmarkingEpoch-owned evaluation mean score; scores only, no benchmark questions [variant] maxPublished Aug 2, 2026
Retrieved Oct 8, 2026 · CC-BY Open source ↗ | 57.5 | math |
| gpqa diamond | 91.0%Epoch AI BenchmarkingEpoch-owned evaluation mean score; scores only, no benchmark questions [variant] maxPublished Aug 2, 2026
Retrieved Oct 8, 2026 · CC-BY Open source ↗ | 91.0 | reasoning |
| livebench coding code completion 2026_06_25 | 73.9%LiveBenchLiveBench subtask result; dataset edition 2026_06_25; publication time is HTTP Last-Modified of the score CSV, not the dataset edition or individual evaluation date [variant] 2026_06_25Published Oct 7, 2026
Retrieved Oct 8, 2026 · factual citation; Apache-2.0 code Open source ↗ | 73.9 | coding |
| livebench coding code generation 2026_06_25 | 76.1%LiveBenchLiveBench subtask result; dataset edition 2026_06_25; publication time is HTTP Last-Modified of the score CSV, not the dataset edition or individual evaluation date [variant] 2026_06_25Published Oct 7, 2026
Retrieved Oct 8, 2026 · factual citation; Apache-2.0 code Open source ↗ | 76.1 | coding |
| livebench coding javascript 2026_06_25 | 63.6%LiveBenchLiveBench subtask result; dataset edition 2026_06_25; publication time is HTTP Last-Modified of the score CSV, not the dataset edition or individual evaluation date [variant] 2026_06_25Published Oct 7, 2026
Retrieved Oct 8, 2026 · factual citation; Apache-2.0 code Open source ↗ | 63.6 | coding |
| livebench coding python 2026_06_25 | 50%LiveBenchLiveBench subtask result; dataset edition 2026_06_25; publication time is HTTP Last-Modified of the score CSV, not the dataset edition or individual evaluation date [variant] 2026_06_25Published Oct 7, 2026
Retrieved Oct 8, 2026 · factual citation; Apache-2.0 code Open source ↗ | 50.0 | coding |
| livebench coding typescript 2026_06_25 | 26.7%LiveBenchLiveBench subtask result; dataset edition 2026_06_25; publication time is HTTP Last-Modified of the score CSV, not the dataset edition or individual evaluation date [variant] 2026_06_25Published Oct 7, 2026
Retrieved Oct 8, 2026 · factual citation; Apache-2.0 code Open source ↗ | 26.7 | coding |
| livebench math amps hard 2026_06_25 | 97%LiveBenchLiveBench subtask result; dataset edition 2026_06_25; publication time is HTTP Last-Modified of the score CSV, not the dataset edition or individual evaluation date [variant] 2026_06_25Published Oct 7, 2026
Retrieved Oct 8, 2026 · factual citation; Apache-2.0 code Open source ↗ | 97.0 | math |
| livebench math integrals with game 2026_06_25 | 65%LiveBenchLiveBench subtask result; dataset edition 2026_06_25; publication time is HTTP Last-Modified of the score CSV, not the dataset edition or individual evaluation date [variant] 2026_06_25Published Oct 7, 2026
Retrieved Oct 8, 2026 · factual citation; Apache-2.0 code Open source ↗ | 65.0 | math |
| livebench math math comp 2026_06_25 | 96.1%LiveBenchLiveBench subtask result; dataset edition 2026_06_25; publication time is HTTP Last-Modified of the score CSV, not the dataset edition or individual evaluation date [variant] 2026_06_25Published Oct 7, 2026
Retrieved Oct 8, 2026 · factual citation; Apache-2.0 code Open source ↗ | 96.1 | math |
| livebench math olympiad 2026_06_25 | 89.1%LiveBenchLiveBench subtask result; dataset edition 2026_06_25; publication time is HTTP Last-Modified of the score CSV, not the dataset edition or individual evaluation date [variant] 2026_06_25Published Oct 7, 2026
Retrieved Oct 8, 2026 · factual citation; Apache-2.0 code Open source ↗ | 89.1 | math |
| livebench math simplify 2026_06_25 | 58.4%LiveBenchLiveBench subtask result; dataset edition 2026_06_25; publication time is HTTP Last-Modified of the score CSV, not the dataset edition or individual evaluation date [variant] 2026_06_25Published Oct 7, 2026
Retrieved Oct 8, 2026 · factual citation; Apache-2.0 code Open source ↗ | 58.4 | math |
| livebench reasoning connections 2026_06_25 | 97.3%LiveBenchLiveBench subtask result; dataset edition 2026_06_25; publication time is HTTP Last-Modified of the score CSV, not the dataset edition or individual evaluation date [variant] 2026_06_25Published Oct 7, 2026
Retrieved Oct 8, 2026 · factual citation; Apache-2.0 code Open source ↗ | 97.3 | reasoning |
| livebench reasoning consecutive events 2026_06_25 | 89.4%LiveBenchLiveBench subtask result; dataset edition 2026_06_25; publication time is HTTP Last-Modified of the score CSV, not the dataset edition or individual evaluation date [variant] 2026_06_25Published Oct 7, 2026
Retrieved Oct 8, 2026 · factual citation; Apache-2.0 code Open source ↗ | 89.4 | reasoning |
| livebench reasoning logic with navigation 2026_06_25 | 70%LiveBenchLiveBench subtask result; dataset edition 2026_06_25; publication time is HTTP Last-Modified of the score CSV, not the dataset edition or individual evaluation date [variant] 2026_06_25Published Oct 7, 2026
Retrieved Oct 8, 2026 · factual citation; Apache-2.0 code Open source ↗ | 70.0 | reasoning |
| livebench reasoning spatial 2026_06_25 | 90%LiveBenchLiveBench subtask result; dataset edition 2026_06_25; publication time is HTTP Last-Modified of the score CSV, not the dataset edition or individual evaluation date [variant] 2026_06_25Published Oct 7, 2026
Retrieved Oct 8, 2026 · factual citation; Apache-2.0 code Open source ↗ | 90.0 | reasoning |
| livebench reasoning theory of mind 2026_06_25 | 86.5%LiveBenchLiveBench subtask result; dataset edition 2026_06_25; publication time is HTTP Last-Modified of the score CSV, not the dataset edition or individual evaluation date [variant] 2026_06_25Published Oct 7, 2026
Retrieved Oct 8, 2026 · factual citation; Apache-2.0 code Open source ↗ | 86.5 | reasoning |
| livebench reasoning zebra puzzle 2026_06_25 | 100%LiveBenchLiveBench subtask result; dataset edition 2026_06_25; publication time is HTTP Last-Modified of the score CSV, not the dataset edition or individual evaluation date [variant] 2026_06_25Published Oct 7, 2026
Retrieved Oct 8, 2026 · factual citation; Apache-2.0 code Open source ↗ | 100.0 | reasoning |
| otis mock aime 2024 2025 | 94.4%Epoch AI BenchmarkingEpoch-owned evaluation mean score; scores only, no benchmark questions [variant] maxPublished Aug 2, 2026
Retrieved Oct 8, 2026 · CC-BY Open source ↗ | 94.4 | math |
| terminal bench v2 1 | 82.7%Official model cards via models.devLab-reported; metric pass@1; transcribed by MIT models.dev catalog; not independently evaluated [variant] max; 2.1
Retrieved Oct 8, 2026 · factual citation; MIT transcription Open source ↗ | 82.7 | coding |
Normalization uses fixed absolute 0–100 scales for each unit, independently of other models that have a result on each benchmark. Coverage and evidence breadth still affect the composite; compare the evaluation conditions before reading a small score gap as decisive. “lab-reported” marks the provider's own published figure.
Sources: in and pending
in Reported (4)
- ARC Prize · arrived Oct 8, 2026
- Epoch AI Benchmarking · arrived Oct 8, 2026
- Official model cards via models.dev · arrived Oct 8, 2026
- LiveBench · arrived Oct 8, 2026
pending Awaiting (3)
- Humanity’s Last Exam · carries 13% of expected weight
- LMArena / Arena · carries 25% of expected weight
- Terminal-Bench · carries 6% of expected weight
The confidence % rises as pending sources publish. Some sources never cover some models — that is why 100% confidence arrives at 80% of expected weight, not at full coverage.