SI Index Data as of Oct 8, 2026

Qwen3.8 Max: Price, Context, Benchmarks, and Release Details

Alibaba / Qwen provisional listing · first seen Oct 8, 2026 · score computed Oct 8, 2026, 22:13 UTC
62.0
SI Score (method si-v2-absolute-shrinkage-1)
#49 of 115 ranked
53% confidence 53 percent, Medium confidence — 3 of 7 expected sources in
Coverage 43% of expected source weight · 100% confidence at 80% coverage

Pillar breakdown

Coding (weight 40 percent) 69.1
Math (weight 15 percent) 86.5
Preference (weight 15 percent) 80.4
Reasoning (weight 30 percent) 85.2

Pillar weights: reasoning 30% · math 15% · coding 40% · preference 15%. Benchmark results use fixed 0–100 scales before averaging; incomplete evidence is shrunk toward 50.

Facts

Input price / 1M
not yet reported
Output price / 1M
not yet reported
Context window
1Mmodels.devPublished source fact Retrieved Oct 8, 2026 · MIT
Open source ↗
Max output
131Kmodels.devPublished source fact Retrieved Oct 8, 2026 · MIT
Open source ↗
Released
Aug 3, 2026models.devPublished source fact Retrieved Oct 8, 2026 · MIT
Open source ↗
Open weights
Nomodels.devPublished source fact Retrieved Oct 8, 2026 · MIT
Open source ↗
License
not yet reported
Input modalities
text, image, video, pdfmodels.devPublished source fact Retrieved Oct 8, 2026 · MIT
Open source ↗

Benchmark results

22 results
Benchmark Raw result Normalized (0–100) Pillar
gpqa diamond 92.6%Official model cards via models.devLab-reported; metric score; transcribed by MIT models.dev catalog; not independently evaluated [variant] Retrieved Oct 8, 2026 · factual citation; MIT transcription
Open source ↗ 		92.6 reasoning
hle 43.6%Official model cards via models.devLab-reported; metric score; transcribed by MIT models.dev catalog; not independently evaluated [variant] without tools Retrieved Oct 8, 2026 · factual citation; MIT transcription
Open source ↗ 		43.6 reasoning
hle tools 56.2%Official model cards via models.devLab-reported; metric score; transcribed by MIT models.dev catalog; not independently evaluated [variant] with tools Retrieved Oct 8, 2026 · factual citation; MIT transcription
Open source ↗ 		56.2 reasoning
livebench coding code completion 2026_06_25 73.9%LiveBenchLiveBench subtask result; dataset edition 2026_06_25; publication time is HTTP Last-Modified of the score CSV, not the dataset edition or individual evaluation date [variant] 2026_06_25Published Oct 7, 2026 Retrieved Oct 8, 2026 · factual citation; Apache-2.0 code
Open source ↗ 		73.9 coding
livebench coding code generation 2026_06_25 71.8%LiveBenchLiveBench subtask result; dataset edition 2026_06_25; publication time is HTTP Last-Modified of the score CSV, not the dataset edition or individual evaluation date [variant] 2026_06_25Published Oct 7, 2026 Retrieved Oct 8, 2026 · factual citation; Apache-2.0 code
Open source ↗ 		71.8 coding
livebench coding javascript 2026_06_25 77.3%LiveBenchLiveBench subtask result; dataset edition 2026_06_25; publication time is HTTP Last-Modified of the score CSV, not the dataset edition or individual evaluation date [variant] 2026_06_25Published Oct 7, 2026 Retrieved Oct 8, 2026 · factual citation; Apache-2.0 code
Open source ↗ 		77.3 coding
livebench coding python 2026_06_25 60%LiveBenchLiveBench subtask result; dataset edition 2026_06_25; publication time is HTTP Last-Modified of the score CSV, not the dataset edition or individual evaluation date [variant] 2026_06_25Published Oct 7, 2026 Retrieved Oct 8, 2026 · factual citation; Apache-2.0 code
Open source ↗ 		60.0 coding
livebench coding typescript 2026_06_25 56.7%LiveBenchLiveBench subtask result; dataset edition 2026_06_25; publication time is HTTP Last-Modified of the score CSV, not the dataset edition or individual evaluation date [variant] 2026_06_25Published Oct 7, 2026 Retrieved Oct 8, 2026 · factual citation; Apache-2.0 code
Open source ↗ 		56.7 coding
livebench math amps hard 2026_06_25 98%LiveBenchLiveBench subtask result; dataset edition 2026_06_25; publication time is HTTP Last-Modified of the score CSV, not the dataset edition or individual evaluation date [variant] 2026_06_25Published Oct 7, 2026 Retrieved Oct 8, 2026 · factual citation; Apache-2.0 code
Open source ↗ 		98.0 math
livebench math integrals with game 2026_06_25 81%LiveBenchLiveBench subtask result; dataset edition 2026_06_25; publication time is HTTP Last-Modified of the score CSV, not the dataset edition or individual evaluation date [variant] 2026_06_25Published Oct 7, 2026 Retrieved Oct 8, 2026 · factual citation; Apache-2.0 code
Open source ↗ 		81.0 math
livebench math math comp 2026_06_25 95.1%LiveBenchLiveBench subtask result; dataset edition 2026_06_25; publication time is HTTP Last-Modified of the score CSV, not the dataset edition or individual evaluation date [variant] 2026_06_25Published Oct 7, 2026 Retrieved Oct 8, 2026 · factual citation; Apache-2.0 code
Open source ↗ 		95.1 math
livebench math olympiad 2026_06_25 91.2%LiveBenchLiveBench subtask result; dataset edition 2026_06_25; publication time is HTTP Last-Modified of the score CSV, not the dataset edition or individual evaluation date [variant] 2026_06_25Published Oct 7, 2026 Retrieved Oct 8, 2026 · factual citation; Apache-2.0 code
Open source ↗ 		91.2 math
livebench math simplify 2026_06_25 67.3%LiveBenchLiveBench subtask result; dataset edition 2026_06_25; publication time is HTTP Last-Modified of the score CSV, not the dataset edition or individual evaluation date [variant] 2026_06_25Published Oct 7, 2026 Retrieved Oct 8, 2026 · factual citation; Apache-2.0 code
Open source ↗ 		67.3 math
livebench reasoning connections 2026_06_25 94.5%LiveBenchLiveBench subtask result; dataset edition 2026_06_25; publication time is HTTP Last-Modified of the score CSV, not the dataset edition or individual evaluation date [variant] 2026_06_25Published Oct 7, 2026 Retrieved Oct 8, 2026 · factual citation; Apache-2.0 code
Open source ↗ 		94.5 reasoning
livebench reasoning consecutive events 2026_06_25 87.1%LiveBenchLiveBench subtask result; dataset edition 2026_06_25; publication time is HTTP Last-Modified of the score CSV, not the dataset edition or individual evaluation date [variant] 2026_06_25Published Oct 7, 2026 Retrieved Oct 8, 2026 · factual citation; Apache-2.0 code
Open source ↗ 		87.1 reasoning
livebench reasoning logic with navigation 2026_06_25 74%LiveBenchLiveBench subtask result; dataset edition 2026_06_25; publication time is HTTP Last-Modified of the score CSV, not the dataset edition or individual evaluation date [variant] 2026_06_25Published Oct 7, 2026 Retrieved Oct 8, 2026 · factual citation; Apache-2.0 code
Open source ↗ 		74.0 reasoning
livebench reasoning spatial 2026_06_25 100%LiveBenchLiveBench subtask result; dataset edition 2026_06_25; publication time is HTTP Last-Modified of the score CSV, not the dataset edition or individual evaluation date [variant] 2026_06_25Published Oct 7, 2026 Retrieved Oct 8, 2026 · factual citation; Apache-2.0 code
Open source ↗ 		100.0 reasoning
livebench reasoning theory of mind 2026_06_25 78.8%LiveBenchLiveBench subtask result; dataset edition 2026_06_25; publication time is HTTP Last-Modified of the score CSV, not the dataset edition or individual evaluation date [variant] 2026_06_25Published Oct 7, 2026 Retrieved Oct 8, 2026 · factual citation; Apache-2.0 code
Open source ↗ 		78.8 reasoning
livebench reasoning zebra puzzle 2026_06_25 100%LiveBenchLiveBench subtask result; dataset edition 2026_06_25; publication time is HTTP Last-Modified of the score CSV, not the dataset edition or individual evaluation date [variant] 2026_06_25Published Oct 7, 2026 Retrieved Oct 8, 2026 · factual citation; Apache-2.0 code
Open source ↗ 		100.0 reasoning
lmarena text 1481.8 eloLMArena / ArenaPublished source fact [variant] text / overallPublished Oct 2, 2026 Retrieved Oct 8, 2026 · CC-BY-4.0
Open source ↗ 		80.4 preference
swe bench pro qwen refined and corrected task set 67.7%Official model cards via models.devLab-reported; metric resolved; transcribed by MIT models.dev catalog; not independently evaluated [variant] Claude Code; Qwen refined and corrected task set Retrieved Oct 8, 2026 · factual citation; MIT transcription
Open source ↗ 		67.7 coding
terminal bench v2 1 86.6%Official model cards via models.devLab-reported; metric avg@10; transcribed by MIT models.dev catalog; not independently evaluated [variant] 5h timeout; Claude Code; 2.1 Retrieved Oct 8, 2026 · factual citation; MIT transcription
Open source ↗ 		86.6 coding

Normalization uses fixed absolute 0–100 scales for each unit, independently of other models that have a result on each benchmark. Coverage and evidence breadth still affect the composite; compare the evaluation conditions before reading a small score gap as decisive. “lab-reported” marks the provider's own published figure.

Sources: in and pending

in Reported (3)

  • Official model cards via models.dev · arrived Oct 8, 2026
  • LiveBench · arrived Oct 8, 2026
  • LMArena / Arena · arrived Oct 8, 2026

pending Awaiting (4)

  • ARC Prize · carries 13% of expected weight
  • Epoch AI Benchmarking · carries 25% of expected weight
  • Humanity’s Last Exam · carries 13% of expected weight
  • Terminal-Bench · carries 6% of expected weight

The confidence % rises as pending sources publish. Some sources never cover some models — that is why 100% confidence arrives at 80% of expected weight, not at full coverage.