Editorial illustration for GPT-6 Astra vs Claude Fable 5.1 vs Gemini 3.8 Flash: Frontier Math, Coding, and Cost
AI analysis / Latest briefings
TerraNet Intelligence

GPT-6 Astra vs Claude Fable 5.1 vs Gemini 3.8 Flash: Frontier Math, Coding, and Cost

Updated with Gemini 3.8 Flash's FrontierMath scores and Artificial Analysis's revised index: GPT-6 Astra leads mathematics, Claude Fable 5.1 leads coding by modest margins, and Gemini 3.8 Flash matches Astra on DeepSWE at about half the cost per task.

By TerraNet Technologies5 min read18 sources
Editorial illustration for GPT-6 Astra vs Claude Fable 5.1 vs Gemini 3.8 Flash: Frontier Math, Coding, and Cost
GPT-6 Astra benchmarks
Claude Fable 5.1 comparison
Gemini 3.8 Flash evaluation
FrontierMath Tier 4 scores
DeepSWE cost per task

Watch

GPT-6 Astra vs Claude Fable 5.1 vs Gemini 3.8 Flash: Frontier Math, Coding, and Cost

Listen to this article

~5 min spoken. Keeps playing while you work in another tab.

Updated 28 September 2026. This comparison was first published on 5 September and has been rewritten with the current scores. Since then, Epoch AI has published Gemini 3.8 Flash's FrontierMath results, which were missing the first time, and Artificial Analysis has revised its Intelligence Index, moving all three models down. The charts are drawn from the data as it stands today.

Both labs have kept tiering their line-ups since. Our briefing of 22 September reported teams routing routine queries to open-weight models while reserving flagships such as Claude Fable 5.1 and GPT-6 Astra for hard reasoning 14, and our briefing of 23 September noted that Amazon Web Services added GPT-6 Sol and Claude Opus 5.5 to Amazon Bedrock 13.

Commentary has split between capability and cost. Ethan Mollick called GPT-6 Astra ascending in Nethack on its third attempt a startling achievement 6. Gemini 3.8 Flash sits apart from both flagships: listed at $1.50 per million tokens blended against $20.00 for the other two, it competes on price and speed rather than on frontier scores 3. Choosing between them means separating the enthusiasm from what the benchmarks measure.

Where the narrative and the numbers disagree

Bindu Reddy argues that Fable 5.1 is far stronger than Claude Opus 5.5 on complex codebases, and under-hyped only because of its price 10. Against the other two models here, the coding measures bear that out, by margins rather than a gulf. On Artificial Analysis's Coding Index, Claude Fable 5.1 at max scores 81.6, GPT-6 Astra at high 77.1 and Gemini 3.8 Flash at high 76.3 3. On Terminal-Bench 2.1 the order is the same and the gaps smaller: Fable 5.1 at 91.4%, Astra at 89.9% and Gemini 3.8 Flash at 87.6%.

GPT-6 Astra vs Claude Fable 5.1 vs Gemini 3.8 Flash across 7 benchmarksGPT-6 Astra vs Claude Fable 5.1 vs Gemini 3.8 Flash across 7 benchmarks.GPT-6 Astra vs Claude Fable 5.1 vs Gemini 3.8 Flash across 7benchmarksGPT-6 AstraClaude Fable 5.1Gemini 3.8 Flash0%25%50%75%100%GPT-6 Astra · FrontierMath Tier 4 · 97.6%98Claude Fable 5.1 · FrontierMath Tier 4 · 87.8%88Gemini 3.8 Flash · FrontierMath Tier 4 · 22.0%22FrontierMathTier 4GPT-6 Astra · FrontierMath Tiers 1–3 · 93.7%94Claude Fable 5.1 · FrontierMath Tiers 1–3 · 90.2%90Gemini 3.8 Flash · FrontierMath Tiers 1–3 · 68.4%68FrontierMathTiers 1–3GPT-6 Astra · Terminal-Bench 2.1 · 89.9%90Claude Fable 5.1 · Terminal-Bench 2.1 · 91.4%91Gemini 3.8 Flash · Terminal-Bench 2.1 · 87.6%88Terminal-Bench2.1GPT-6 Astra · DeepSWE · 74.1%74–Gemini 3.8 Flash · DeepSWE · 73.8%74DeepSWEGPT-6 Astra · Humanity's Last Exam · 54.7%55Claude Fable 5.1 · Humanity's Last Exam · 59.1%59Gemini 3.8 Flash · Humanity's Last Exam · 47.8%48Humanity'sLast ExamGPT-6 Astra · Artificial Analysis Coding Index · 77.1%77Claude Fable 5.1 · Artificial Analysis Coding Index · 81.6%82Gemini 3.8 Flash · Artificial Analysis Coding Index · 76.3%76ArtificialAnalysis…GPT-6 Astra · Artificial Analysis Intelligence Index · 52.7%53Claude Fable 5.1 · Artificial Analysis Intelligence Index · 53.4%53Gemini 3.8 Flash · Artificial Analysis Intelligence Index · 40.9%41ArtificialAnalysis…Source: Epoch AI, 'AI Benchmarking Hub'. Published online at epoch.ai. Retrieved from'https://epoch.ai/benchmarks' [online resource]. Licence CC BY 4.0. Retrieved 2026-09-10.Source: Artificial Analysis, https://artificialanalysis.ai/ Licence Free API, attribution required. Retrieved2026-09-10.Source: Datacurve, DeepSWE leaderboard v1.1, https://deepswe.datacurve.ai/. Licence not stated (publicleaderboard, cited with attribution). Retrieved 2026-09-10.TerraNet Technologies · terranettechnologies.com

The numbers behind this chart

Benchmark GPT-6 Astra Claude Fable 5.1 Gemini 3.8 Flash
FrontierMath Tier 4 97.6% 87.8% 22.0%
FrontierMath Tiers 1–3 93.7% 90.2% 68.4%
Terminal-Bench 2.1 89.9% 91.4% 87.6%
DeepSWE 74.1% – 73.8%
Humanity's Last Exam 54.7% 59.1% 47.8%
Artificial Analysis Coding Index 77.1% 81.6% 76.3%
Artificial Analysis Intelligence Index 52.7% 53.4% 40.9%

Mathematics reverses the order, and it is where the new data changes the picture most. On FrontierMath Tier 4, GPT-6 Astra at high leads with 97.6%, Claude Fable 5.1 at max scores 87.8%, and Gemini 3.8 Flash at high - unscored when this article first ran - comes in at 22.0% 2. Fable 5.1 also trails its predecessor here: Claude Fable 5 at max scored 90.2%.

FrontierMath Tier 4: top 6 API-access and open-weight modelsFrontierMath Tier 4: GPT-6 Astra (high) 97.6%, Claude Fable 5 (max) 90.2%, Claude Fable 5.1 (max) 87.8% and others.FrontierMath Tier 4: top 6 API-access and open-weight modelsAPI accessOpen weights0%25%50%75%100%GPT-6 Astra (high)GPT-6 Astra (high) · OpenAI · 97.6% · rank 197.6%Claude Fable 5 (max)Claude Fable 5 (max) · Anthropic · 90.2% · rank 290.2%Claude Fable 5.1 (max)Claude Fable 5.1 (max) · Anthropic · 87.8% · rank 387.8%GPT-5.6 Sol (max)GPT-5.6 Sol (max) · OpenAI · 82.9% · rank 482.9%GPT-5.5 Pro (xhigh)GPT-5.5 Pro (xhigh) · OpenAI · 78.0% · rank 578.0%AI Co-MathematicianAI Co-Mathematician · Google DeepMind · 75.6% · rank 675.6%Kimi K3 (max)Kimi K3 (max) · Moonshot · 39.0% · rank 1739.0%GLM-5.2 (max)GLM-5.2 (max) · Z.ai (Zhipu AI) · 29.3% · rank 2529.3%DeepSeek V4 Pro 0813 (max)DeepSeek V4 Pro 0813 (max) · DeepSeek · 26.8% · rank 2826.8%Kimi K2.6Kimi K2.6 · Moonshot · 25.6% · rank 3125.6%DeepSeek V4 Flash 0731 (max)DeepSeek V4 Flash 0731 (max) · DeepSeek · 24.4% · rank 3224.4%Gemini 3.8 Flash (high)Gemini 3.8 Flash (high) · Google DeepMind · 22.0% · rank 3522.0%GLM-5.3-Flash (max)GLM-5.3-Flash (max) · Z.ai (Zhipu AI) · 17.1% · rank 3917.1%Source: Epoch AI, 'AI Benchmarking Hub'. Published online at epoch.ai. Retrieved from'https://epoch.ai/benchmarks' [online resource]. Licence CC BY 4.0. Retrieved 2026-09-10.TerraNet Technologies · terranettechnologies.com

The numbers behind this chart

Rank Model Access Score
1 GPT-6 Astra (high) API 97.6%
2 Claude Fable 5 (max) API 90.2%
3 Claude Fable 5.1 (max) API 87.8%
4 GPT-5.6 Sol (max) API 82.9%
5 GPT-5.5 Pro (xhigh) API 78.0%
6 AI Co-Mathematician API 75.6%
17 Kimi K3 (max) Open weights 39.0%
25 GLM-5.2 (max) Open weights 29.3%
28 DeepSeek V4 Pro 0813 (max) Open weights 26.8%
31 Kimi K2.6 Open weights 25.6%
32 DeepSeek V4 Flash 0731 (max) Open weights 24.4%
35 Gemini 3.8 Flash (high) API 22.0%
39 GLM-5.3-Flash (max) Open weights 17.1%

Repository repair is closer than any ranking suggests. On DeepSWE, GPT-6 Astra at xhigh scores 74.1%, Gemini 3.8 Flash at high 73.8% and Claude Opus 5 at max 73.6% 1. Datacurve publishes run-to-run intervals for these scores - ±2.9, ±1.4 and ±3.9 points - and all three overlap, so the order among them is not evidence (what the DeepSWE intervals show). What does separate them is cost: Gemini 3.8 Flash reaches its score at a mean of $2.36 per task, against $4.43 for Astra and $11.84 for Opus 5. On this benchmark, the cheapest of the three repairs code about as well as the dearest.

DeepSWE against cost per task28 models plotted by DeepSWE score against cost per task.DeepSWE against cost per taskAPI accessOpen weights0%25%50%75%100%$0.10$0.30$1.00$3.00$10$30mean cost per task in USD, log scaleClaude Fable 5 · 69.9% · $13/1MClaude Opus 4.8 · 59.0% · $13/1MClaude Opus 5 · 73.6% · $12/1MClaude Sonnet 4.6 · 29.9% · $5.52/1MClaude Sonnet 5 · 53.8% · $26/1MDeepSeek-V4-Flash · 53.3% · $0.10/1MDeepSeek-V4-Pro · 62.8% · $0.24/1MGemini 3.1 Pro Preview · 11.7% · $2.14/1MGemini 3.5 Flash · 36.1% · $3.45/1MGemini 3.6 Flash · 46.7% · $4.42/1MGemini 3.7 Flash · 65.5% · $2.03/1MGemini 3.8 Flash · 73.8% · $2.36/1MGLM-5.2 · 43.8% · $3.92/1MGLM-5.3-Flash · 63.4% · $0.48/1MGLM-5.3 · 69.0% · $3.99/1MGPT-5.4 · 51.8% · $5.65/1MGPT-5.5 · 67.0% · $7.23/1MGPT-5.6 Luna · 67.2% · $3.03/1MGPT-5.6 Sol · 72.7% · $8.39/1MGPT-5.6 Terra · 69.6% · $4.95/1MGPT-6 Astra · 74.1% · $4.43/1MGrok 4.5 · 53.8% · $2.42/1MGrok 4.6 · 67.5% · $3.45/1MKimi K2.7 Code · 30.5% · $2.82/1MKimi K3 · 68.5% · $4.65/1MMuse Spark 1.1 · 53.3% · $2.36/1MMuse Spark 1.2 · 54.9% · $3.70/1MQwen3.8 Max · 57.5% · $3.73/1MGemini 3.8 FlashGPT-6 AstraClaude Opus 5DeepSeek-V4-FlashDeepSeek-V4-ProSource: Datacurve, DeepSWE leaderboard v1.1, https://deepswe.datacurve.ai/. Licence not stated (publicleaderboard, cited with attribution). Retrieved 2026-09-05.Cost is the mean spend per task over four runs on mini-swe-agent, as measured by Datacurve.TerraNet Technologies · terranettechnologies.com

The numbers behind this chart

Model Access Score $/task
GPT-6 Astra API 74.1% $4.43
Gemini 3.8 Flash API 73.8% $2.36
Claude Opus 5 API 73.6% $12
GPT-5.6 Sol API 72.7% $8.39
Claude Fable 5 API 69.9% $13
GPT-5.6 Terra API 69.6% $4.95
GLM-5.3 API 69.0% $3.99
Kimi K3 Open weights 68.5% $4.65
Grok 4.6 API 67.5% $3.45
GPT-5.6 Luna API 67.2% $3.03
GPT-5.5 API 67.0% $7.23
Gemini 3.7 Flash API 65.5% $2.03
GLM-5.3-Flash Open weights 63.4% $0.48
DeepSeek-V4-Pro Open weights 62.8% $0.24
Claude Opus 4.8 API 59.0% $13
Qwen3.8 Max API 57.5% $3.73
Muse Spark 1.2 API 54.9% $3.70
Claude Sonnet 5 API 53.8% $26
Grok 4.5 API 53.8% $2.42
DeepSeek-V4-Flash Open weights 53.3% $0.10
Muse Spark 1.1 API 53.3% $2.36
GPT-5.4 API 51.8% $5.65
Gemini 3.6 Flash API 46.7% $4.42
GLM-5.2 Open weights 43.8% $3.92
Gemini 3.5 Flash API 36.1% $3.45
Kimi K2.7 Code Open weights 30.5% $2.82
Claude Sonnet 4.6 API 29.9% $5.52
Gemini 3.1 Pro Preview API 11.7% $2.14

Formal reasoning and composite intelligence

Artificial Analysis's composite measures put Anthropic and OpenAI close together, with Google behind. Its revised Intelligence Index scores Claude Fable 5.1 at max at 53.4, GPT-6 Astra at max at 52.7 and Gemini 3.8 Flash at high at 40.9 3; in the first version of this article, the same three read 56.8, 54.7 and 47.1. On Humanity's Last Exam, a broad test spanning many academic subjects, Fable 5.1 at max scores 59.1%, Astra at max 54.7% and Gemini 3.8 Flash at high 47.8%. Among open-weight models, Kimi K3, released under its own licence, comes within a point of Gemini 3.8 Flash.

On FrontierMath Tiers 1–3, the less extreme problems, GPT-6 Astra at max leads with 93.7%, ahead of Claude Fable 5.1 at max at 90.2%, with Gemini 3.8 Flash at high on 68.4% 2.

FrontierMath Tier 4 against price per million tokens46 models plotted by FrontierMath Tier 4 score against price per million tokens.FrontierMath Tier 4 against price per million tokensAPI accessOpen weights0%25%50%75%100%$0.10$0.30$1.00$3.00$10$30$100price per 1M tokens, log scaleClaude Fable 5.1 · 87.8% · $20/1MClaude Fable 5 · 90.2% · $20/1MClaude Opus 4.1 · 2.4% · $30/1MClaude Opus 4.5 · 4.9% · $10/1MClaude Opus 4.6 · 26.8% · $10/1MClaude Opus 4.7 · 31.7% · $10/1MClaude Opus 4.8 · 56.1% · $10/1MClaude Opus 5 · 73.2% · $10/1MClaude Sonnet 4.5 · 2.4% · $6.00/1MClaude Sonnet 5 · 29.3% · $4.00/1MDeepSeek V4 Flash 0731 · 24.4% · $0.66/1MDeepSeek V4 Pro 0813 · 26.8% · $1.98/1MDeepSeek-V4-Pro · 2.4% · $0.54/1MGemini 3.5 Flash-Lite · 0.0% · $0.85/1MGemini 3.5 Flash · 26.8% · $3.38/1MGemini 3.6 Flash · 22.0% · $1.50/1MGemini 3.7 Flash · 36.6% · $1.50/1MGemini 3.8 Flash · 22.0% · $1.50/1MGLM-5.2 · 29.3% · $2.15/1MGLM-5.3-Flash · 17.1% · $0.24/1MGLM-5.3 · 29.3% · $2.15/1MGPT-5.2 · 31.7% · $4.81/1MGPT-5.4 Mini · 9.8% · $1.69/1MGPT-5.4 Nano · 12.2% · $0.46/1MGPT-5.4 Pro · 58.5% · $68/1MGPT-5.4 · 49.0% · $5.63/1MGPT-5.5 · 72.5% · $11/1MGPT-5.6 Luna · 61.0% · $0.45/1MGPT-5.6 Sol · 82.9% · $8.00/1MGPT-5.6 Terra · 70.7% · $4.50/1MGPT-5 mini · 12.2% · $0.69/1MGPT-5 nano · 2.4% · $0.14/1MGPT-5 · 22.0% · $3.44/1MGPT-6 Astra · 97.6% · $20/1MGrok 4.5 · 24.4% · $3.00/1MGrok 4.6 · 31.7% · $3.00/1MInkling-Small · 17.1% · $0.53/1MInkling · 4.9% · $1.76/1MKimi K2.6 · 25.6% · $1.71/1MKimi K2.7 Code · 12.2% · $1.71/1MKimi K3 · 39.0% · $6.00/1MMuse Spark 1.3 · 46.3% · $2.00/1Mo3-mini · 0.0% · $1.93/1Mo4-mini · 4.9% · $1.93/1MQwen3.7-Max · 34.1% · $3.75/1MQwen3.8 Max (0902) · 34.1% · $3.00/1MClaude Fable 5.1Gemini 3.8 FlashGPT-6 AstraGPT-5.6 SolClaude Opus 5GPT-5 nanoGLM-5.3-FlashSource: Epoch AI, 'AI Benchmarking Hub'. Published online at epoch.ai. Retrieved from'https://epoch.ai/benchmarks' [online resource]. Licence CC BY 4.0. Retrieved 2026-09-04.Price is the blended cost per million tokens at 3:1 input to output, from Artificial Analysis(https://artificialanalysis.ai/), attribution required.TerraNet Technologies · terranettechnologies.com
12 scored models without a published price are not plotted.

The numbers behind this chart

Model Access Score $/1M tokens
GPT-6 Astra API 97.6% $20
Claude Fable 5 API 90.2% $20
Claude Fable 5.1 API 87.8% $20
GPT-5.6 Sol API 82.9% $8.00
Claude Opus 5 API 73.2% $10
GPT-5.5 API 72.5% $11
GPT-5.6 Terra API 70.7% $4.50
GPT-5.6 Luna API 61.0% $0.45
GPT-5.4 Pro API 58.5% $68
Claude Opus 4.8 API 56.1% $10
GPT-5.4 API 49.0% $5.63
Muse Spark 1.3 API 46.3% $2.00
Kimi K3 Open weights 39.0% $6.00
Gemini 3.7 Flash API 36.6% $1.50
Qwen3.7-Max API 34.1% $3.75
Qwen3.8 Max (0902) API 34.1% $3.00
Claude Opus 4.7 API 31.7% $10
Grok 4.6 API 31.7% $3.00
GPT-5.2 API 31.7% $4.81
Claude Sonnet 5 API 29.3% $4.00
GLM-5.2 Open weights 29.3% $2.15
GLM-5.3 API 29.3% $2.15
Claude Opus 4.6 API 26.8% $10
DeepSeek V4 Pro 0813 Open weights 26.8% $1.98
Gemini 3.5 Flash API 26.8% $3.38
Kimi K2.6 Open weights 25.6% $1.71
DeepSeek V4 Flash 0731 Open weights 24.4% $0.66
Grok 4.5 API 24.4% $3.00
Gemini 3.6 Flash API 22.0% $1.50
Gemini 3.8 Flash API 22.0% $1.50
GPT-5 API 22.0% $3.44
GLM-5.3-Flash Open weights 17.1% $0.24
Inkling-Small Open weights 17.1% $0.53
GPT-5.4 Nano API 12.2% $0.46
GPT-5 mini API 12.2% $0.69
Kimi K2.7 Code Open weights 12.2% $1.71
GPT-5.4 Mini API 9.8% $1.69
Claude Opus 4.5 API 4.9% $10
Inkling Open weights 4.9% $1.76
o4-mini API 4.9% $1.93
Claude Opus 4.1 API 2.4% $30
Claude Sonnet 4.5 API 2.4% $6.00
DeepSeek-V4-Pro Open weights 2.4% $0.54
GPT-5 nano API 2.4% $0.14
Gemini 3.5 Flash-Lite API 0.0% $0.85
o3-mini API 0.0% $1.93

Latency, throughput, and API operating budgets

Price and speed separate them more than any score. Claude Fable 5.1 and GPT-6 Astra are both listed at $20.00 per million tokens blended, and Gemini 3.8 Flash at $1.50 3. For scale, our analysis of open-weight costs found that $2,111 - a month of one rented H100 - buys about 106 million tokens on either Astra or Fable 5.1, so a self-hosted model would need to sustain 40 tokens a second to be worth the machine.

Gemini 3.8 Flash also generates at 282 tokens a second, against 68 for Fable 5.1 and 63 for Astra 3. Open-weight alternatives are priced near it - GLM-5.2 at $2.15 per million and DeepSeek V4 Flash 0731 at $0.66 - though Artificial Analysis currently publishes no speed for either. For voice and other interactive uses, that speed matters more than a few points of benchmark score.

What to watch

Several critical data points remain unresolved across these models. Specifically, Claude Fable 5.1 has no published DeepSWE score. Datacurve's evaluation suite currently lists Claude Fable 5 at 69.9% at xhigh and Claude Opus 5 at 73.6% at max, but has yet to publish verified runs for Fable 5.1 1. If an independent run puts Fable 5.1 ahead of that tied cluster at a reasonable cost per task, it would be the strongest coding case of the three.

The other open question is mathematics. Gemini 3.8 Flash's 22.0% on FrontierMath Tier 4 is the one place in this comparison where it is not competitive. How far a later Flash release closes that gap will decide whether the $20.00 models keep a technical case beyond the hardest reasoning.

Verdict by use

  • Choose Claude Fable 5.1 if your work is complex code, terminal-driven agents, or broad knowledge work where it leads Humanity's Last Exam, and your costs can carry $20.00 per million tokens blended.
  • Choose GPT-6 Astra if your work is formal mathematics, where it leads both FrontierMath measures, and a measured 63 tokens a second is fast enough.
  • Choose Gemini 3.8 Flash for interactive agents, voice tools or cost-constrained code repair: it matches GPT-6 Astra on DeepSWE within the margin of error at a mean $2.36 per task, where Fable 5.1 has no published score yet, and generates at 282 tokens a second. Look elsewhere for frontier mathematics.

AI Tools

    GPT-6 Astra vs Claude Fable 5.1 vs Gemini 3.8 Flash: Frontier Math, Coding, and Cost | TerraNet Technologies