GPT-6 Astra: The AGI Mirage and the 60% Failure Rate They Didn’t Tweet About

Prediction Markets | MaxWolf |

Greg Brockman stood on stage and declared it the “AGI era.” OpenAI trained GPT-6 Astra on more than 100,000 GPUs at its Stargate facility in Texas — the largest training run in company history. The model is the first to hit OpenAI’s internal “Critical” cybersecurity threshold. It can browse the web, fill out forms, manipulate spreadsheets, design PCBs in KiCad, build 3D scenes in Blender, and write legal contracts from scratch. All of that, packaged into the same $20/month ChatGPT Plus subscription millions already pay. [[8]][[1]][[6]]

Here’s what the press release won’t tell you: on the benchmark that matters most for real-world deployment — Agents’ Last Exam, which measures multi-step task completion — Astra scored 41.4%. That means roughly 6 out of every 10 complex tasks still fail. The ARC-AGI-3 score that’s being marketed as proof of AGI? Achieved with a custom “harness” that includes memory and tooling — not the raw model alone. The “Critical” cybersecurity threshold? OpenAI has never publicly defined what that means. [[23]][[27]][[29]]

Speed is the asset, but silence is the warning. And on September 3, 2026, the silence around what Astra cannot do is louder than what it can.


The Stargate Machine

GPT-6 Astra is not an incremental update. It is the direct successor to GPT-5.6 Sol, which launched in August 2025 and was itself a capable model. The jump from Sol to Astra represents roughly 13 months of development, punctuated by a July 2026 delay triggered by the Hugging Face incident that forced OpenAI to bolt on additional safety layers before shipping. [[2]][[1]]

The training infrastructure is staggering. OpenAI confirmed Astra was built using more than 100,000 GPUs at its Stargate data center in Texas. It is also the first OpenAI model to use other AI models in a significant supervisory role during training — a recursive architecture where one model’s outputs become another’s training signal. [[8]]

The rollout is tiered and deliberate. Day one: a limited set of organizations in OpenAI’s Daybreak Access cybersecurity program. Day two and beyond: ChatGPT Plus ($20/month), Pro, Business, and Enterprise tiers, plus API access through OpenAI’s own endpoints, Amazon Bedrock, and Microsoft Foundry. A “Pro” version of Astra exists for higher-tier subscribers, though OpenAI has not clearly delineated the capability gap between standard Astra and Astra Pro. [[3]][[4]][[5]]

Notably absent: any free-tier access. OpenAI has not announced a free plan for Astra. The free ChatGPT tier remains on older models. This is a deliberate signal: AGI-level capability is a paid product, not a loss leader. [[2]][[5]]

Pricing for the API: $15 per million input tokens and $75 per million output tokens for standard speed, with a “Fast” mode at double the price for double the throughput. Developers access it as gpt-6-astra through the API. A Zero Data Retention option is available for eligible API customers. [[3]][[21]]


What the Benchmarks Actually Say

OpenAI published an extensive benchmark suite. Let’s cut through the marketing and read the numbers the way a risk analyst reads a protocol’s TVL curve.

Agents’ Last Exam (Multi-Step Tasks): 41.4% This is the headline number that matters for anyone deploying AI into production workflows. Astra scored 41.4%, up from GPT-5.6 Sol’s 18.1% — a 128.7% relative improvement. Claude Fable 5.1 scored 31.4%. The leap is real. But 41.4% means the model fails 58.6% of complex, multi-step professional tasks. For context, that’s a grade of “F” in any academic setting. In a production environment, it means every two out of five tasks require human intervention. [[29]][[21]]

The benchmark tests agents on tasks ranging from financial modeling to engineering to media production. These are not toy problems. They are real professional workflows executed in real software environments. Astra is better than any model before it. It is not yet reliable enough to trust unattended. The house didn’t ban the game. It just changed the odds.

ARC-AGI-3: 98.6% — With a Harness OpenAI reports that Astra scored 98.6% on ARC-AGI-3, a benchmark designed to test abstract reasoning in unfamiliar turn-based environments. The ARC Prize organization, which created the benchmark, confirmed the result but immediately added a crucial caveat: “We are not claiming that it is AGI.” [[27]]

The reason is straightforward. OpenAI ran Astra with a “Responses API harness” that retains reasoning state between turns, uses compaction to manage long contexts, and provides tool access. The ARC Prize team explicitly noted that “those system choices can substantially raise ARC-AGI-3 scores without changing the underlying model.” [[23]]

In standardized conditions without the custom harness, Astra scored 62.7% on ARC-AGI-3 — still a significant result, but a far cry from the 98.6% headline. The benchmark measures “model plus agent system,” not raw fluid intelligence. FOMO drove the bus; reality hit the brakes. [[28]]

Terminal-Bench Science: 64.6% This is where Astra’s most dramatic leap lives. The model scored 64.6% on Terminal-Bench Science 0.1, versus GPT-5.6 Sol’s 22.4% — a 188% improvement. Claude Fable 5.1 scored 52.6%. At a lower-cost setting, Astra still hit 61.1%, versus Sol’s best of 22.4%, at approximately 27% lower estimated API cost. [[29]]

This is the kind of selective, discontinuous leap that suggests a genuine architectural breakthrough in formal reasoning and symbolic manipulation. If this capability transfers to real scientific research workflows — drug discovery, materials science, climate modeling — the impact will be profound. But the benchmark tests code-and-terminal-based scientific workflows, not wet-lab or experimental science. The gap between benchmark and lab bench remains wide.

Coding: DeepSWE v1.1 — 74.1% On this 113-task agentic coding benchmark, Astra scores 74.1%. Claude Opus 5 scores 73.7%. Gemini 3.8 Flash scores 73.8%. Meta’s Muse Spark 1.3 edges ahead. This is a photo finish, not a blowout. OpenAI’s claim that Astra is “the best model for software engineering to date” holds by a statistical hair — and only on this specific benchmark. [[30]][[24]]

On Terminal-Bench 4.0, which tests terminal-based software engineering and system configuration, Astra scores 57.7% versus Claude Fable 5.1’s 55.8% and Opus 5’s 52.3%. Leading, but not dominant. In coding, the field has converged. OpenAI is not running away with this category. [[30]]

Computer Use: OSWorld 2.0 — 72.6% This is Astra’s clearest win. On OSWorld 2.0, which measures how well an AI agent can navigate a real desktop environment, Astra scores 72.6% in approximately 40 minutes per task. GPT-5.6 Sol scored 65.7% at roughly 75 minutes. Higher accuracy, nearly half the time. That combination — better results, faster execution — is the difference between a model you babysit and one you can hand a task to and walk away. [[26]][[30]]

OpenAI also claims a 1.9x speed improvement on the Mind2Web browser benchmark using the updated Codex harness. In agentic workflows, time-per-task is the metric that determines whether an AI is a tool or a liability. On this front, Astra delivers. [[21]]

Cybersecurity: First to “Critical” OpenAI’s Preparedness Framework designates four risk thresholds: Low, Medium, High, Critical. Astra is the first model to reach “Critical.” On ExploitGym, Astra achieved a 42.4% success rate versus Sol’s 30.3%, while using substantially fewer output tokens. On ExploitBench (June–August 2026), which tests exploit development against 20 high-severity V8 vulnerabilities, Astra achieved substantially higher arbitrary code-execution rates. [[7]][[29]]

But “Critical” is an internal designation. OpenAI has not published the specific test methodology, the pass/fail criteria, or the independent audit results. We don’t know if “Critical” means “capable of autonomously exploiting a zero-day in a production environment” or “capable of outperforming a script kiddie with a known exploit.” The range between those two is the entire spectrum of cybersecurity risk. Gravity always wins, even in a vertical chain.


The Architecture Question No One Can Answer

OpenAI has disclosed almost nothing about Astra’s architecture. No parameter count. No details on the training methodology beyond the 100,000+ GPU figure. No paper. No technical report beyond the launch blog post. [[8]][[7]]

The 128.7% jump in multi-step task performance and the 188% leap in scientific computing suggest something fundamentally changed under the hood. These are not the kind of gains you get from scaling data alone. You get them from architectural innovation — possibly a hybrid architecture incorporating state-space models, or a novel training paradigm combining reinforcement learning with search-based agent trajectories at scale.

Based on my experience auditing AI systems and tracing anomalous performance patterns, the shape of Astra’s benchmark curve — massive gains in agentic and reasoning tasks, marginal gains in coding — points to a model optimized for planning and execution, not just prediction. This is consistent with a model trained on large-scale agent trajectory data, where the reward signal is task completion rather than next-token prediction.

The inference cost data tells a complementary story. OpenAI is pricing Astra at $15/$75 per MTok, roughly 3x the cost of GPT-5.6 Sol. But Astra completes many tasks in fewer tokens and fewer retries. OpenAI argues that the per-task cost may be comparable or even lower. That claim is plausible but unproven — OpenAI has not published enough task-level detail to calculate it. [[3]][[22]]

The $20/month Plus subscription is the most aggressive signal. If Astra’s inference costs were still prohibitive, OpenAI would not bundle it into the same subscription tier as previous models. They either achieved a breakthrough in inference efficiency, or they are willing to bleed margin for market share. The absence of a free tier suggests the former is at least partially true — if costs had collapsed completely, a free tier would be the obvious growth hack. [[2]][[5]]


The Digital Labor Thesis

For my readers who track the convergence of AI and crypto, Astra is not primarily an AGI story. It is a labor market story.

Astra can browse the web, fill out forms, update CRMs, run frontend QA on websites it just built, lay out PCBs, work across Excel and Power BI, and troubleshoot what is on screen. These are not creative tasks. They are procedural, rule-bound, and repetitive — exactly the kind of tasks that constitute the global business process outsourcing (BPO) industry.

At $20/month, Astra is cheaper than a Filipino virtual assistant by a factor of 10. At 41.4% multi-step task completion, it is less reliable — but the gap is closing, and the cost advantage is structural. The BPO industry, which employs roughly 80 million people globally and generated over $300 billion in revenue in 2025, is staring at a technology that could replace 30-50% of its task volume within 18 months. [[29]]

For crypto-native businesses — exchanges, DeFi protocols, NFT marketplaces, DAOs — Astra’s agentic capabilities mean compliance workflows, customer support triage, smart contract auditing pre-checks, and liquidity monitoring can be partially automated with an AI that acts rather than just advises.

But the caveat is the same: 41.4% success rate means every workflow needs a human in the loop. We didn’t see the crash coming. We saw the data that made it inevitable.


The Contrarian Angle: AGI Is a Marketing Construct

Let’s be precise about what OpenAI has and has not claimed.

OpenAI has not formally declared that Astra achieves AGI. The company’s official position, per Brockman, is that AGI is “a gray, fuzzy thing” and that Astra “may be the first model to reach that level.” The contractual trigger linking AGI to Microsoft’s profit-sharing agreement has been removed. Brockman’s statement — “Welcome to the AGI era” — is strategically ambiguous: it is not a formal declaration, but it is functionally identical to one in media coverage. [[8]][[9]][[11]]

This is a pattern I’ve seen before in crypto. Projects that cannot pass an objective test for decentralization instead declare themselves “sufficiently decentralized.” The standard becomes unfalsifiable. OpenAI is doing the same with AGI. By defining AGI as a “gray, fuzzy thing,” Brockman makes it impossible to prove that Astra has not achieved it. Any criticism can be met with “You’re applying too narrow a definition.”

The parallel to DAO governance is exact. In theory, “code is law” — in practice, multi-sig admins hold upgrade keys. In theory, AGI is a measurable milestone — in practice, OpenAI controls the definition and the measurement. The house didn’t ban the game. It just changed the odds.

Three specific concerns:

1. The ARC-AGI-3 Harness Problem The ARC Prize organization explicitly states that Astra’s 98.6% score reflects “model plus agent system” and that saturating the benchmark does not constitute proof of AGI. The standardized-condition score of 62.7% is a more honest representation of the model’s raw reasoning capability. OpenAI chose to lead with the 98.6% number. That is marketing, not science. [[27]][[28]]

2. The “Critical” Cybersecurity Threshold Is Undefined OpenAI has not published the methodology, test cases, or pass/fail criteria for its “Critical” designation. We know Astra outperforms Sol on ExploitGym. We do not know what “Critical” means in operational terms. Is it “capable of autonomously finding and exploiting a zero-day in a major protocol”? Or is it “capable of outperforming an automated scanner on known CVEs”? Those are fundamentally different risk profiles. [[7]][[2]]

3. Benchmark Self-Reporting Bias Every benchmark in OpenAI’s launch post was run by OpenAI or its vendors. The company controls the test conditions, the prompt design, the evaluation methodology, and the data presentation. In competitive markets, self-reported benchmarks systematically overstate advantage. Independent evaluations from Artificial Analysis show Astra scoring competitively but not dominantly on their Coding Agent Index, with Claude Fable 5.1 leading on certain agentic knowledge work metrics. [[22]]


What This Means for Crypto

Three implications for web3 professionals:

Security Risk Amplification. Astra’s cybersecurity capabilities are a double-edged sword. A model that can autonomously identify vulnerabilities in well-protected systems is a gift to security researchers and a weapon for attackers. OpenAI’s decision to gate access through the Daybreak program is prudent, but the capability exists. The question is not whether it will be used maliciously, but when. The first AI-generated exploit targeting a DeFi protocol is likely a matter of months, not years.

Digital Labor Disruption. Smart contract auditing, compliance monitoring, liquidity analysis, and governance communication are all multi-step digital workflows that fit Astra’s capability profile. Expect the first AI-augmented auditing firms to emerge within 6 months, offering faster and cheaper audits — but with the 41.4% caveat that human oversight remains essential. The firms that figure out the human-AI collaboration model will eat those that don’t.

Inference Cost as Infrastructure Signal. The $15/$75 per MTok pricing, combined with the $20/month subscription bundling, suggests OpenAI has achieved meaningful inference efficiency gains. For crypto projects building on AI inference, this means the cost of intelligent agents is dropping faster than the market expects. The economic bottleneck is shifting from compute cost to prompt engineering quality and task design.


The Takeaway

GPT-6 Astra is a genuine leap forward. The multi-step task improvement from 18.1% to 41.4% is real. The scientific computing jump is real. The computer use speed and accuracy gains are real. OpenAI has built a model that is closer to a usable digital assistant than anything that came before it.

But the “AGI era” is a narrative, not a technical reality. The model fails 6 out of 10 complex tasks. Its best benchmark scores were achieved with a custom harness that masks the model’s raw limitations. The “Critical” cybersecurity threshold is undefined. The architecture is undisclosed. The benchmarks are self-reported.

Speed is the asset, but silence is the warning. The next three months will tell the real story: independent benchmark results from LMArena and Artificial Analysis, real-world deployment data from Daybreak participants, and the first wave of enterprise case studies. Until then, Astra is the most capable AI model ever released — and still not reliable enough to trust unattended.

We didn’t see the crash coming. We saw the data that made it inevitable.