Will AI replace programmers? What the benchmarks actually say

What AI can already do

The measurable progress is real. Frontier models handle complex, multi-step coding tasks — around 80% on SWE-Bench Pro — and coding agents are deployed in real production workflows, not just demos. On raw capability, AI has cleared the bar of a strong entry-level engineer for many well-scoped tasks. This is the same evidence behind the scorecard's On-track "outpace college graduates" verdict.

Where it still falls short

Benchmarks aren't autonomy. The gap between scoring 80% on a coding test and reliably owning a feature end-to-end — scoping, integrating, debugging in a messy real codebase, and being accountable for it without human cleanup — is exactly where "replace" breaks down. The defining AGI bar Aschenbrenner named, a system that autonomously does AI research (the hardest kind of programming), remains undemonstrated.

The honest verdict

So: AI is automating slices of programming and raising each engineer's output, but it is not a drop-in replacement for a software engineer as of mid-2026. On track on capability; the reliability-and-ownership gap is what to watch.

Frequently asked questions

Partly, and unevenly. As of mid-2026 agentic coding is strong (~80% on SWE-Bench Pro) and automates parts of the job, but no system reliably owns end-to-end software engineering without human review. It augments programmers rather than replacing them.

Frontier models score around 80% on SWE-Bench Pro and ship real code in production for well-scoped tasks — roughly the level Aschenbrenner predicted for 2025/26, graded On track.

The gap between benchmark scores and reliable, accountable, end-to-end ownership in a real codebase. Autonomous software engineering without human cleanup is undemonstrated as of mid-2026.