← Live scorecard
Odds vs evidence · Issue #5 · reviewed 2026-09-21

AGI odds vs evidence: the market prices announcements, we grade capability

Last updated: September 21, 2026 · Updated as verdicts change
Prediction markets and this scorecard are measuring different things — and the difference is the insight. Polymarket prices an announcement event; the scorecard grades a capability claim against pre-registered criteria. Issue #5 of a running comparison: the market's AGI-by-2027 contract vs the Thesis Tracker's 62.5/100 evidence read.

Issue #5 — 2026-09-21

Prediction marketEvidence layer (this site)
Instrument"OpenAI announces it has achieved AGI before 2027?" (Polymarket)AGI-2027 verdict + Thesis Tracker
Question actually askedWill OpenAI announce it has achieved AGI before 2027?Do models do the work of an AI researcher by end-2027 (Aschenbrenner's own bar)?
Reading86% No / 14% Yes — machine-verified snapshot, 2026-09-21 09:11:05 UTC · $266,157 volume · market openVerdict Open; thesis at 62.5/100 (not a probability — a mean of 8 graded verdicts)
Resolves onAn announcement (with or without the capability)Pre-registered capability criteria, deadline 2028-01-01 (resolution page)

What moved since 2026-09-14

2026-09-14 09:08:58 UTC2026-09-21 09:11:05 UTCChange
Market: Yes22%14%-8 pt (0.6x)
Market: No78%86%+8 pt
Volume$247,155$266,157+19,002
Thesis Tracker62.5/10062.5/100unchanged
AGI-2027 verdictOpenOpenunchanged

What it does and does not tell you. The contract resolves on an announcement, so a move toward No is a repricing of how likely traders think a label is — not evidence about capability. The evidence side did not move: the tracker held at 62.5/100 and the AGI-2027 verdict stayed Open. That divergence is the whole point of running the two side by side.

Honest limits. One week is one data point, and a single market with $266,157 of volume is thin enough to move on modest flow. We do not know who traded or why.

Why the two numbers must not be conflated

A lab could announce "AGI" for a system that cannot do autonomous research — the market contract could pay out while the capability verdict stays Open or resolves Wrong. The reverse is also possible: genuine research autonomy demonstrated without anyone using the word AGI. Markets are excellent at pricing events and incentives; a graded evidence ledger is what tells you whether the substance happened. Traders on these markets are, in effect, this site's target reader: the resolution criteria they need are the ones we pre-registered.

Review log

DateMarket sideEvidence sideIssue published?
2026-09-2186% No / 14% Yes, $266,157 volume (2026-09-21 09:11:05 UTC)Verdict Open; tracker 62.5/100Yes — issue #5
2026-09-1478% No / 22% Yes, $247,155 volume (2026-09-14 09:08:58 UTC)Verdict Open; tracker 62.5/100Yes — issue #4
2026-09-0773% No / 27% Yes, $194,567 volume (2026-09-07 04:06:55 UTC)Verdict Open; tracker 62.5/100Yes — issue #3
2026-08-3182% No / 18% Yes, $103,282 volume (2026-08-31 04:18:24 UTC)Verdict Open; tracker 62.5/100Yes — issue #2
2026-08-2492% No / 8% Yes, $95,951 volume (2026-08-24 04:12:59 UTC)Verdict Open; tracker 62.5/100No — first machine-verified baseline, nothing to compare against yet
2026-08-10No further movement found beyond the issue #1 snapshot (~11% Yes)No verdict change; tracker held at 62.5/100No — nothing moved, so there was nothing to say
2026-08-08Issue #1 snapshot recordedVerdict Open; tracker 62.5/100Yes — issue #1

This series updates when something moves, not on a calendar. A weekly slot that must be filled produces filler; an evidence layer that publishes noise to look busy is worth less than one that publishes nothing and says so. Reviews happen weekly and are logged above either way — including the weeks the answer is "neither side moved". When a verdict actually flips, subscribers hear the same day, before they would read it in the odds.

Odds snapshots are third-party market data quoted with their as-of date; this site takes no positions and this is not trading advice.

Frequently asked questions

Is the Thesis Tracker score a probability of AGI?

No. 62.5/100 is the mean of 8 graded verdict weights — an auditable evidence composite, not a forecast. Prediction-market prices are crowd probabilities of specific contract wordings. The two answer different questions.

Why compare them at all?

Because the gap is informative. An announcement-priced market and a capability-graded ledger diverging tells you the crowd expects labeling to run ahead of substance (or behind it). Traders need pre-registered resolution criteria; that is exactly what this site publishes.

How current are the odds shown?

Each issue quotes a dated snapshot with a link to the live market — never a 'current' price. The odds are fetched automatically once a week and carry an exact UTC timestamp and the market's traded volume, so a reading can no longer drift into being quoted as if it were live. The series is reviewed weekly but only publishes a new issue when one side actually moves; every review, including the quiet ones, is logged on the page.

The live scorecard updates as models ship and verdicts change.

View the live scorecard →