← Chart

November 2026 · Current score overlay

PredictionBench

Every claim. Its grade. The evidence.

Compare people Current ranking · 25 people

Current edition · 164 scored claims

Historical archive counts · separate from current scored-claim totals

Outcome columns count eligible claims only. “Partial/mixed” is not full success.

PersonAllEligibleExcludedPendingRightPartial/mixedWrong/mostly wrongUnresolvedNo outcome grade
13103002134
1385024020
1192054000
201820111240
13130012019
990025110
181620310030
232102410331
312110055290
11101017101
6153531724453
13111128010
13103036100
19181018180
1192016020
21210028470
11101007030
752005000
11101004141
232300213530
13130029011
17152039210
15141015080
251960112150
131120010010
Current weighted aggregates · 424-record edition

164 scored claims. Ranges reflect uncertain inputs, not statistical confidence intervals.

PersonScoredCurrent weighted credit boundsConfidence of ScoringWeight mass
Gary Marcus2386.9754384587258897.0832638475282922.329150684931506
Ilya Sutskever785.67222678519666–85.6852669125204264.735029354207444.531452054794521–4.536876712328768
Andrej Karpathy485.50445245541576–85.5916903374897745.5254794520547962.27627397260274–2.295178082191781
Demis Hassabis784.32964044049356–84.4668003985029158.143248532289634.070027397260274–4.12986301369863
Jürgen Schmidhuber381.05061646486428–81.0976450474299639.642739726027391.9821369863013698–1.987068493150685
Rodney Brooks980.86984443486384–80.884781418558167.784474885844766.100602739726027–6.105369863013699
Andrew Ng680.81456500874322–81.0861168358154969.460273972602744.1676164383561645–4.2274520547945205
Daniel Kokotajlo978.2738084345479–83.7539029014844890.228310502283128.12054794520548
Stuart Russell376.88899929615368–76.9784484627726325.272328767123291.2636164383561646–1.3234520547945205
Geoffrey Hinton676.00800921608425–76.0511254196246749.783561643835622.987013698630137–2.9965479452054793
Ajeya Cotra175–10019.681095890410960.9840547945205479
Jensen Huang37545.0575342465753442.252876712328767
Nick Bostrom37515.4652054794520560.7732602739726028–0.902958904109589
Noam Shazeer17519.697534246575340.9848767123287671–0.9898082191780821
Yann LeCun87567.60410958904115.408328767123288–5.447945205479452
Yoshua Bengio57555.3632876712328752.768164383561644
Sam Altman672.28524773323021–72.2900906701003485.00547945205485.100328767123288–5.1067397260273975
Eliezer Yudkowsky1169.6198937358025851.7519302615193065.692712328767123
Dario Amodei464.8429593004927866.050410958904113.302520547945205
Ray Kurzweil1064.8226676946800211.3709589041095891.137095890410959
Paul Christiano361.2428856357737641.697534246575342.084876712328767
Kai-Fu Lee1156.96277733979052–57.9904831625183144.2291407222914054.8652054794520545
François Chollet543.8615109323162983.903561643835624.195178082191781
Elon Musk1343.761335751627016–43.9941470907598263.200842992623818.216109589041096–8.277260273972603
Ben Goertzel343.35080915445753–44.9233324233324222.888767123287671.1444383561643836–1.2042739726027398
Current edition method

Current published score: each scored claim contributes once; the headline is the lower bound of the weighted mean credit.

Qualitative grades use reviewed credits of 0, 25, 50, 75, or 100. Stated binary probabilities use 100 × (1 − (p − y)²) against their original event/window. That event's time is already part of the claim; no extra timing penalty is applied.

Formula, dates, and interpretation

Weighted credit: Σ(credit × recency weight) ÷ Σ(recency weight). Where credit or backing dates are uncertain, the score bounds are optimized over the reviewed intervals. Individual endpoint products are not additive score bounds.

Recency weight: max(10%, min(100%, 100% − 6 percentage points × (age − 3 years))). Age is fractional Gregorian calendar age. Weight uses the earliest documented prospective backing of the same claim, with upper/lower bounds preserved; unknown dates use the engine's reviewed [10%, 100%] bound.

Confidence of Scoring: 100 × lower-bound weight mass ÷ max(5, scored-claim count). It describes sample/date weight, not probability that the score is correct.

Public rank: sort by the unrounded lower score bound; values equal at eight decimal places (ties-to-even) share a rank. The score is a descriptive archive result, not a percent-correct estimate or a universal measure of forecasting skill. It does not adjust for question difficulty.

Edition: frozen supplied 424-source-record / 164-scored-claim edition; as of 2026-11-01, outcome cutoff 2026-10-27T04:43:05Z. The surrounding 435-record audit ledger, its source material and authored verdicts are preserved. Its old draft aggregates and formula are superseded here.

Eligible claims

Portrait of Geoffrey HintonGeoffrey Hinton23 Feb 2026

AI substantially better than people at persuasion in roughly ten years, against an already strong baseline.

Randomized April–May 2026 text conversations favored AI over professional canvassers.

OutcomePartly rightDirectionRightMagnitudePartly supportedTimingWithin original window
Geoffrey HintonEligible

23 February 2026 publisher episode; recording day unverified, adjacent official-video publication February 22.

OutcomePartly rightDirectionRightMagnitudePartly supportedTimingWithin original window

Further evidence: Study 3 showed larger immediate policy-agreement change; Study 4’s public Claude Opus 4.6 elicited 10.8p more from a £1 donation bonus (95% CI 6.4–15.1). Bounded comparative capability, not generalized superiority or control.

Direction: Matched human comparisons support direction.

Magnitude: Substantial local advantage; broader superiority only partly supported.

Timing: April–May 2026 observations fall inside the approximate decade; preissue superiority rules out first-arrival or measured-progress credit.

Scope: Study 3: April 15–29; Study 4: April 30–May 13; June 15 preprint. Paid English-speaking adult completers; identities concealed, human matchmaking caused differential completion. Short, low-stakes text interaction, not durable beliefs, elections, broad mobilization or face-to-face persuasion. Earlier November–December 2025 studies are baseline; speed/length matching erased AI’s advantage. Changing models/tasks prevent longitudinal-gain inference. Not threefold total fundraising. Stronger smarter-agent/control-risk reading remains unresolved. Short paid experiments and model/platform effects; not broad, durable persuasion or loss-of-control evidence.

Shared evidence: Shared Chollet outcome work and investigators/platform, not independent replication. One persuasion lineage; weak-information continuation, not exceptional foresight.

Evidence confidence: Moderate for bounded comparative capability; lower for broader interpretation.

Original original_publisher_transcript (2026-02-23)
Outcome or context primary_postissue_comparative_outcome_and_preissue_baseline (2026-06-15T09:40:28Z)
Draft formula inputs

No draft score: grade held / duplicate. No vote, not zero.

Portrait of Ajeya CotraAjeya Cotra14 Jan 2026

≈80%: AI can solve hardest 2026 IMO problem at human-comparable inference cost by year-end.

Fixed July 23, 2026 Fable 5 artifacts contain natural-language solutions for P3 and P6.

Probability≈80%2026-01-14EventOccurredconditionalBrier loss≈0.04lower is better
Ajeya CotraEligible

2026-01-14

OutcomeNot applicableDirectionNot applicableMagnitudeNot applicableTimingNot separately applicable

Score condition: Conditional y=1 accepts stated budget and documented retail token estimates. Human fees, failed-stream charges and external reviewer/orchestrator costs remain unverified; full-cost alternative unscored.

Probability precision: Approximate, item-specific—not group-derived. The ≈ marks approximate probability and losses, not an exact elicited point.

Resolution confidence: Moderate conditional confidence; stricter alternative unresolved.

Proper score: 2026-01-14: p(event)≈80%; outcome=1 (under the stated score condition); Brier≈0.04; log loss≈0.2231436 nats.

Outcome dates: 2026-07-23

Interpretation: Lower Brier and log loss are better. Revisions concern the same event, not additional forecasts. One event does not establish calibration or overall reliability.

Further evidence: An independent AI static review found no substantive gap in either proof and matched each proof byte-for-byte to its final cost-bearing logged write. Logged-token estimates, including failed attempts, are $23.45 for P3 and $9.11 for P6, totaling $32.56. All four harness rates match the provider legacy price table; dated launch and successor announcements corroborate input/output and cache-read pricing. This supports conditional y=1. Human fees, unlogged or failed-stream charges and reviewer/orchestrator inference costs remain unverified. These are not invoices or human-certified proofs. Numeric probability forecast: event resolution and proper scores are separate; no categorical win.

Scope: One event. P3 is the hardest candidate identified by a dated expert assessment; P6 is retained as additional difficult-problem corroboration, not a second forecast. No official IMO participation or medal is claimed. No game-specific generic-harness requirement. January edited; original-day wording unverified.

Evidence confidence: Moderate conditional event resolution; separate independent AI proof review and primary pricing support, with budget completeness and human-fee uncertainty explicit.

Draft formula inputs

No draft score: grade held / duplicate. No vote, not zero.

Portrait of Ajeya CotraAjeya Cotra14 Jan 2026

≈80%: generic-scaffold, no-special-fine-tuning Pokémon-like play comparable to a typical ten-year-old by end-2026, at human-comparable inference cost.

One selected PokéBench Red run reached its first badge in 444 turns/102.8 minutes, demonstrating navigation/backtracking, combat, purchases, healing and recovery; audited marginal API cost: $7.623972.

Probability≈80%2026-01-14EventOccurredconditionalBrier loss≈0.04lower is better
Ajeya CotraEligible

2026-01-14

OutcomeNot applicableDirectionNot applicableMagnitudeNot applicableTimingNot separately applicable

Score condition: Conditional y=1 accepts bounded skills/recovery and practical marginal-cost comparison. Broader sustained/across-title competence or matched Red human economics remain unresolved, unscored; no categorical win or calibration.

Probability precision: Approximate. The ≈ marks approximate probability and losses, not an exact elicited point.

Resolution confidence: Moderate conditional confidence; skill breadth and imperfect human comparator remain judgment-sensitive.

Proper score: 2026-01-14: p(event)≈80%; outcome=1 (under the stated score condition); Brier≈0.04; log loss≈0.2231436 nats.

Outcome dates: Run October 12; public October 20, 2026. October 29 video-link excluded.

Interpretation: Lower Brier and log loss are better. Revisions concern the same event, not additional forecasts. One event does not establish calibration or overall reliability.

Further evidence: Explicit probability record: conditional event resolution and approximate proper scores are separate; no categorical win or extra outcome vote.

Scope: One game/early span, not full-game/broad-title or age-matched Red equivalence. RAM-based settling synchronizes screenshots; model action decisions use screenshots, notes/history, without RAM, map or extracted screen-text input. Stricter no-tailoring reading unresolved. Standard model, no reported game fine-tuning; ordinary pretraining allowed, universal training audit unclaimed. ≈70 calibration calls/engineering are separate development overhead; local power/hosting unpriced. All 444 records structurally audited; selected transitions inspected, not full visual replay. Mistakes/blackouts occurred; project report, not independent replication. Official tariffs match; marginal API cost is not an invoice/all-in bill. Emerald first-gym average 1:22:05 is context, not measured Red parity. Historical paid-play $13/$15–20 per hour versus $5 for 1–1.5 hours: heterogeneous, not 2026 same-game quotes. Break-even 35.19/30.50/22.87 minutes at $13/$15/$20 hourly are sensitivity, not Red observations/pass thresholds; lower rates sustain stricter uncertainty. No matched pre-January baseline or first-arrival credit. August acceptance informs intent, not independent proof or a fifty-hour requirement. Deadline: December 31, 23:59 Pacific; early positive allowed. Post-cutoff video link excluded; other summary fields unchanged.

Shared evidence: One conditional probability event, not separate votes for model, run, badge, code or comparator; prior other-source holds remain historical.

Evidence confidence: Moderate conditional resolution. Same-run substantive play, pinned generic decision scaffold, actual badge and fully reconciled API accounting support the practical interpretation; broader skill and human-cost comparability remain judgment-sensitive.

Draft formula inputs

No draft score: grade held / duplicate. No vote, not zero.

Portrait of Ajeya CotraAjeya Cotra14 Jan 2026

≈80%: brief-prompt AI can make ≈4-minute, ≥2-character video with somewhat coherent plot and no glaring visual incoherence/degeneracy by end-2026, at human-comparable inference cost.

V2 (October 25, 2026): outputs from all 50 prompts were human-rated, including seven 10/30-minute dramas; pooled eight-metric mean was 3.52/5, not a per-film pass rate.

Probability≈80%2026-01-14EventOccurredconditionalBrier loss≈0.04lower is better
Ajeya CotraEligible

2026-01-14

OutcomeNot applicableDirectionNot applicableMagnitudeNot applicableTimingNot separately applicable

Score condition: Conditional y=1 accepts same-population assessment, long dramas and practical estimates against original task/budget interpretation. Exact per-film quality/matched human-cost sensitivity: unresolved, unscored—not mandatory.

Probability precision: Approximate. The ≈ marks approximate probability and losses, not an exact elicited point.

Resolution confidence: Moderate conditional confidence; revised-study and pooled-score limits.

Proper score: 2026-01-14: p(event)≈80%; outcome=1 (under the stated score condition); Brier≈0.04; log loss≈0.2231436 nats.

Outcome dates: Generation/rating days unreported; publication dates in Outcome and Scope.

Interpretation: Lower Brier and log loss are better. Revisions concern the same event, not additional forecasts. One event does not establish calibration or overall reliability.

Further evidence: Explicit probability record: event resolution and approximate proper scores are separate; no categorical win.

Scope: Deadline: 2026-12-31, 23:59 Pacific. Training/development excluded. No commercial-polish, universal-success, single-call, personal-review, invoice or independent-replication requirement; automated editing allowed. January wording retained, not refetched; edit/history limits remain. Early attainment counts; year-end availability unguaranteed. Approximate-duration capability, not a logged four-minute run. Twenty paid raters assessed whole-drama coherence and boundary continuity; 43 outputs were ≈3, five ≈10, two ≈30 minutes. V1 (May 21, 2026): 20 unpaid raters, segment-level flow; corpus/judges/protocol changed. One revised study, no backward transfer or replication. Static ≈30-minute hospital/romance example supports recurring characters/plot, not full-motion quality. Full-motion supplement uninspected: exact authorized GET returned 403; all recovery stopped. Long outputs rated; earlier “unscored” suggestion overstated and retired. API $25–27/min includes retries: modeled four minutes $100–108 (alternative retry reading $133.60); demonstrated ten-minute duration, modeled API $250–270 ($334). Local compute extra; typical ten-minute pipeline 74–90 minutes, one 48GB A6000; conservative 1.5 GPU-hours occupancy context, not a meter or filmwise worst-case bound. Estimates, not invoices; maximum three retries are not observed retry counts. A funded five-minute, two-character student drama budget (£750; listed items £730, actors £250) planned a one-to-two-day shoot; funding closed April 10, 2026. March shoot/May release were plans, not verified completion, quality or full crew wages. Ordinary cost comparability is contextual—not guaranteed savings, cheapest-market floor, exact currency conversion or duration-prorated same-film quote. Undated four-minute, two-character short reportedly cost under £100 cash; unpaid labor/equipment/editing unspecified. Not pre-cutoff price proof, a human minimum or a basis for combining incompatible budgets.

Evidence confidence: Moderate conditional resolution. Same-population human assessment and practical production estimates support the original low bar, with individual-film quality and accounting uncertainty explicit.

Outcome or context Earlier primary outcome version, limits preserved (2026-05-21) · Pre-cutoff revised primary outcome and same-population quality/method/cost linkage (2026-10-25T12:32:36Z) · Dated ordinary-production human-budget context, not matched invoice (Fundingcompleted2026-04-10;plannedMarchshoot/Mayrelease,completionnotestablished)
Source Selected static example from accessible paper, not denied supplement (Associated with pre-cutoffv2;HTTP last-modified2026-10-27T01:12:23Z) · Low-cash comparator/accounting caution only, not dated endpoint proof (Undatedportfolio;not used as pre-cutoffcostanchor)
Draft formula inputs

No draft score: grade held / duplicate. No vote, not zero.

Portrait of Ben GoertzelBen GoertzelJan 2026 · range

2026: symbolic grounding enables reliable, uncertainty-aware quantitative, relational and graphical business reasoning.

VeriFin realizes bounded numerical-business QA with symbolic verification and abstention; general dependability remains unverified.

OutcomePartly rightDirectionRightMagnitudePartly matched scopeTimingWithin original window
Ben GoertzelEligible

January 2026; day unknown

OutcomePartly rightDirectionRightMagnitudePartly matched scopeTimingWithin original window

Further evidence: Qualified central capability; full-domain reading unresolved.

Direction: Matched candidate-pool comparisons support improved accepted-answer reliability; continuation, not invention.

Magnitude: Domain breadth partial.

Timing: In-window centrally; broader endpoint open.

Scope: VeriFin is a preprint: first submitted 10 August 2026, evaluated v3 dated 23 October. XBRL facts, authorized formulas and SMT checks ground interpretation. Tests use 600 constructed filing questions and selected 67 FinanceBench/403 TAT-DQA numerical questions, excluding qualitative questions. Nineteen FinanceBench-specific definitions and XBRL selection limit generalization; withheld labels are not an independent leakage audit. Qwen3-30B correctly accepts 304/600, falsely rejects 63 correct answers and abstains twice; zero observed false accepts covers selected evaluable cases, not universal safety. Its 99.7% decision coverage is not answer coverage; precision interval 98.8–100%. FinanceBench: 24/67 correct accepts, 15 abstentions, eight false rejections; precision interval 85.8–100%. GPT-5.5 accepts 560/600, with small gains over existing verifiers. Unresolved-correctness cases are excluded from precision/accuracy, not coverage. Formalization errors remain; checks depend on correct formalization. Repair subsets are unpaired; inconsistent GPT-5.5 FinanceBench accuracy is unused. No independent replication or production-benefit evaluation. QueryProof tests 80 synthetic warehouse tasks: routed success 53.7% versus 30% baseline, but 13 of 37 returned answers wrong. Abstention/ambiguity remain weak. Prior test exposure persists despite phrase removal; one annotator, correlated templates and cluster-bootstrap intervals spanning zero limit inference. This does not refute every symbolic system. December 2025 VERAFI already combined financial tools and neurosymbolic policy guidance; no first-invention credit or post-issue performance claim. Graphical/arbitrary-relational coverage unverified. No added perfection/profit requirement. No separately dated current endorsement is inferred.

Evidence confidence: Moderate for bounded numerical business capability; lower for broad business-data generalization.

Original original (January 2026; URL month only)
Outcome or context primary_outcome_and_limits (First submission 2026-08-10; evaluated version v3 2026-10-23T18:58:53Z) · primary_counterevidence (2026-08-10) · preissue_baseline (2025-12-12T17:17:43Z)
Draft formula inputs

No draft score: grade held / duplicate. No vote, not zero.

Portrait of Ben GoertzelBen GoertzelJan 2026 · range

AI contributes to longstanding open mathematics during 2026.

May 2026 primary mathematical papers verify AI-generated contributions resolving longstanding unit-distance and primitive-set conjectures.

OutcomeRightDirectionRightMagnitudeNot quantifiedTimingWithin original window
Ben GoertzelEligible

January 2026; day unknown

OutcomeRightDirectionRightMagnitudeNot quantifiedTimingWithin original window

Further evidence: Human exposition, checking and extensions remain explicit. Verified contributions to decades-old conjectures meet the asserted target without relying on contest scores or recovered prior literature.

Direction: AI made new mathematical contributions beyond predesigned contest problems.

Magnitude: No required numeric/Millennium threshold.

Timing: May results are in-window.

Evidence confidence: high for contributions and timing; no claim of universal reasoning reliability

Original original (2026-01 URL month; exact day unspecified)
Outcome or context outcome (2026-05-20) · outcome (2026-05-01) · outcome (2026-05-03) · corroboration (2026-05-24)
Draft formula inputs

No draft score: grade held / duplicate. No vote, not zero.

Portrait of Ben GoertzelBen GoertzelJan 2026 · range

In 2026, AI connects short clips into coherent long animation, easing production.

CHIEF’s matched novice-creator workflow supports AI-coordinated long-form continuity and local audience-perceived coherence.

OutcomePartly rightDirectionRightMagnitudePartly supportedTimingTiming unresolved
Ben GoertzelEligible

January 2026; day unknown

OutcomePartly rightDirectionRightMagnitudePartly supportedTimingTiming unresolved

Further evidence: A²RD supports minute-scale continuity; producer accounts describe feature animation by small core teams. Qualified central enablement supported; stricter full labor-saving conjunction unresolved.

Direction: Same-workflow evidence supports direction, not invention or measured post-January improvement.

Magnitude: Comparative artist-team/months savings, broad reliability and wider population effects remain unmeasured.

Timing: June 2026 disclosure, not exact runs or first attainment; no arrival credit. The stronger-reading year remains open.

Scope: CHIEF is researcher-reported novice production/local evaluation, not independent, randomized or blinded replication. Humans direct, rewrite, select and approve; comparison jointly changes human revision and AI support. Headcount, sessions and working time are unreported; selected revisions are not a full labor ledger. No personal film/frame inspection, feature-length or autonomous-production inference. A²RD: Human-tested one-minute single-scene samples support bounded continuity; ten-minute demonstrations relied on model judging. Poq Mher’s producer describes 23 core crew, including 13 AI creators; inconsistent premiere wording prevents an exact release date. SPEED EFFECT reports 117 minutes and three production staff, not all contributors; humans scripted, directed and edited. Its stated calendar date conflicts with its weekday label. Generation-cost claims are not total budgets. No independent viewing, film-quality verification or controlled labor study. Co-Director tests twelve-second outputs, not long films. Undated project examples add no timing credit. Pre-2026 long-video systems limit novelty; no first-ever credit.

Shared evidence: Shared source; not independent.

Evidence confidence: Moderate for the bounded central-functionality interpretation; lower for comparative labor, broad production quality and timing.

Original original (January 2026; exact day not displayed)
Source author project examples (Accompanies May 2026 paper; standalone page date unspecified) · primary producer retrospective (2026-06-05) · primary production-company release (2026-10-22 10:23 Japan displayed)
Draft formula inputs

No draft score: grade held / duplicate. No vote, not zero.

Portrait of Ben GoertzelBen GoertzelJan 2026 · range

2026: agents begin substantive organizational governance/management assistance.

Andon’s April launch and August report describe two agents hiring, contracting, purchasing and coordinating shifts for five employees at two businesses.

OutcomePartly rightDirectionRightMagnitudePartly supportedTimingWithin original window
Ben GoertzelEligible

January 2026; day unknown

OutcomePartly rightDirectionRightMagnitudePartly supportedTimingWithin original window

Further evidence: Useful hiring and shift coverage coexist with purchasing errors, closures, redundant work, inconsistent pay, fabricated arrangements, privacy problems and human-prevented overlong schedules. Qualified emergence; better-informed strategy and full-conjunction reading unresolved.

Direction: Successful actual work supports assistance despite serious errors.

Magnitude: Two small monitored businesses; no superiority or adoption estimate.

Timing: In-window; first-crossing/full-year verdict unresolved. Year remains open.

Scope: One operator’s supervised experiments, not independent replications or prevalence estimates. Humans remained legal employers, guaranteed pay, monitored and overrode decisions. Models changed; counterfactual replays are not extra deployments. No matched managerial-quality comparison. A controlled strategy study found no full-sample gain but an experienced-manager subgroup improvement; pre-2026 acceptance prevents new-emergence credit. Charity facilitation improved neither consensus nor equity significantly. OECD cases are selected testimony without verified intervention dates or quantitative comparisons; undated NVIDIA figures add no timing support. Greater DAO/open-source impact: possible, not mandatory.

Evidence confidence: Moderate for qualified central emergence; low for breadth or strategic superiority

Original original (2026-01; exact day not displayed)
Outcome or context outcome (2026-04-10) · outcome (2026-08-04) · counterweight_or_baseline (2026-02-20 publication; accepted2025-12-14) · counterweight_or_baseline (2026-06-26) · counterweight_or_baseline · supporting_context_chronology_unverified
Draft formula inputs

No draft score: grade held / duplicate. No vote, not zero.

Portrait of Geoffrey HintonGeoffrey Hinton30 Dec 2025

GPT-6 would arrive within roughly one or two years and improve on original GPT-5; a large gain was only possible.

GPT-6 Astra was publicly released 3 September 2026.

OutcomePartly rightDirectionRightMagnitudePartly supportedTimingWithin original window
Geoffrey HintonEligible

30 December 2025 publication; interview recording day unknown.

OutcomePartly rightDirectionRightMagnitudePartly supportedTimingWithin original window

Further evidence: The 22 October text-preference table scored Astra (Max) 1476±6 (14,076 votes), original GPT-5 (High) 1435±5 (31,712), and GPT-5 Chat 1426±4. GPT-5.6 Sol ranked above Astra. Qualified arrival/improvement conjunction under a bounded preference proxy.

Direction: Direct original-GPT-5 preference comparison supports improvement.

Magnitude: No numerical gain forecast or calibrated cross-domain magnitude; optional large gain uncredited.

Timing: Release and comparison fall within the approximate 2026–2027 forward horizon. No mandatory one-year lower bound, exact first crossing or timing-error estimate; literal delayed-arrival reading remains an alternative.

Scope: Preference-based, unequal reasoning settings; not universal superiority. A predictable continuation, with no numerical improvement promised. Exact interview recording date unknown; publication date is used. GPT-5.6 ranks above Astra in the same table. Self-selected prompts/preferences are neither semantic accuracy nor representative population benefit. Developer results use later GPT-5-family comparators and changed settings; no transitive original-GPT-5 inference. Mixed safety results and a September 22 HealthBench configuration correction limit generalization. The navigation study compares different harnesses/inputs/subsets and earns no grade credit. Original attribution is the interviewer-published dialogue, not its AI summary; audio was not independently checked. No current endorsement, exceptional foresight or separate launch/improvement votes.

Evidence confidence: Moderate for qualified successor/improvement conjunction; low for magnitude outside evaluated preference domain

Original original (2025-12-30) · supporting_outcome_not_original5_comparator (2026-09-03; relevant corrections through September 22 and appendices through September 29 precede cutoff)
Outcome or context outcome_release (2026-09-03 entry) · outcome_direct_comparator (2026-10-22 displayed leaderboard date)
Source method (Undated current methodology page; not used as a dated outcome) · screened_auxiliary_not_grade_basis (2026-09-25 website/report update; September24 arXiv first release)
Draft formula inputs

No draft score: grade held / duplicate. No vote, not zero.

Portrait of Sam AltmanSam AltmanOct 2025 · range

Qualified goal: Intern-level AI assistance meaningfully accelerates OpenAI research under human direction, with substantial inference compute allowed.

OpenAI reported reaching its research-intern goal by September 6, 2026, with internal agent use and more experiments.

OutcomeRightDirectionNot separately gradedMagnitudeNot separately gradedTimingWithin original window
Sam AltmanEligible

Event reported October 28, 2025; transcript page dates video October 29, 2025. Preserve one-day publication/upload distinction.

OutcomeRightDirectionNot separately gradedMagnitudeNot separately gradedTimingWithin original window

Original horizon: By September 2026; month precision. Preserve actual dated use and first public report separately. Earliest qualifying use may predate announcement but cannot be invented.

Further evidence: Human steering fits the target; the first-party measurements are preliminary, incomplete and not independently replicated, with compute growth confounding the experiment trend. Concrete supervised research assistance matches the intern-level target; required human steering is not a target shortfall.

Direction: Not separately graded in the historical record.

Magnitude: Not separately graded in the historical record.

Timing: The September 6 report fits a September month-level horizon; a strict September 1 deadline remains unresolved.

Scope: Earliest actual attainment is unknown. Success analyses exclude uncertain outcomes and small samples; “researcher” includes support roles. Code volume is not research progress. This is not autonomous project leadership, replacement of all researchers, or fulfillment of the separate March 2028 researcher goal. This was a qualified goal and forecast, not an unconditional promise.

Evidence confidence: Not separately rated.

Original Original · Original
Outcome or context Outcome
Draft formula inputs

No draft score: grade held / duplicate. No vote, not zero.

Portrait of Sam AltmanSam AltmanOct–Nov 2025 · range

Tentatively expects ChatGPT to reach about 30% of people worldwide weekly within a year.

OpenAI reported 1.2 billion weekly people on 5 October 2026, well below the target scale: a qualified near-anniversary inference, not exact-week falsification.

OutcomeMostly wrongDirectionRightMagnitudeOverestimatedTimingTiming unresolved

17 October 2025 live event; 5 November host transcript.

OutcomeMostly wrongDirectionRightMagnitudeOverestimatedTimingTiming unresolved

Original horizon: One year from the event, approximately October 2026; publication does not reset it.

Direction: Usage grew beyond the original roughly 10% worldwide baseline.

Magnitude: Scale overestimated; no precise population conversion or acceptance band inferred.

Timing: Unresolved: measurement weeks unknown; 5 October was 12 days early. The 21 October more-than-1.2-billion disclosure is a lower bound, not a ceiling or dated miss.

Scope: Assumes contemporaneous reporting and no extraordinary twofold pre-deadline surge. Rounded issuer counts have unknown deduplication; disclosures are not independent. Target: worldwide weekly people, not accounts, monthly traffic or all OpenAI products. Tentative 30% is a share, not probability. Host dates recording; audio unchecked; organizer confirms only event window. A transcript-date November 2026 horizon stays open at cutoff. No later same-scope endorsement.

Evidence confidence: Moderate for reported-scale shortfall; lower for exact-week outcome, given company measurement and rounding limitations.

Original primary_original_host_transcript (Recorded 2025-10-17; published 2025-11-05)
Draft formula inputs

Not in this 424-record calculation edition. No score assigned here.

Portrait of Yoshua BengioYoshua Bengio9 Oct 2025

Rapid task-capability growth is likelier to continue than stall in six months.

METR software-task gains ran through 16 March 2026.

OutcomePartly rightDirectionRightMagnitudePartly supportedTimingTiming unresolved
Yoshua BengioEligible

2025-10-09 publication; recording date unknown

OutcomePartly rightDirectionRightMagnitudePartly supportedTimingTiming unresolved

Further evidence: AISI’s newer checkpoint, received after 13 April and reported by 13 May 2026, supports continuation beyond the earlier interval gap. Qualified continuation, not universal or indefinite growth.

Direction: Technical-task capability improved after issuance.

Magnitude: Partial rapid-progress support; no exact doubling rate.

Timing: Recording date unknown; no hard deadline or timing win.

Scope: Narrow benchmarks and uncertain human-time calibration; no exact growth-rate, all-job or AGI credit. Success thresholds: AISI cyber 80%, METR software 50%; no numerical pooling. AISI’s human baselines are partly estimated; saturation and longer tails limit precision. Statistical reanalysis retains observed growth but questions equal-interval interpretation and long extrapolation; this is shared-data reanalysis, not a new capability experiment. Shared METR findings are not independent replications.

Evidence confidence: Moderate for qualified continuation; benchmark scope, human-time measurement and saturation limit transfer.

Outcome or context independent_primary_outcome (2026-01-29) · independent_primary_outcome (2026-05-19) · statistical_validity_counterweight (2026-10-08)
Source metric_limitations (2026-09-08) · independent_post_interval_task_duration_measurements (2026-05-13; new checkpoint received after the April13 report) · initial_checkpoint_comparator (2026-04-13)
Draft formula inputs

No draft score: grade held / duplicate. No vote, not zero.

Portrait of Sam AltmanSam Altman10 Jun 2025

AI systems will likely generate novel insights during 2026.

A May 2026 mathematical manuscript verifies an AI-generated counterexample to a longstanding discrete-geometry conjecture.

OutcomeRightDirectionRightMagnitudeNot quantifiedTimingWithin original window
Sam AltmanEligible

2025-06-10

OutcomeRightDirectionRightMagnitudeNot quantifiedTimingWithin original window

Further evidence: Human checking and exposition are explicit. The bounded existence claim is met by a verified novel mathematical contribution, rather than a contest score or rediscovery.

Direction: A substantive new research result supports the predicted capability.

Magnitude: No number of insights, discipline coverage or reliability threshold was specified.

Timing: The verified result appeared in the specified 2026 year, after the June 2025 forecast.

Shared evidence: Related to A-C026 and BG-C031. This row reuses the mathematical outcome evidence from BG-C031; it is not an independent success.

Evidence confidence: High for bounded novelty and year; not a claim about broad research reliability.

Original original_primary (2025-06-10) · contemporaneous_provenance (2025-06-12)
Outcome or context outcome_primary_mathematicians (2026-05-20 publication alongside announcement) · outcome_dated_announcement (2026-05-20)
Draft formula inputs

No draft score: grade held / duplicate. No vote, not zero.

Portrait of Demis HassabisDemis Hassabis3 Jun 2025

Over the next few years, AI tools likely greatly boost individual productivity.

September–November 2025 Argentina randomization found substantial assisted-task quality gains and modest time savings.

OutcomePartly rightDirectionRightMagnitudePartly supportedTimingTiming unresolved

2025-06-03 release; recording date unknown.

OutcomePartly rightDirectionRightMagnitudePartly supportedTimingTiming unresolved

Further evidence: Qualified continuation of useful-tool assistance.

Direction: Bounded human-task gains.

Magnitude: Partial, not universal benefit.

Timing: Soft multiyear outlook; no timing credit.

Scope: Short artificial tasks, attrition, convenience recruitment and partly automated grading limit generalization; one time-saving estimate did not reach conventional 5% significance. Existing GPT-4.1 limits novelty. German apprentice corroboration compares AI plus internet against no internet, not isolated AI; exact cutoff-version chronology is uncertain. No economy-wide or broadly superhuman gains, durable learning or full multiyear persistence established. Mixed findings. The separate tenfold branch is ungraded.

Evidence confidence: Moderate for bounded experimental support; lower for generality and exact publication-version chronology of ancillary IZA corroboration.

Draft formula inputs

No draft score: grade held / duplicate. No vote, not zero.

Portrait of Geoffrey HintonGeoffrey HintonJun 2025 · range

Good personalized AI tutors within roughly ten years, with factor-two timing uncertainty; eventual superiority to human tutors and three-to-fourfold learning efficiency also anticipated.

StudentBench’s summer 2026 randomized one-hour adult GRE tutoring used individual pretest errors.

OutcomePartly rightDirectionRightMagnitudeUnresolvedTimingWithin original window
Geoffrey HintonEligible

June 2025 host event; exact day and transcript first-publication/revision chronology unverified.

OutcomePartly rightDirectionRightMagnitudeUnresolvedTimingWithin original window

Further evidence: Immediate unaided gains exceeded control. Pooled AI–human equivalence met authors’ margins, but Verbal separately did not; six systems passed exploratory uncorrected tests. Bounded adaptive tutoring, not full numerical fulfillment.

Direction: Adaptive teaching and learner benefit.

Magnitude: Learning-speed superiority and three-to-fourfold efficiency unresolved.

Timing: Postissue observation within the broad window; no first-arrival date or numerical-clause timing.

Scope: Adjusted equivalence survived repeat-student/leave-one-tutor checks; gain-only section tests did not. Gemma4: −1.09 percentage points versus humans (90% CI −3.93–1.75). Paid, mainly young adult completers; English GRE and immediate tests, not durable child/classroom learning. Adaptation was not causally isolated; human video versus AI chat differed. Human clustering limited precision; control watched unrelated educational videos, not GRE self-study. Platform-funded preprint, not independent replication. The 918× figure is inference cost, not learning speed or all-in cost. Stronger full-superiority/numerical conjunction remains unresolved. Adult GRE setting and immediate outcomes, not durable broad schooling. Human-comparison results are model-sensitive; learning-speed superiority remains unresolved.

Shared evidence: Tutoring predated issuance: weak-information continuation, not first invention. One 2024/2025 lineage, not separate votes.

Evidence confidence: Moderate for bounded central functionality; lower for broader tutoring interpretation.

Original original_host_transcript (June2025 event, exact day unknown)
Outcome or context host_date_corroboration (2025-07-23) · primary_measured_postissue_outcome (2026-09-30 pinnedv2;v1September23) · retained_preissue_baseline (2024-06)
Draft formula inputs

No draft score: grade held / duplicate. No vote, not zero.

Portrait of Demis HassabisDemis Hassabis27 Apr 2025

Coding assistants become very good by 2026.

METR’s early-2026 evaluation and firsthand engineering use support stronger coding assistance, but custom work retained serious bugs and poor judgment.

OutcomePartly rightDirectionRightMagnitudePartly supportedTimingTiming unresolved
Demis HassabisEligible

2025-04-27 publication; recording day unknown

OutcomePartly rightDirectionRightMagnitudePartly supportedTimingTiming unresolved

Further evidence: Matched software-task tests improved; corrected estimates replace January values. Time horizon measures human-equivalent task difficulty, not autonomous working time. An early-2025 experienced-maintainer trial found slower work; February 2026 follow-up remains selection- and measurement-limited. Anthropic’s small junior-developer study found no significant time gain and lower immediate quiz performance; narrow new-library tasks are not all coding work. Qualified capability match, not universal usefulness.

Direction: More demanding software tasks became feasible.

Magnitude: No numerical quality or speedup threshold was promised.

Timing: 2026 was stated; no defined threshold-crossing date is established.

Scope: Software-task-heavy evidence; shared METR findings are not independent replications. No autonomous-research, OS-design or professional-replacement credit.

Evidence confidence: Moderate for qualified coding-quality trajectory; lower for the undefined quality level and practical productivity.

Original original_primary_interview (2025-04-27 publication; recording day unknown)
Outcome or context controlled_contrary_context (2025-07-25 v2; February–June2025 experimental tools) · scoped_learning_and_productivity_counterweight (2026-01-29)
Source independent_matched_capability_comparison (2026-01-29) · independent_dated_observations_and_limits (2026-05-19; observations February16–March16,2026) · primary_method_and_correction_notice (Page last updated2026-09-08; correction2026-03-03) · later_productivity_uncertainty (2026-02-24)
Draft formula inputs

No draft score: grade held / duplicate. No vote, not zero.

Portrait of Daniel KokotajloDaniel Kokotajlo3 Apr 2025Chart grade 75 / 100

By end 2025: a rudimentary, unreliable party-organizing MVP, not dependable life management.

A June 2025 event drew 23 people.

OutcomePartly rightDirectionRightMagnitudePartly supportedTimingWithin original window
Daniel KokotajloEligible

2025-04-03 publication; recording day not separately established

OutcomePartly rightDirectionRightMagnitudePartly supportedTimingWithin original window

Further evidence: Agents handled materials, promotion, RSVPs and facilitator recruitment. Humans redirected venue search and corrected hallucinations; pizza arrived as an unrelated donation, not successful agent ordering. A partial agent-assisted demonstration is consistent with the qualified MVP forecast; stronger autonomy is unverified

Direction: Real event-organization work demonstrated.

Magnitude: Limited demonstration; intervention and failed subtasks.

Timing: June 2025 precedes December 31; no first-onset claim.

Scope: The host’s roughly thirty-minute example describes human invitations and food ordering, not a required agent runtime. Multiple agents worked for weeks with human help. Autonomous thirty-minute completion, reliable attendee selection and food fulfillment remain unestablished.

Evidence confidence: Moderate-low: dated official-host original and first-party organizer account; linked execution logs were not independently audited. Narrow demonstration, not a measured success rate.

Original Original interview (2025-04-03)
Source First-party event account (2025-07-18)
Current edition contribution · Daniel Kokotajlo

Graded credit: 75 / 100.

Recency weight
100%
Credit × weight endpoint products
75
Last documented backing
2025-04-03 to 2025-04-03
Timing deduction recorded
0 points

The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.

Preserved draft calculation (superseded)Draft formula inputs
Credit
75 / 100
Recency weight
100%
Weighted credit term
75
Same-claim backing date
2025-04-03 to 2025-04-03

Existing reviewed grade for the original scope; time intrinsic to that scope is retained.

Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.

Date basis

No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.

Exact calculation inputs
{
  "scoring": {
    "kind": "reviewed_credit",
    "bounds": [
      75,
      75
    ]
  },
  "backingDateBounds": [
    "2025-04-03",
    "2025-04-03"
  ],
  "timingCostBounds": [
    0,
    0
  ],
  "calculated": {
    "creditBounds": [
      75,
      75
    ],
    "weightBounds": [
      1,
      1
    ],
    "normalizedBackingDateBounds": [
      "2025-04-03",
      "2025-04-03"
    ],
    "timingCostBounds": [
      0,
      0
    ],
    "deadlineWaiverCreditBounds": [
      75,
      75
    ],
    "aggregationDisposition": "one admitted claim; uncertainty retained as interval"
  }
}
Portrait of Jensen HuangJensen HuangApr–May 2025 · range

Expects early physical-agent production in 2026 and domain-specific humanoid work within five years.

Figure reported over 350 Figure 03 robots built by April 2026.

OutcomePartly rightDirectionRightMagnitudeUnresolvedTimingWithin original window
Jensen HuangEligible

April 2025 recording; May 2025 publication (exact days unknown)

OutcomePartly rightDirectionRightMagnitudeUnresolvedTimingWithin original window

Further evidence: BMW reported a ten-month Figure 02 pilot during 2025, with exact dates unspecified. The same sheet-metal task was already trialed in August 2024 before the forecast; the later pilot is deployment depth, not first task emergence. Actual reported manufacture and industrial work support the bounded early transition, not robots generally doing whatever humans request.

Direction: Physical-agent engineering proceeded into small production runs and narrow workplace use.

Magnitude: No count, adoption fraction or reliability target was supplied; described factory capacity is not realized output.

Timing: April 2026 production report falls within the explicit 2026 window; narrower 2025 use also precedes the five-year upper bound. Neither proves all longer-run functionality.

Scope: Narrow trials and pilot tasks, not general factory autonomy. 2025 pilot dates are unspecified; separately dated 2026 production evidence is post-forecast.

Evidence confidence: Moderate: primary manufacturer/customer reports, narrow tasks, unaudited production count.

Original original (2025-05 (recorded 2025-04))
Outcome or context outcome_and_limitations (2026-04-29) · customer_outcome (2026-02-27) · pre_forecast_baseline (2024-06-27) · same-task pre-forecast baseline (2024-08-06 release header)
Draft formula inputs

No draft score: grade held / duplicate. No vote, not zero.

Portrait of Dario AmodeiDario Amodei10 Mar 2025Chart grade 25 / 100

AI will write 90% of code within three–six months, while humans retain design and integration duties.

Google reported 30% of new code AI-assisted/generated in August 2025.

OutcomeMostly wrongDirectionRightMagnitudeOverestimated at deadlineTimingOriginal deadline missed
Dario AmodeiEligible

2025-03-10

OutcomeMostly wrongDirectionRightMagnitudeOverestimated at deadlineTimingOriginal deadline missed

Further evidence: An October 2025 survey of AI-using technology professionals reported 42% generated or significantly assisted code (979 responses), alongside other near-window evidence. These non-census observations strongly disfavor the broad 90% deadline interpretation; localized high shares and substantial later progress remain explicit. Moderate, qualitative and interpretation-sensitive; convergent near-window company and broad survey evidence, with later corroboration, strongly disfavors 90% as an ordinary industry-wide share. This is not proof of an exact world percentage.

Direction: right: AI-generated coding increased substantially, supported by actual-code measures not merely user counts.

Magnitude: Overestimated at the original deadline; no artificial weighted meta-estimate across different denominators.

Timing: Original deadline missed; eventual status unverified: qualified inference for original broad September 2025 target; no precise eventual crossing/lateness.

Scope: Field/world actual code writing, not expressly Anthropic-only or one workflow; precise population/volume unit unspecified. Human design, integration and security judgment remain. Existential some-workflow reading can have very high shares; original did not explicitly restrict to that. Later Anthropic broader 90% self-assessment does not rewrite March 2025 scope.

Evidence confidence: Moderate, interpretation-sensitive negative judgment for broad industry code writing; samples and company reports are not a global volume-weighted census.

Original original (2025-03-10)
Source near_deadline_code_share (2025-08-18) · within_window_population_code_share (July2025fieldwork;Q3report) · shortly_post_deadline_code_share_and_methods (October2025fieldwork;January8,2026release) · later_scope_check (2026-04-22) · later_population_check (May–July2026fieldwork) · contrary_narrow_high_share (2025-06-03report;validationdayunknown) · contrary_later_company_share (May2026observation;September18,2026update)
Current edition contribution · Dario Amodei

Graded credit: 25 / 100.

Recency weight
100%
Credit × weight endpoint products
25
Last documented backing
2025-03-10 to 2025-03-10
Timing deduction recorded
0 points

The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.

Preserved draft calculation (superseded)Draft formula inputs
Credit
25 / 100
Recency weight
100%
Weighted credit term
25
Same-claim backing date
2025-03-10 to 2025-03-10

This state-at-time, annual trajectory or original-period market/adoption predicate already includes time in its meaning. There is no separate event-arrival penalty to add back; preserve the reviewed original credit and temporal scope.

Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.

Date basis

No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.

Exact calculation inputs
{
  "scoring": {
    "kind": "reviewed_credit",
    "bounds": [
      25,
      25
    ]
  },
  "backingDateBounds": [
    "2025-03-10",
    "2025-03-10"
  ],
  "timingCostBounds": [
    0,
    0
  ],
  "calculated": {
    "creditBounds": [
      25,
      25
    ],
    "weightBounds": [
      1,
      1
    ],
    "normalizedBackingDateBounds": [
      "2025-03-10",
      "2025-03-10"
    ],
    "timingCostBounds": [
      0,
      0
    ],
    "deadlineWaiverCreditBounds": [
      25,
      25
    ],
    "aggregationDisposition": "one admitted claim; uncertainty retained as interval"
  }
}
Portrait of Gary MarcusGary Marcus9 Mar 2025

AI from 2026–2027 will substantially assist human scientific research.

A 2026 primary report documents nontrivial model contributions incorporated into human-led mathematical research, with important failures and limited breadth.

OutcomePartly rightDirectionRightMagnitudePartly matched scopeTimingWithin original window
Gary MarcusEligible

2025-03-09

OutcomePartly rightDirectionRightMagnitudePartly matched scopeTimingWithin original window

Further evidence: Approximately right for the separable positive research-assistance component: experts report nontrivial AI contributions to actual novel mathematics. The future Nobel-laureate beneficiary claim is not resolved.

Direction: Observed useful human–AI scientific collaboration supports the augmentation direction, not just benchmark improvement.

Magnitude: Selected research contributions support substantive help, but not broad gains across science, Nobel-level achievement or a representative average productivity increase.

Timing: The research report identifies a January 2026 base model for the research cases, placing observed assistance inside the specified 2026–2027 generation window. This is not proof of the separate future-laureate endpoint.

Scope: Selected human-led mathematics contributions, not broad scientific productivity or future Nobel winners. Project-author evidence; rare successes, failures and modest significance retained.

Evidence confidence: Moderate for reported narrow contribution; project-author evidence, not independent publication-quality validation or population inference.

Original original (2025-03-09)
Source human_ai_research_contribution (2026-02-10 v1)
Draft formula inputs

No draft score: grade held / duplicate. No vote, not zero.

Official AI-generated avatar of Noam ShazeerNoam Shazeer12 Feb 2025

In a tentative three-year outlook, parallel machine exploration could aid ML breakthroughs; research coordination remains uncertain.

DeepScientist’s 16 parallel workers shared findings and produced measured gains across three ML tasks.

OutcomePartly rightDirectionRightMagnitudePartly supportedTimingTiming unresolved
Noam ShazeerEligible

12 February 2025 publication; earlier recording day unknown.

OutcomePartly rightDirectionRightMagnitudePartly supportedTimingTiming unresolved

Further evidence: ScientistTwo reports gains on 86/107 selected problems; success-only mean/median gains were 25.2%/7.7%. The earlier game-algorithm study remains counterevidence. Its later 18-game revision reveals over-specialization and improves generalization through human distillation. Approximately right for the tentative central exploration/coordination trajectory; the stronger whole day-to-day research arrangement remains unresolved.

Direction: Useful parallel/coordinated exploration in two developer-reported studies; separate teams are not independent replications.

Magnitude: Meaningful bounded gains, not a researcher-productivity multiple or paradigm-breakthrough guarantee; selection, verification and rigor limit breadth.

Timing: Three-year context remains open; publication is not an exact recording anchor or new 2028 deadline. Experiment dates are unknown.

Scope: DeepScientist: humans reproduced baselines, supervised runs and verified all results; about 5,000 ideas yielded 1,100 experiments, 21 progress findings and five selected papers. Expert reviewers flagged rigor; mean rating 5/10 is not acceptance. ICLR accepted the system report, not its generated papers. A retrospective efficiency comparison is not a controlled productivity trial. ScientistTwo’s September 2026 preprint uses reproducibility-selected tasks and success-selected outputs; 72.1% simulated acceptance is not conference acceptance. Nine humans reviewed 33 papers; developer artifact audits are not independent reruns. Another configuration retained reward hacking. Local refinement, weak breakthrough evidence and incompletely documented review uncertainty limit generalization. DeepScientist is a separate Westlake team; ScientistTwo shares Google affiliation with Noam. Neither supplies independent replication. Report/model chronology supports later contributions without exact experimental dates. Gemini 2.5 Pro searches code within human-specified baselines, evaluators and editable components. The February 18 v1 reported gains in 10/11 and 8/11 games for VAD-CFR/SHOR-PSRO respectively; larger variants partly held out. The May 7 v3’s 18-game tests qualify those version-specific results, not an independent replication. One search trajectory, closely related game tests, tabular baselines, fixed horizons and exact-best-response machinery limit transfer; no fully deep-RL or broad autonomous-research validation. Post-issue experiments are inferred from model generation, not proven by report date. Forecaster/outcome team share Google affiliation. DiscoRL’s December 2024 submission predates issuance and supplies no post-issue credit. Automated discovery already existed; tentative coordination and largest-scale uncertainty remain. Related reformulations add no independent trials; no numerical probability or current endorsement inferred.

Evidence confidence: Moderate for the bounded central parallel-exploration trajectory; limited for general research capability, productivity and long-run work organization.

Original original_primary_interview (2025-02-12 publication; recording date unknown and earlier)
Outcome or context outcome_primary_preprint (2026-02-18 v1) · outcome_primary_preprint_later_version (2026-05-07 v3)
Source chronology_exclusion_primary (received2024-12-11; published2025-10-22) · primary_version_chronology (v1 2026-02-18; v2 2026-02-21; v3 2026-05-07) · new_primary_parallel_exploration_and_limits (2025-09-30 preprint; ICLR2026 final conference version) · new_primary_broader_research_coordination_and_limits (2026-09-17v1, only version in inspected history)
Draft formula inputs

No draft score: grade held / duplicate. No vote, not zero.

Portrait of Gary MarcusGary Marcus11 Feb 2025Chart grade 50 / 100

The new administration will protect businesses and do nothing to protect individuals in AI policy.

AI infrastructure support was advanced, while the signed TAKE IT DOWN Act and FTC implementation supplied concrete individual protections against AI-related abuse.

OutcomeMixedDirectionMixedMagnitudeOverstated absence of protectionTimingNot separately applicable
Gary MarcusEligible

2025-02-11

OutcomeMixedDirectionMixedMagnitudeOverstated absence of protectionTimingNot separately applicable

Further evidence: Marcus acknowledged the deepfake-law exception on May 22, 2025. Mixed observed outcomes: business-favoring executive policy, but a signed and implemented AI-related individual-protection law contradicts the absolute negative component.

Direction: Industry-support direction was borne out; the categorical expectation of no individual protection was not. This is not a net-benefit or whole-administration moral assessment.

Magnitude: The zero-protection wording is too strong. A narrow protective law does not establish comprehensive governance, effective prevention or dominance of individual interests.

Timing: The administration is the setting, not a separate arrival deadline. The counterexample occurs within that term; the full term is not finished, and no timing score is proposed.

Evidence confidence: High for enacted-action counterexample; moderate for broad business-policy direction

Later statement: 2025-05-22 (later qualification): Acknowledges an exception for legislation addressing deepfake pornography; does not explicitly retract the February wording. No erasure of original grade or extra forecast vote.

Original original (2025-02-11)
Outcome or context individual_protection_counterexample (2025-05-19 approved) · implementation_counterexample (May 2026; body references May 19, 2026 compliance deadline) · business_policy_direction_support (2025-07-23)
Source enactment_authentication (2025-05-19) · later_qualification (2025-05-22)
Current edition contribution · Gary Marcus

Graded credit: 50 / 100.

Recency weight
100%
Credit × weight endpoint products
50
Last documented backing
2025-02-11 to 2025-02-11
Timing deduction recorded
0 points

The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.

Preserved draft calculation (superseded)Draft formula inputs
Credit
50 / 100
Recency weight
100%
Weighted credit term
50
Same-claim backing date
2025-02-11 to 2025-02-11

Existing reviewed grade for the original scope; time intrinsic to that scope is retained.

Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.

Date basis

No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing. Marcus’s 2025-05-22 acknowledgment of the deepfake-law exception qualifies/counters the original absolute wording; it is not an explicit same-scope reaffirmation.

Exact calculation inputs
{
  "scoring": {
    "kind": "reviewed_credit",
    "bounds": [
      50,
      50
    ]
  },
  "backingDateBounds": [
    "2025-02-11",
    "2025-02-11"
  ],
  "timingCostBounds": [
    0,
    0
  ],
  "calculated": {
    "creditBounds": [
      50,
      50
    ],
    "weightBounds": [
      1,
      1
    ],
    "normalizedBackingDateBounds": [
      "2025-02-11",
      "2025-02-11"
    ],
    "timingCostBounds": [
      0,
      0
    ],
    "deadlineWaiverCreditBounds": [
      50,
      50
    ],
    "aggregationDisposition": "one admitted claim; uncertainty retained as interval"
  }
}
Portrait of Gary MarcusGary Marcus26 Jan 2025

Expected GPT-5 or a similarly impressive model within the three-year outlook, with the supplier unspecified.

GPT-5 demonstrated substantive successor capability while retaining reliability limits.

OutcomeRightDirectionRightMagnitudeQualitatively supportedTimingWithin original window
Gary MarcusEligible

2025-01-26

OutcomeRightDirectionRightMagnitudeQualitatively supportedTimingWithin original window

Further evidence: Right for the modest positive component that a substantially capable successor would emerge, not merely acquire a new model name. Multiple task evaluations support actual advance.

Direction: Capability advanced, while reliable general intelligence was neither promised by this component nor established.

Magnitude: No numerical gain was forecast. Impressive is qualitative; this is not a verdict on the separate claim that advances become more incremental or leads quickly vanish.

Timing: The observed successor arrived within the surrounding three-year outlook. This is contextual-window credit, not a forecast of its exact release date.

Scope: Low-specificity positive capability forecast. Separate incremental-rate, supplier-lead and AGI predictions remain ungraded here; first-party benchmarks do not establish all-task superiority.

Evidence confidence: Moderate: first-party multidomain evaluations and existing limitations, no independent all-task census

Original original (2025-01-26)
Outcome or context reliability_counterweight (Document August 13, 2025; arXiv deposit December 19, 2025)
Source capability_and_limits (2025-08-07)
Draft formula inputs

No draft score: grade held / duplicate. No vote, not zero.

Portrait of Daniel KokotajloDaniel Kokotajlo7 Jan 2025

Impressive-looking, though flawed, autonomous research and development is likely by 2025.

A primary report published April 10, 2025 demonstrated a substantive manuscript workflow, supporting the central prediction.

OutcomePartly rightDirectionNot separately gradedMagnitudeNot quantifiedTimingWithin original window
Daniel KokotajloEligible

2025-01-07T23:08:38.541Z

OutcomePartly rightDirectionNot separately gradedMagnitudeNot quantifiedTimingWithin original window

Original horizon: 2025

Further evidence: Human selection and quality gaps remain; benchmark dominance is unverified, dependable research replacement is not established, and related 2024 workflows limit novelty. A real manuscript workflow supports the central component, not benchmark dominance or dependable research replacement.

Direction: Not separately graded in the historical record.

Magnitude: No separately documented rationale is available.

Timing: The April 10, 2025 report falls within the original window for the supported workflow component.

Scope: The illustrative RE-Bench superiority claim remains unresolved, not an observed miss. Treating it as essential leaves the full conjunction unjudgeable. The result is a selected-run report, not a general autonomous-research success rate.

Evidence confidence: Not separately rated.

Original Original
Outcome or context Outcome
Draft formula inputs

No draft score: grade held / duplicate. No vote, not zero.

Portrait of Jensen HuangJensen Huang7 Jan 2025Chart grade 75 / 100

Expects deployment of software-engineering, digital-marketing campaign-management and customer-service agents during 2025.

Existing dated coding and customer-service workflow evidence, plus the newly dated Advolve campaign-management case, support real deployment in all three roles during 2025.

OutcomePartly rightDirectionRightMagnitudeUnresolvedTimingWithin original window
Jensen HuangEligible

2025-01-07

OutcomePartly rightDirectionRightMagnitudeUnresolvedTimingWithin original window

Further evidence: The result is bounded and partly continuation of existing use, not workforce replacement or an established industry take-off. Approximately right for the frozen three-role deployment conjunction: all roles now have actual tool-using-work evidence, including the previously missing campaign-management predicate. First-party accounts and human oversight limit strength; broader take-off interpretation remains unmeasured.

Direction: Operational examples support enterprise agent use across the named roles.

Magnitude: No prevalence threshold or labor-cost share was fixed; selected cases do not establish broad adoption or replacement.

Timing: Reports establish use during the stated year, not the date of first-ever deployment. Advolve may have started preissue, reducing novelty rather than supplying a new invention date.

Scope: Three-role deployment conjunction; tool-using enterprise work with humans allowed. Broad take-off language has no specified scale. NVIDIA internal plans and all-engineer policy are separate, not scored.

Evidence confidence: Moderate for bounded three-role deployment; first-party reports and prior-use baseline limit inference. Broader adoption magnitude remains unresolved.

Original original (2025-01-07 event)
Outcome or context marketing_outcome (2025-01-28 publisher-index date) · coding_outcome (2025-10-06) · service_outcome_and_limits (2025-04-10)
Source marketing_date (2025-01-28 listed)
Current edition contribution · Jensen Huang

Graded credit: 75 / 100.

Recency weight
100%
Credit × weight endpoint products
75
Last documented backing
2025-01-07 to 2025-01-07
Timing deduction recorded
0 points

The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.

Preserved draft calculation (superseded)Draft formula inputs
Credit
75 / 100
Recency weight
100%
Weighted credit term
75
Same-claim backing date
2025-01-07 to 2025-01-07

Existing reviewed grade for the original scope; time intrinsic to that scope is retained.

Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.

Date basis

No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.

Exact calculation inputs
{
  "scoring": {
    "kind": "reviewed_credit",
    "bounds": [
      75,
      75
    ]
  },
  "backingDateBounds": [
    "2025-01-07",
    "2025-01-07"
  ],
  "timingCostBounds": [
    0,
    0
  ],
  "calculated": {
    "creditBounds": [
      75,
      75
    ],
    "weightBounds": [
      1,
      1
    ],
    "normalizedBackingDateBounds": [
      "2025-01-07",
      "2025-01-07"
    ],
    "timingCostBounds": [
      0,
      0
    ],
    "deadlineWaiverCreditBounds": [
      75,
      75
    ],
    "aggregationDisposition": "one admitted claim; uncertainty retained as interval"
  }
}