November 2026 · Current score overlay
PredictionBench
Every claim. Its grade. The evidence.
Compare people Current ranking · 25 people
Current edition · 164 scored claims
Historical archive counts · separate from current scored-claim totals
Outcome columns count eligible claims only. “Partial/mixed” is not full success.
| Person | All | Eligible | Excluded | Pending | Right | Partial/mixed | Wrong/mostly wrong | Unresolved | No outcome grade |
|---|---|---|---|---|---|---|---|---|---|
| 13 | 10 | 3 | 0 | 0 | 2 | 1 | 3 | 4 | |
| 13 | 8 | 5 | 0 | 2 | 4 | 0 | 2 | 0 | |
| 11 | 9 | 2 | 0 | 5 | 4 | 0 | 0 | 0 | |
| 20 | 18 | 2 | 0 | 1 | 11 | 2 | 4 | 0 | |
| 13 | 13 | 0 | 0 | 1 | 2 | 0 | 1 | 9 | |
| 9 | 9 | 0 | 0 | 2 | 5 | 1 | 1 | 0 | |
| 18 | 16 | 2 | 0 | 3 | 10 | 0 | 3 | 0 | |
| 23 | 21 | 0 | 2 | 4 | 10 | 3 | 3 | 1 | |
| 31 | 21 | 10 | 0 | 5 | 5 | 2 | 9 | 0 | |
| 11 | 10 | 1 | 0 | 1 | 7 | 1 | 0 | 1 | |
| 61 | 53 | 5 | 3 | 17 | 24 | 4 | 5 | 3 | |
| 13 | 11 | 1 | 1 | 2 | 8 | 0 | 1 | 0 | |
| 13 | 10 | 3 | 0 | 3 | 6 | 1 | 0 | 0 | |
| 19 | 18 | 1 | 0 | 1 | 8 | 1 | 8 | 0 | |
| 11 | 9 | 2 | 0 | 1 | 6 | 0 | 2 | 0 | |
| 21 | 21 | 0 | 0 | 2 | 8 | 4 | 7 | 0 | |
| 11 | 10 | 1 | 0 | 0 | 7 | 0 | 3 | 0 | |
| 7 | 5 | 2 | 0 | 0 | 5 | 0 | 0 | 0 | |
| 11 | 10 | 1 | 0 | 0 | 4 | 1 | 4 | 1 | |
| 23 | 23 | 0 | 0 | 2 | 13 | 5 | 3 | 0 | |
| 13 | 13 | 0 | 0 | 2 | 9 | 0 | 1 | 1 | |
| 17 | 15 | 2 | 0 | 3 | 9 | 2 | 1 | 0 | |
| 15 | 14 | 1 | 0 | 1 | 5 | 0 | 8 | 0 | |
| 25 | 19 | 6 | 0 | 1 | 12 | 1 | 5 | 0 | |
| 13 | 11 | 2 | 0 | 0 | 10 | 0 | 1 | 0 |
Current weighted aggregates · 424-record edition
164 scored claims. Ranges reflect uncertain inputs, not statistical confidence intervals.
| Person | Scored | Current weighted credit bounds | Confidence of Scoring | Weight mass |
|---|---|---|---|---|
| Gary Marcus | 23 | 86.97543845872588 | 97.08326384752829 | 22.329150684931506 |
| Ilya Sutskever | 7 | 85.67222678519666–85.68526691252042 | 64.73502935420744 | 4.531452054794521–4.536876712328768 |
| Andrej Karpathy | 4 | 85.50445245541576–85.59169033748977 | 45.525479452054796 | 2.27627397260274–2.295178082191781 |
| Demis Hassabis | 7 | 84.32964044049356–84.46680039850291 | 58.14324853228963 | 4.070027397260274–4.12986301369863 |
| Jürgen Schmidhuber | 3 | 81.05061646486428–81.09764504742996 | 39.64273972602739 | 1.9821369863013698–1.987068493150685 |
| Rodney Brooks | 9 | 80.86984443486384–80.8847814185581 | 67.78447488584476 | 6.100602739726027–6.105369863013699 |
| Andrew Ng | 6 | 80.81456500874322–81.08611683581549 | 69.46027397260274 | 4.1676164383561645–4.2274520547945205 |
| Daniel Kokotajlo | 9 | 78.2738084345479–83.75390290148448 | 90.22831050228312 | 8.12054794520548 |
| Stuart Russell | 3 | 76.88899929615368–76.97844846277263 | 25.27232876712329 | 1.2636164383561646–1.3234520547945205 |
| Geoffrey Hinton | 6 | 76.00800921608425–76.05112541962467 | 49.78356164383562 | 2.987013698630137–2.9965479452054793 |
| Ajeya Cotra | 1 | 75–100 | 19.68109589041096 | 0.9840547945205479 |
| Jensen Huang | 3 | 75 | 45.057534246575344 | 2.252876712328767 |
| Nick Bostrom | 3 | 75 | 15.465205479452056 | 0.7732602739726028–0.902958904109589 |
| Noam Shazeer | 1 | 75 | 19.69753424657534 | 0.9848767123287671–0.9898082191780821 |
| Yann LeCun | 8 | 75 | 67.6041095890411 | 5.408328767123288–5.447945205479452 |
| Yoshua Bengio | 5 | 75 | 55.363287671232875 | 2.768164383561644 |
| Sam Altman | 6 | 72.28524773323021–72.29009067010034 | 85.0054794520548 | 5.100328767123288–5.1067397260273975 |
| Eliezer Yudkowsky | 11 | 69.61989373580258 | 51.751930261519306 | 5.692712328767123 |
| Dario Amodei | 4 | 64.84295930049278 | 66.05041095890411 | 3.302520547945205 |
| Ray Kurzweil | 10 | 64.82266769468002 | 11.370958904109589 | 1.137095890410959 |
| Paul Christiano | 3 | 61.24288563577376 | 41.69753424657534 | 2.084876712328767 |
| Kai-Fu Lee | 11 | 56.96277733979052–57.99048316251831 | 44.229140722291405 | 4.8652054794520545 |
| François Chollet | 5 | 43.86151093231629 | 83.90356164383562 | 4.195178082191781 |
| Elon Musk | 13 | 43.761335751627016–43.99414709075982 | 63.20084299262381 | 8.216109589041096–8.277260273972603 |
| Ben Goertzel | 3 | 43.35080915445753–44.92333242333242 | 22.88876712328767 | 1.1444383561643836–1.2042739726027398 |
Current edition method
Current published score: each scored claim contributes once; the headline is the lower bound of the weighted mean credit.
Qualitative grades use reviewed credits of 0, 25, 50, 75, or 100. Stated binary probabilities use 100 × (1 − (p − y)²) against their original event/window. That event's time is already part of the claim; no extra timing penalty is applied.
Formula, dates, and interpretation
Weighted credit: Σ(credit × recency weight) ÷ Σ(recency weight). Where credit or backing dates are uncertain, the score bounds are optimized over the reviewed intervals. Individual endpoint products are not additive score bounds.
Recency weight: max(10%, min(100%, 100% − 6 percentage points × (age − 3 years))). Age is fractional Gregorian calendar age. Weight uses the earliest documented prospective backing of the same claim, with upper/lower bounds preserved; unknown dates use the engine's reviewed [10%, 100%] bound.
Confidence of Scoring: 100 × lower-bound weight mass ÷ max(5, scored-claim count). It describes sample/date weight, not probability that the score is correct.
Public rank: sort by the unrounded lower score bound; values equal at eight decimal places (ties-to-even) share a rank. The score is a descriptive archive result, not a percent-correct estimate or a universal measure of forecasting skill. It does not adjust for question difficulty.
Edition: frozen supplied 424-source-record / 164-scored-claim edition; as of 2026-11-01, outcome cutoff 2026-10-27T04:43:05Z. The surrounding 435-record audit ledger, its source material and authored verdicts are preserved. Its old draft aggregates and formula are superseded here.
Filters & tools
Eligible claims
Geoffrey Hinton23 Feb 2026AI substantially better than people at persuasion in roughly ten years, against an already strong baseline.
Randomized April–May 2026 text conversations favored AI over professional canvassers.
OutcomePartly rightDirectionRightMagnitudePartly supportedTimingWithin original window
23 February 2026 publisher episode; recording day unverified, adjacent official-video publication February 22.
Further evidence: Study 3 showed larger immediate policy-agreement change; Study 4’s public Claude Opus 4.6 elicited 10.8p more from a £1 donation bonus (95% CI 6.4–15.1). Bounded comparative capability, not generalized superiority or control.
Direction: Matched human comparisons support direction.
Magnitude: Substantial local advantage; broader superiority only partly supported.
Timing: April–May 2026 observations fall inside the approximate decade; preissue superiority rules out first-arrival or measured-progress credit.
Scope: Study 3: April 15–29; Study 4: April 30–May 13; June 15 preprint. Paid English-speaking adult completers; identities concealed, human matchmaking caused differential completion. Short, low-stakes text interaction, not durable beliefs, elections, broad mobilization or face-to-face persuasion. Earlier November–December 2025 studies are baseline; speed/length matching erased AI’s advantage. Changing models/tasks prevent longitudinal-gain inference. Not threefold total fundraising. Stronger smarter-agent/control-risk reading remains unresolved. Short paid experiments and model/platform effects; not broad, durable persuasion or loss-of-control evidence.
Shared evidence: Shared Chollet outcome work and investigators/platform, not independent replication. One persuasion lineage; weak-information continuation, not exceptional foresight.
Evidence confidence: Moderate for bounded comparative capability; lower for broader interpretation.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Ajeya Cotra14 Jan 2026≈80%: AI can solve hardest 2026 IMO problem at human-comparable inference cost by year-end.
Fixed July 23, 2026 Fable 5 artifacts contain natural-language solutions for P3 and P6.
Probability≈80%2026-01-14EventOccurredconditionalBrier loss≈0.04lower is better
2026-01-14
Score condition: Conditional y=1 accepts stated budget and documented retail token estimates. Human fees, failed-stream charges and external reviewer/orchestrator costs remain unverified; full-cost alternative unscored.
Probability precision: Approximate, item-specific—not group-derived. The ≈ marks approximate probability and losses, not an exact elicited point.
Resolution confidence: Moderate conditional confidence; stricter alternative unresolved.
Proper score: 2026-01-14: p(event)≈80%; outcome=1 (under the stated score condition); Brier≈0.04; log loss≈0.2231436 nats.
Outcome dates: 2026-07-23
Interpretation: Lower Brier and log loss are better. Revisions concern the same event, not additional forecasts. One event does not establish calibration or overall reliability.
Further evidence: An independent AI static review found no substantive gap in either proof and matched each proof byte-for-byte to its final cost-bearing logged write. Logged-token estimates, including failed attempts, are $23.45 for P3 and $9.11 for P6, totaling $32.56. All four harness rates match the provider legacy price table; dated launch and successor announcements corroborate input/output and cache-read pricing. This supports conditional y=1. Human fees, unlogged or failed-stream charges and reviewer/orchestrator inference costs remain unverified. These are not invoices or human-certified proofs. Numeric probability forecast: event resolution and proper scores are separate; no categorical win.
Scope: One event. P3 is the hardest candidate identified by a dated expert assessment; P6 is retained as additional difficult-problem corroboration, not a second forecast. No official IMO participation or medal is claimed. No game-specific generic-harness requirement. January edited; original-day wording unverified.
Evidence confidence: Moderate conditional event resolution; separate independent AI proof review and primary pricing support, with budget completeness and human-fee uncertainty explicit.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Ajeya Cotra14 Jan 2026≈80%: generic-scaffold, no-special-fine-tuning Pokémon-like play comparable to a typical ten-year-old by end-2026, at human-comparable inference cost.
One selected PokéBench Red run reached its first badge in 444 turns/102.8 minutes, demonstrating navigation/backtracking, combat, purchases, healing and recovery; audited marginal API cost: $7.623972.
Probability≈80%2026-01-14EventOccurredconditionalBrier loss≈0.04lower is better
2026-01-14
Score condition: Conditional y=1 accepts bounded skills/recovery and practical marginal-cost comparison. Broader sustained/across-title competence or matched Red human economics remain unresolved, unscored; no categorical win or calibration.
Probability precision: Approximate. The ≈ marks approximate probability and losses, not an exact elicited point.
Resolution confidence: Moderate conditional confidence; skill breadth and imperfect human comparator remain judgment-sensitive.
Proper score: 2026-01-14: p(event)≈80%; outcome=1 (under the stated score condition); Brier≈0.04; log loss≈0.2231436 nats.
Outcome dates: Run October 12; public October 20, 2026. October 29 video-link excluded.
Interpretation: Lower Brier and log loss are better. Revisions concern the same event, not additional forecasts. One event does not establish calibration or overall reliability.
Further evidence: Explicit probability record: conditional event resolution and approximate proper scores are separate; no categorical win or extra outcome vote.
Scope: One game/early span, not full-game/broad-title or age-matched Red equivalence. RAM-based settling synchronizes screenshots; model action decisions use screenshots, notes/history, without RAM, map or extracted screen-text input. Stricter no-tailoring reading unresolved. Standard model, no reported game fine-tuning; ordinary pretraining allowed, universal training audit unclaimed. ≈70 calibration calls/engineering are separate development overhead; local power/hosting unpriced. All 444 records structurally audited; selected transitions inspected, not full visual replay. Mistakes/blackouts occurred; project report, not independent replication. Official tariffs match; marginal API cost is not an invoice/all-in bill. Emerald first-gym average 1:22:05 is context, not measured Red parity. Historical paid-play $13/$15–20 per hour versus $5 for 1–1.5 hours: heterogeneous, not 2026 same-game quotes. Break-even 35.19/30.50/22.87 minutes at $13/$15/$20 hourly are sensitivity, not Red observations/pass thresholds; lower rates sustain stricter uncertainty. No matched pre-January baseline or first-arrival credit. August acceptance informs intent, not independent proof or a fifty-hour requirement. Deadline: December 31, 23:59 Pacific; early positive allowed. Post-cutoff video link excluded; other summary fields unchanged.
Shared evidence: One conditional probability event, not separate votes for model, run, badge, code or comparator; prior other-source holds remain historical.
Evidence confidence: Moderate conditional resolution. Same-run substantive play, pinned generic decision scaffold, actual badge and fully reconciled API accounting support the practical interpretation; broader skill and human-cost comparability remain judgment-sensitive.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Ajeya Cotra14 Jan 2026≈80%: brief-prompt AI can make ≈4-minute, ≥2-character video with somewhat coherent plot and no glaring visual incoherence/degeneracy by end-2026, at human-comparable inference cost.
V2 (October 25, 2026): outputs from all 50 prompts were human-rated, including seven 10/30-minute dramas; pooled eight-metric mean was 3.52/5, not a per-film pass rate.
Probability≈80%2026-01-14EventOccurredconditionalBrier loss≈0.04lower is better
2026-01-14
Score condition: Conditional y=1 accepts same-population assessment, long dramas and practical estimates against original task/budget interpretation. Exact per-film quality/matched human-cost sensitivity: unresolved, unscored—not mandatory.
Probability precision: Approximate. The ≈ marks approximate probability and losses, not an exact elicited point.
Resolution confidence: Moderate conditional confidence; revised-study and pooled-score limits.
Proper score: 2026-01-14: p(event)≈80%; outcome=1 (under the stated score condition); Brier≈0.04; log loss≈0.2231436 nats.
Outcome dates: Generation/rating days unreported; publication dates in Outcome and Scope.
Interpretation: Lower Brier and log loss are better. Revisions concern the same event, not additional forecasts. One event does not establish calibration or overall reliability.
Further evidence: Explicit probability record: event resolution and approximate proper scores are separate; no categorical win.
Scope: Deadline: 2026-12-31, 23:59 Pacific. Training/development excluded. No commercial-polish, universal-success, single-call, personal-review, invoice or independent-replication requirement; automated editing allowed. January wording retained, not refetched; edit/history limits remain. Early attainment counts; year-end availability unguaranteed. Approximate-duration capability, not a logged four-minute run. Twenty paid raters assessed whole-drama coherence and boundary continuity; 43 outputs were ≈3, five ≈10, two ≈30 minutes. V1 (May 21, 2026): 20 unpaid raters, segment-level flow; corpus/judges/protocol changed. One revised study, no backward transfer or replication. Static ≈30-minute hospital/romance example supports recurring characters/plot, not full-motion quality. Full-motion supplement uninspected: exact authorized GET returned 403; all recovery stopped. Long outputs rated; earlier “unscored” suggestion overstated and retired. API $25–27/min includes retries: modeled four minutes $100–108 (alternative retry reading $133.60); demonstrated ten-minute duration, modeled API $250–270 ($334). Local compute extra; typical ten-minute pipeline 74–90 minutes, one 48GB A6000; conservative 1.5 GPU-hours occupancy context, not a meter or filmwise worst-case bound. Estimates, not invoices; maximum three retries are not observed retry counts. A funded five-minute, two-character student drama budget (£750; listed items £730, actors £250) planned a one-to-two-day shoot; funding closed April 10, 2026. March shoot/May release were plans, not verified completion, quality or full crew wages. Ordinary cost comparability is contextual—not guaranteed savings, cheapest-market floor, exact currency conversion or duration-prorated same-film quote. Undated four-minute, two-character short reportedly cost under £100 cash; unpaid labor/equipment/editing unspecified. Not pre-cutoff price proof, a human minimum or a basis for combining incompatible budgets.
Evidence confidence: Moderate conditional resolution. Same-population human assessment and practical production estimates support the original low bar, with individual-film quality and accounting uncertainty explicit.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Ben GoertzelJan 2026 · range2026: research/personal assistants integrate lasting goal memory, project tracking, autonomous action and anticipation.
Bounded evaluations demonstrate memory-linked execution and anticipation, not verified everyday integrated assistance. Whole outcome unresolved.
OutcomeUnresolvedDirectionRightMagnitudePartly matched scopeTimingFuture window open
January 2026; day unknown
Further evidence: Conjunction unresolved; simulated integration insufficient.
Direction: Prior interaction helps agents anticipate unstated requirements and produce artifacts or tool actions; memory ablation weakens this behavior.
Magnitude: Functional analogy; structure undefined and unverified.
Timing: Published before cutoff; 2026 remains open.
Scope: π-Bench (May 2026) uses 100 tasks in five 20-session workflows, simulated users/apps and one Nanobot-derived scaffold. Hidden intents directly completed: 56.84% for GPT-5.4, 60.56% for Opus 4.6; these are intent fractions, not whole-task success. Checklist completeness reaches 67.6%, not a pass rate. History removal reduces proactive scores 9.5 points on average. Proactivity also credits questions; simulated users eventually reveal missed requirements for reactive recovery. Model grading and reported expert audits are not independent replication. Proactivity-Gym (September 2026) tests 23 model/harness combinations in ten 7–10-simulated-day scenarios. Best task-capability score is 65.1, temporal allocation 51.7% and intervention-depth alignment 52.4%; metrics differ. Other models score below 20% on temporal allocation. Thirty people rated prepared scenarios/logs, not lived deployments. Correct actions can violate preferences and trust; release is promised, not verified. PersonalAlign uses 91 users’ 60-day Android records, not a deployed-agent trial. Preference-sensitive execution and proactive suggestions are separate modes: conditional success 42.3 versus 26.6 baseline; suggestion false alarms 49%. Suggestions are not external autonomous action. Cross-chat memory existed in 2024, with broader past-conversation reference in April 2025; no first-invention credit. Do not combine separate systems into a completed conjunction or impose arbitrary perfection. No separately dated current endorsement is inferred.
Evidence confidence: Moderate for bounded functional direction; whole everyday integrated capability unresolved.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Ben GoertzelJan 2026 · range2026: symbolic grounding enables reliable, uncertainty-aware quantitative, relational and graphical business reasoning.
VeriFin realizes bounded numerical-business QA with symbolic verification and abstention; general dependability remains unverified.
OutcomePartly rightDirectionRightMagnitudePartly matched scopeTimingWithin original window
January 2026; day unknown
Further evidence: Qualified central capability; full-domain reading unresolved.
Direction: Matched candidate-pool comparisons support improved accepted-answer reliability; continuation, not invention.
Magnitude: Domain breadth partial.
Timing: In-window centrally; broader endpoint open.
Scope: VeriFin is a preprint: first submitted 10 August 2026, evaluated v3 dated 23 October. XBRL facts, authorized formulas and SMT checks ground interpretation. Tests use 600 constructed filing questions and selected 67 FinanceBench/403 TAT-DQA numerical questions, excluding qualitative questions. Nineteen FinanceBench-specific definitions and XBRL selection limit generalization; withheld labels are not an independent leakage audit. Qwen3-30B correctly accepts 304/600, falsely rejects 63 correct answers and abstains twice; zero observed false accepts covers selected evaluable cases, not universal safety. Its 99.7% decision coverage is not answer coverage; precision interval 98.8–100%. FinanceBench: 24/67 correct accepts, 15 abstentions, eight false rejections; precision interval 85.8–100%. GPT-5.5 accepts 560/600, with small gains over existing verifiers. Unresolved-correctness cases are excluded from precision/accuracy, not coverage. Formalization errors remain; checks depend on correct formalization. Repair subsets are unpaired; inconsistent GPT-5.5 FinanceBench accuracy is unused. No independent replication or production-benefit evaluation. QueryProof tests 80 synthetic warehouse tasks: routed success 53.7% versus 30% baseline, but 13 of 37 returned answers wrong. Abstention/ambiguity remain weak. Prior test exposure persists despite phrase removal; one annotator, correlated templates and cluster-bootstrap intervals spanning zero limit inference. This does not refute every symbolic system. December 2025 VERAFI already combined financial tools and neurosymbolic policy guidance; no first-invention credit or post-issue performance claim. Graphical/arbitrary-relational coverage unverified. No added perfection/profit requirement. No separately dated current endorsement is inferred.
Evidence confidence: Moderate for bounded numerical business capability; lower for broad business-data generalization.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Ben GoertzelJan 2026 · rangeAI contributes to longstanding open mathematics during 2026.
May 2026 primary mathematical papers verify AI-generated contributions resolving longstanding unit-distance and primitive-set conjectures.
OutcomeRightDirectionRightMagnitudeNot quantifiedTimingWithin original window
January 2026; day unknown
Further evidence: Human exposition, checking and extensions remain explicit. Verified contributions to decades-old conjectures meet the asserted target without relying on contest scores or recovered prior literature.
Direction: AI made new mathematical contributions beyond predesigned contest problems.
Magnitude: No required numeric/Millennium threshold.
Timing: May results are in-window.
Evidence confidence: high for contributions and timing; no claim of universal reasoning reliability
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Ben GoertzelJan 2026 · rangeIn 2026, AI connects short clips into coherent long animation, easing production.
CHIEF’s matched novice-creator workflow supports AI-coordinated long-form continuity and local audience-perceived coherence.
OutcomePartly rightDirectionRightMagnitudePartly supportedTimingTiming unresolved
January 2026; day unknown
Further evidence: A²RD supports minute-scale continuity; producer accounts describe feature animation by small core teams. Qualified central enablement supported; stricter full labor-saving conjunction unresolved.
Direction: Same-workflow evidence supports direction, not invention or measured post-January improvement.
Magnitude: Comparative artist-team/months savings, broad reliability and wider population effects remain unmeasured.
Timing: June 2026 disclosure, not exact runs or first attainment; no arrival credit. The stronger-reading year remains open.
Scope: CHIEF is researcher-reported novice production/local evaluation, not independent, randomized or blinded replication. Humans direct, rewrite, select and approve; comparison jointly changes human revision and AI support. Headcount, sessions and working time are unreported; selected revisions are not a full labor ledger. No personal film/frame inspection, feature-length or autonomous-production inference. A²RD: Human-tested one-minute single-scene samples support bounded continuity; ten-minute demonstrations relied on model judging. Poq Mher’s producer describes 23 core crew, including 13 AI creators; inconsistent premiere wording prevents an exact release date. SPEED EFFECT reports 117 minutes and three production staff, not all contributors; humans scripted, directed and edited. Its stated calendar date conflicts with its weekday label. Generation-cost claims are not total budgets. No independent viewing, film-quality verification or controlled labor study. Co-Director tests twelve-second outputs, not long films. Undated project examples add no timing credit. Pre-2026 long-video systems limit novelty; no first-ever credit.
Shared evidence: Shared source; not independent.
Evidence confidence: Moderate for the bounded central-functionality interpretation; lower for comparative labor, broad production quality and timing.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Ben GoertzelJan 2026 · range2026: agents begin substantive organizational governance/management assistance.
Andon’s April launch and August report describe two agents hiring, contracting, purchasing and coordinating shifts for five employees at two businesses.
OutcomePartly rightDirectionRightMagnitudePartly supportedTimingWithin original window
January 2026; day unknown
Further evidence: Useful hiring and shift coverage coexist with purchasing errors, closures, redundant work, inconsistent pay, fabricated arrangements, privacy problems and human-prevented overlong schedules. Qualified emergence; better-informed strategy and full-conjunction reading unresolved.
Direction: Successful actual work supports assistance despite serious errors.
Magnitude: Two small monitored businesses; no superiority or adoption estimate.
Timing: In-window; first-crossing/full-year verdict unresolved. Year remains open.
Scope: One operator’s supervised experiments, not independent replications or prevalence estimates. Humans remained legal employers, guaranteed pay, monitored and overrode decisions. Models changed; counterfactual replays are not extra deployments. No matched managerial-quality comparison. A controlled strategy study found no full-sample gain but an experienced-manager subgroup improvement; pre-2026 acceptance prevents new-emergence credit. Charity facilitation improved neither consensus nor equity significantly. OECD cases are selected testimony without verified intervention dates or quantitative comparisons; undated NVIDIA figures add no timing support. Greater DAO/open-source impact: possible, not mandatory.
Evidence confidence: Moderate for qualified central emergence; low for breadth or strategic superiority
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Ben GoertzelJan 2026 · range2026: humanoids improve reliable fetching, door-opening and basic help across human environments.
Figure reported three learned household behaviors across 30 unseen homes in September 2026. Whole outcome unresolved.
OutcomeUnresolvedDirectionRightMagnitudeUnresolvedTimingFuture window open
January 2026; day unknown
Further evidence: Complete-task success was 56%, versus 9% for an otherwise matched model without Index pretraining. This supports progress, not the entire broad reliability claim. Reliability unresolved; no exhaustive checklist.
Direction: Blind trials show concrete generalization in unseen homes and reduced task-specific data needs compared with the earlier system. This is more than an edited single successful video.
Magnitude: 56% completion and corresponding failures must remain visible; the 9% comparator is an ablation, not a measured January fieldwide baseline.
Timing: Positive progress occurred within 2026; year remains open.
Evidence confidence: High for the developer-reported figures and rubric; moderate for the progress inference; no independent replication established.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Ben GoertzelJan 2026 · range2026: meaningful voice translation reaches underserved languages.
French–Mooré speech components improved and were integrated; translation fidelity and accessible community deployment remain unverified. Whole outcome unresolved.
OutcomeUnresolvedDirectionRightMagnitudeExtent unresolvedTimingFuture window open
January 2026; day unknown
Further evidence: Full fidelity and access unresolved.
Direction: The French–Mooré integrated pipeline and native-speaker-tested adaptation are substantive matched progress, not a generic 70-language feature count.
Magnitude: No measured connectivity reach. Paper explicitly says computing demands are unsuitable for low-resource technological environments.
Timing: Public technical result appeared during 2026 before cutoff; fieldwork dates unknown. Year remains open.
Evidence confidence: Moderate for matched technical direction; low for community deployment.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Yann LeCunJan–Jun 2026 · rangeFor a long time, AI science remains human-directed assistance, allowing autonomous exploration.
October 2026 First Proof testing generated substantive proofs for human-selected research questions without further interaction. Whole outcome unresolved.
OutcomeUnresolvedDirectionPartly rightMagnitudePartly supportedTimingTiming unresolved
2026 Winter/Spring (issue interval; exact date unknown)
Further evidence: Expert review accepted selected alternative arguments; citation and exposition weaknesses remained. These support partial direction, not the predicted persistence; whole outcome unresolved.
Direction: Compatible division of work, not necessary human control.
Magnitude: Selected proof tasks, not all science or field-wide prevalence.
Timing: October work postdates conservative issue interval; no precise deadline or timing hit.
Scope: Benchmark direction was imposed; the long-lasting relationship remains unestablished. Questions had known unpublished solutions; this does not establish new-to-humanity discovery. Very low-information continuation. One problem was corrected and rerun. Native duration is required; this correction adds no ongoing-lab partnership condition.
Evidence confidence: Moderate for bounded task-level delegation; low for extrapolating to natural field-wide or enduring practice. Very low predictive information against preexisting human-directed AI research.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Geoffrey Hinton30 Dec 2025GPT-6 would arrive within roughly one or two years and improve on original GPT-5; a large gain was only possible.
GPT-6 Astra was publicly released 3 September 2026.
OutcomePartly rightDirectionRightMagnitudePartly supportedTimingWithin original window
30 December 2025 publication; interview recording day unknown.
Further evidence: The 22 October text-preference table scored Astra (Max) 1476±6 (14,076 votes), original GPT-5 (High) 1435±5 (31,712), and GPT-5 Chat 1426±4. GPT-5.6 Sol ranked above Astra. Qualified arrival/improvement conjunction under a bounded preference proxy.
Direction: Direct original-GPT-5 preference comparison supports improvement.
Magnitude: No numerical gain forecast or calibrated cross-domain magnitude; optional large gain uncredited.
Timing: Release and comparison fall within the approximate 2026–2027 forward horizon. No mandatory one-year lower bound, exact first crossing or timing-error estimate; literal delayed-arrival reading remains an alternative.
Scope: Preference-based, unequal reasoning settings; not universal superiority. A predictable continuation, with no numerical improvement promised. Exact interview recording date unknown; publication date is used. GPT-5.6 ranks above Astra in the same table. Self-selected prompts/preferences are neither semantic accuracy nor representative population benefit. Developer results use later GPT-5-family comparators and changed settings; no transitive original-GPT-5 inference. Mixed safety results and a September 22 HealthBench configuration correction limit generalization. The navigation study compares different harnesses/inputs/subsets and earns no grade credit. Original attribution is the interviewer-published dialogue, not its AI summary; audio was not independently checked. No current endorsement, exceptional foresight or separate launch/improvement votes.
Evidence confidence: Moderate for qualified successor/improvement conjunction; low for magnitude outside evaluated preference domain
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Sam AltmanOct 2025 · rangeQualified goal: Intern-level AI assistance meaningfully accelerates OpenAI research under human direction, with substantial inference compute allowed.
OpenAI reported reaching its research-intern goal by September 6, 2026, with internal agent use and more experiments.
OutcomeRightDirectionNot separately gradedMagnitudeNot separately gradedTimingWithin original window
Event reported October 28, 2025; transcript page dates video October 29, 2025. Preserve one-day publication/upload distinction.
Original horizon: By September 2026; month precision. Preserve actual dated use and first public report separately. Earliest qualifying use may predate announcement but cannot be invented.
Further evidence: Human steering fits the target; the first-party measurements are preliminary, incomplete and not independently replicated, with compute growth confounding the experiment trend. Concrete supervised research assistance matches the intern-level target; required human steering is not a target shortfall.
Direction: Not separately graded in the historical record.
Magnitude: Not separately graded in the historical record.
Timing: The September 6 report fits a September month-level horizon; a strict September 1 deadline remains unresolved.
Scope: Earliest actual attainment is unknown. Success analyses exclude uncertain outcomes and small samples; “researcher” includes support roles. Code volume is not research progress. This is not autonomous project leadership, replacement of all researchers, or fulfillment of the separate March 2028 researcher goal. This was a qualified goal and forecast, not an unconditional promise.
Evidence confidence: Not separately rated.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Sam AltmanOct–Nov 2025 · rangeTentatively expects ChatGPT to reach about 30% of people worldwide weekly within a year.
OpenAI reported 1.2 billion weekly people on 5 October 2026, well below the target scale: a qualified near-anniversary inference, not exact-week falsification.
OutcomeMostly wrongDirectionRightMagnitudeOverestimatedTimingTiming unresolved
17 October 2025 live event; 5 November host transcript.
Original horizon: One year from the event, approximately October 2026; publication does not reset it.
Direction: Usage grew beyond the original roughly 10% worldwide baseline.
Magnitude: Scale overestimated; no precise population conversion or acceptance band inferred.
Timing: Unresolved: measurement weeks unknown; 5 October was 12 days early. The 21 October more-than-1.2-billion disclosure is a lower bound, not a ceiling or dated miss.
Scope: Assumes contemporaneous reporting and no extraordinary twofold pre-deadline surge. Rounded issuer counts have unknown deduplication; disclosures are not independent. Target: worldwide weekly people, not accounts, monthly traffic or all OpenAI products. Tentative 30% is a share, not probability. Host dates recording; audio unchecked; organizer confirms only event window. A transcript-date November 2026 horizon stays open at cutoff. No later same-scope endorsement.
Evidence confidence: Moderate for reported-scale shortfall; lower for exact-week outcome, given company measurement and rounding limitations.
Draft formula inputs
Not in this 424-record calculation edition. No score assigned here.
Yoshua Bengio9 Oct 2025Rapid task-capability growth is likelier to continue than stall in six months.
METR software-task gains ran through 16 March 2026.
OutcomePartly rightDirectionRightMagnitudePartly supportedTimingTiming unresolved
2025-10-09 publication; recording date unknown
Further evidence: AISI’s newer checkpoint, received after 13 April and reported by 13 May 2026, supports continuation beyond the earlier interval gap. Qualified continuation, not universal or indefinite growth.
Direction: Technical-task capability improved after issuance.
Magnitude: Partial rapid-progress support; no exact doubling rate.
Timing: Recording date unknown; no hard deadline or timing win.
Scope: Narrow benchmarks and uncertain human-time calibration; no exact growth-rate, all-job or AGI credit. Success thresholds: AISI cyber 80%, METR software 50%; no numerical pooling. AISI’s human baselines are partly estimated; saturation and longer tails limit precision. Statistical reanalysis retains observed growth but questions equal-interval interpretation and long extrapolation; this is shared-data reanalysis, not a new capability experiment. Shared METR findings are not independent replications.
Evidence confidence: Moderate for qualified continuation; benchmark scope, human-time measurement and saturation limit transfer.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Sam Altman10 Jun 2025AI systems will likely generate novel insights during 2026.
A May 2026 mathematical manuscript verifies an AI-generated counterexample to a longstanding discrete-geometry conjecture.
OutcomeRightDirectionRightMagnitudeNot quantifiedTimingWithin original window
2025-06-10
Further evidence: Human checking and exposition are explicit. The bounded existence claim is met by a verified novel mathematical contribution, rather than a contest score or rediscovery.
Direction: A substantive new research result supports the predicted capability.
Magnitude: No number of insights, discipline coverage or reliability threshold was specified.
Timing: The verified result appeared in the specified 2026 year, after the June 2025 forecast.
Shared evidence: Related to A-C026 and BG-C031. This row reuses the mathematical outcome evidence from BG-C031; it is not an independent success.
Evidence confidence: High for bounded novelty and year; not a claim about broad research reliability.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Demis Hassabis3 Jun 2025Over the next few years, AI tools likely greatly boost individual productivity.
September–November 2025 Argentina randomization found substantial assisted-task quality gains and modest time savings.
OutcomePartly rightDirectionRightMagnitudePartly supportedTimingTiming unresolved
2025-06-03 release; recording date unknown.
Further evidence: Qualified continuation of useful-tool assistance.
Direction: Bounded human-task gains.
Magnitude: Partial, not universal benefit.
Timing: Soft multiyear outlook; no timing credit.
Scope: Short artificial tasks, attrition, convenience recruitment and partly automated grading limit generalization; one time-saving estimate did not reach conventional 5% significance. Existing GPT-4.1 limits novelty. German apprentice corroboration compares AI plus internet against no internet, not isolated AI; exact cutoff-version chronology is uncertain. No economy-wide or broadly superhuman gains, durable learning or full multiyear persistence established. Mixed findings. The separate tenfold branch is ungraded.
Evidence confidence: Moderate for bounded experimental support; lower for generality and exact publication-version chronology of ancillary IZA corroboration.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Geoffrey HintonJun 2025 · rangeGood personalized AI tutors within roughly ten years, with factor-two timing uncertainty; eventual superiority to human tutors and three-to-fourfold learning efficiency also anticipated.
StudentBench’s summer 2026 randomized one-hour adult GRE tutoring used individual pretest errors.
OutcomePartly rightDirectionRightMagnitudeUnresolvedTimingWithin original window
June 2025 host event; exact day and transcript first-publication/revision chronology unverified.
Further evidence: Immediate unaided gains exceeded control. Pooled AI–human equivalence met authors’ margins, but Verbal separately did not; six systems passed exploratory uncorrected tests. Bounded adaptive tutoring, not full numerical fulfillment.
Direction: Adaptive teaching and learner benefit.
Magnitude: Learning-speed superiority and three-to-fourfold efficiency unresolved.
Timing: Postissue observation within the broad window; no first-arrival date or numerical-clause timing.
Scope: Adjusted equivalence survived repeat-student/leave-one-tutor checks; gain-only section tests did not. Gemma4: −1.09 percentage points versus humans (90% CI −3.93–1.75). Paid, mainly young adult completers; English GRE and immediate tests, not durable child/classroom learning. Adaptation was not causally isolated; human video versus AI chat differed. Human clustering limited precision; control watched unrelated educational videos, not GRE self-study. Platform-funded preprint, not independent replication. The 918× figure is inference cost, not learning speed or all-in cost. Stronger full-superiority/numerical conjunction remains unresolved. Adult GRE setting and immediate outcomes, not durable broad schooling. Human-comparison results are model-sensitive; learning-speed superiority remains unresolved.
Shared evidence: Tutoring predated issuance: weak-information continuation, not first invention. One 2024/2025 lineage, not separate votes.
Evidence confidence: Moderate for bounded central functionality; lower for broader tutoring interpretation.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Demis Hassabis27 Apr 2025Coding assistants become very good by 2026.
METR’s early-2026 evaluation and firsthand engineering use support stronger coding assistance, but custom work retained serious bugs and poor judgment.
OutcomePartly rightDirectionRightMagnitudePartly supportedTimingTiming unresolved
2025-04-27 publication; recording day unknown
Further evidence: Matched software-task tests improved; corrected estimates replace January values. Time horizon measures human-equivalent task difficulty, not autonomous working time. An early-2025 experienced-maintainer trial found slower work; February 2026 follow-up remains selection- and measurement-limited. Anthropic’s small junior-developer study found no significant time gain and lower immediate quiz performance; narrow new-library tasks are not all coding work. Qualified capability match, not universal usefulness.
Direction: More demanding software tasks became feasible.
Magnitude: No numerical quality or speedup threshold was promised.
Timing: 2026 was stated; no defined threshold-crossing date is established.
Scope: Software-task-heavy evidence; shared METR findings are not independent replications. No autonomous-research, OS-design or professional-replacement credit.
Evidence confidence: Moderate for qualified coding-quality trajectory; lower for the undefined quality level and practical productivity.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Daniel Kokotajlo3 Apr 2025Chart grade 75 / 100By end 2025: a rudimentary, unreliable party-organizing MVP, not dependable life management.
A June 2025 event drew 23 people.
OutcomePartly rightDirectionRightMagnitudePartly supportedTimingWithin original window
2025-04-03 publication; recording day not separately established
Further evidence: Agents handled materials, promotion, RSVPs and facilitator recruitment. Humans redirected venue search and corrected hallucinations; pizza arrived as an unrelated donation, not successful agent ordering. A partial agent-assisted demonstration is consistent with the qualified MVP forecast; stronger autonomy is unverified
Direction: Real event-organization work demonstrated.
Magnitude: Limited demonstration; intervention and failed subtasks.
Timing: June 2025 precedes December 31; no first-onset claim.
Scope: The host’s roughly thirty-minute example describes human invitations and food ordering, not a required agent runtime. Multiple agents worked for weeks with human help. Autonomous thirty-minute completion, reliable attendee selection and food fulfillment remain unestablished.
Evidence confidence: Moderate-low: dated official-host original and first-party organizer account; linked execution logs were not independently audited. Narrow demonstration, not a measured success rate.
Current edition contribution · Daniel Kokotajlo
Graded credit: 75 / 100.
- Recency weight
- 100%
- Credit × weight endpoint products
- 75
- Last documented backing
- 2025-04-03 to 2025-04-03
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 75 / 100
- Recency weight
- 100%
- Weighted credit term
- 75
- Same-claim backing date
- 2025-04-03 to 2025-04-03
Existing reviewed grade for the original scope; time intrinsic to that scope is retained.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
75,
75
]
},
"backingDateBounds": [
"2025-04-03",
"2025-04-03"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
75,
75
],
"weightBounds": [
1,
1
],
"normalizedBackingDateBounds": [
"2025-04-03",
"2025-04-03"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
75,
75
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Jensen HuangApr–May 2025 · rangeExpects early physical-agent production in 2026 and domain-specific humanoid work within five years.
Figure reported over 350 Figure 03 robots built by April 2026.
OutcomePartly rightDirectionRightMagnitudeUnresolvedTimingWithin original window
April 2025 recording; May 2025 publication (exact days unknown)
Further evidence: BMW reported a ten-month Figure 02 pilot during 2025, with exact dates unspecified. The same sheet-metal task was already trialed in August 2024 before the forecast; the later pilot is deployment depth, not first task emergence. Actual reported manufacture and industrial work support the bounded early transition, not robots generally doing whatever humans request.
Direction: Physical-agent engineering proceeded into small production runs and narrow workplace use.
Magnitude: No count, adoption fraction or reliability target was supplied; described factory capacity is not realized output.
Timing: April 2026 production report falls within the explicit 2026 window; narrower 2025 use also precedes the five-year upper bound. Neither proves all longer-run functionality.
Scope: Narrow trials and pilot tasks, not general factory autonomy. 2025 pilot dates are unspecified; separately dated 2026 production evidence is post-forecast.
Evidence confidence: Moderate: primary manufacturer/customer reports, narrow tasks, unaudited production count.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Dario Amodei10 Mar 2025Chart grade 25 / 100AI will write 90% of code within three–six months, while humans retain design and integration duties.
Google reported 30% of new code AI-assisted/generated in August 2025.
OutcomeMostly wrongDirectionRightMagnitudeOverestimated at deadlineTimingOriginal deadline missed
2025-03-10
Further evidence: An October 2025 survey of AI-using technology professionals reported 42% generated or significantly assisted code (979 responses), alongside other near-window evidence. These non-census observations strongly disfavor the broad 90% deadline interpretation; localized high shares and substantial later progress remain explicit. Moderate, qualitative and interpretation-sensitive; convergent near-window company and broad survey evidence, with later corroboration, strongly disfavors 90% as an ordinary industry-wide share. This is not proof of an exact world percentage.
Direction: right: AI-generated coding increased substantially, supported by actual-code measures not merely user counts.
Magnitude: Overestimated at the original deadline; no artificial weighted meta-estimate across different denominators.
Timing: Original deadline missed; eventual status unverified: qualified inference for original broad September 2025 target; no precise eventual crossing/lateness.
Scope: Field/world actual code writing, not expressly Anthropic-only or one workflow; precise population/volume unit unspecified. Human design, integration and security judgment remain. Existential some-workflow reading can have very high shares; original did not explicitly restrict to that. Later Anthropic broader 90% self-assessment does not rewrite March 2025 scope.
Evidence confidence: Moderate, interpretation-sensitive negative judgment for broad industry code writing; samples and company reports are not a global volume-weighted census.
Current edition contribution · Dario Amodei
Graded credit: 25 / 100.
- Recency weight
- 100%
- Credit × weight endpoint products
- 25
- Last documented backing
- 2025-03-10 to 2025-03-10
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 25 / 100
- Recency weight
- 100%
- Weighted credit term
- 25
- Same-claim backing date
- 2025-03-10 to 2025-03-10
This state-at-time, annual trajectory or original-period market/adoption predicate already includes time in its meaning. There is no separate event-arrival penalty to add back; preserve the reviewed original credit and temporal scope.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
25,
25
]
},
"backingDateBounds": [
"2025-03-10",
"2025-03-10"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
25,
25
],
"weightBounds": [
1,
1
],
"normalizedBackingDateBounds": [
"2025-03-10",
"2025-03-10"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
25,
25
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Gary Marcus9 Mar 2025AI from 2026–2027 will substantially assist human scientific research.
A 2026 primary report documents nontrivial model contributions incorporated into human-led mathematical research, with important failures and limited breadth.
OutcomePartly rightDirectionRightMagnitudePartly matched scopeTimingWithin original window
2025-03-09
Further evidence: Approximately right for the separable positive research-assistance component: experts report nontrivial AI contributions to actual novel mathematics. The future Nobel-laureate beneficiary claim is not resolved.
Direction: Observed useful human–AI scientific collaboration supports the augmentation direction, not just benchmark improvement.
Magnitude: Selected research contributions support substantive help, but not broad gains across science, Nobel-level achievement or a representative average productivity increase.
Timing: The research report identifies a January 2026 base model for the research cases, placing observed assistance inside the specified 2026–2027 generation window. This is not proof of the separate future-laureate endpoint.
Scope: Selected human-led mathematics contributions, not broad scientific productivity or future Nobel winners. Project-author evidence; rare successes, failures and modest significance retained.
Evidence confidence: Moderate for reported narrow contribution; project-author evidence, not independent publication-quality validation or population inference.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Gary Marcus2 Mar 2025Generated-code errors will probably persist for decades, especially on genuinely novel systems.
A pre-cutoff multi-model feature-development test found actual faulty implementations alongside substantial successful delivery and iterative improvement. Whole outcome unresolved.
OutcomeUnresolvedDirectionPartly rightMagnitudeScale and novelty unresolvedTimingFuture window open
2025-03-02
Further evidence: Unresolved: observations through 2026 cannot settle a decades-long duration or the special difficulty of entirely novel systems.
Direction: Approximately right as early corroboration only: post-forecast multi-task evidence identifies actual faulty implementations despite substantial successful coding and repair.
Magnitude: No numerical rate was forecast. Existing-repository feature work is a bounded proxy; no population error prevalence or stronger novelty penalty is established.
Timing: Pending: the stated duration extends decades beyond 2025. Neither early residual errors nor strong improvements settle that horizon.
Scope: Early direction only. Fresh preprint on bounded existing-repository tasks, not decades resolved or a population error rate. Strong coding successes retained; special novelty penalty unverified.
Evidence confidence: Moderate-low for early direction: a fresh primary preprint with explicit execution-based failure analysis and bounded task coverage.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Noam Shazeer12 Feb 2025In a tentative three-year outlook, parallel machine exploration could aid ML breakthroughs; research coordination remains uncertain.
DeepScientist’s 16 parallel workers shared findings and produced measured gains across three ML tasks.
OutcomePartly rightDirectionRightMagnitudePartly supportedTimingTiming unresolved
12 February 2025 publication; earlier recording day unknown.
Further evidence: ScientistTwo reports gains on 86/107 selected problems; success-only mean/median gains were 25.2%/7.7%. The earlier game-algorithm study remains counterevidence. Its later 18-game revision reveals over-specialization and improves generalization through human distillation. Approximately right for the tentative central exploration/coordination trajectory; the stronger whole day-to-day research arrangement remains unresolved.
Direction: Useful parallel/coordinated exploration in two developer-reported studies; separate teams are not independent replications.
Magnitude: Meaningful bounded gains, not a researcher-productivity multiple or paradigm-breakthrough guarantee; selection, verification and rigor limit breadth.
Timing: Three-year context remains open; publication is not an exact recording anchor or new 2028 deadline. Experiment dates are unknown.
Scope: DeepScientist: humans reproduced baselines, supervised runs and verified all results; about 5,000 ideas yielded 1,100 experiments, 21 progress findings and five selected papers. Expert reviewers flagged rigor; mean rating 5/10 is not acceptance. ICLR accepted the system report, not its generated papers. A retrospective efficiency comparison is not a controlled productivity trial. ScientistTwo’s September 2026 preprint uses reproducibility-selected tasks and success-selected outputs; 72.1% simulated acceptance is not conference acceptance. Nine humans reviewed 33 papers; developer artifact audits are not independent reruns. Another configuration retained reward hacking. Local refinement, weak breakthrough evidence and incompletely documented review uncertainty limit generalization. DeepScientist is a separate Westlake team; ScientistTwo shares Google affiliation with Noam. Neither supplies independent replication. Report/model chronology supports later contributions without exact experimental dates. Gemini 2.5 Pro searches code within human-specified baselines, evaluators and editable components. The February 18 v1 reported gains in 10/11 and 8/11 games for VAD-CFR/SHOR-PSRO respectively; larger variants partly held out. The May 7 v3’s 18-game tests qualify those version-specific results, not an independent replication. One search trajectory, closely related game tests, tabular baselines, fixed horizons and exact-best-response machinery limit transfer; no fully deep-RL or broad autonomous-research validation. Post-issue experiments are inferred from model generation, not proven by report date. Forecaster/outcome team share Google affiliation. DiscoRL’s December 2024 submission predates issuance and supplies no post-issue credit. Automated discovery already existed; tentative coordination and largest-scale uncertainty remain. Related reformulations add no independent trials; no numerical probability or current endorsement inferred.
Evidence confidence: Moderate for the bounded central parallel-exploration trajectory; limited for general research capability, productivity and long-run work organization.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Gary Marcus11 Feb 2025Chart grade 50 / 100The new administration will protect businesses and do nothing to protect individuals in AI policy.
AI infrastructure support was advanced, while the signed TAKE IT DOWN Act and FTC implementation supplied concrete individual protections against AI-related abuse.
OutcomeMixedDirectionMixedMagnitudeOverstated absence of protectionTimingNot separately applicable
2025-02-11
Further evidence: Marcus acknowledged the deepfake-law exception on May 22, 2025. Mixed observed outcomes: business-favoring executive policy, but a signed and implemented AI-related individual-protection law contradicts the absolute negative component.
Direction: Industry-support direction was borne out; the categorical expectation of no individual protection was not. This is not a net-benefit or whole-administration moral assessment.
Magnitude: The zero-protection wording is too strong. A narrow protective law does not establish comprehensive governance, effective prevention or dominance of individual interests.
Timing: The administration is the setting, not a separate arrival deadline. The counterexample occurs within that term; the full term is not finished, and no timing score is proposed.
Evidence confidence: High for enacted-action counterexample; moderate for broad business-policy direction
Later statement: 2025-05-22 (later qualification): Acknowledges an exception for legislation addressing deepfake pornography; does not explicitly retract the February wording. No erasure of original grade or extra forecast vote.
Current edition contribution · Gary Marcus
Graded credit: 50 / 100.
- Recency weight
- 100%
- Credit × weight endpoint products
- 50
- Last documented backing
- 2025-02-11 to 2025-02-11
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 50 / 100
- Recency weight
- 100%
- Weighted credit term
- 50
- Same-claim backing date
- 2025-02-11 to 2025-02-11
Existing reviewed grade for the original scope; time intrinsic to that scope is retained.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing. Marcus’s 2025-05-22 acknowledgment of the deepfake-law exception qualifies/counters the original absolute wording; it is not an explicit same-scope reaffirmation.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
50,
50
]
},
"backingDateBounds": [
"2025-02-11",
"2025-02-11"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
50,
50
],
"weightBounds": [
1,
1
],
"normalizedBackingDateBounds": [
"2025-02-11",
"2025-02-11"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
50,
50
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Sam Altman9 Feb 2025Everyday life and time use in 2025 stay mostly like 2024.
Whole outcome unresolved.
OutcomeUnresolvedDirectionPartly rightMagnitudeUnresolvedTimingTiming unresolved
2025-02-09
Further evidence: U.S. aggregate continuity is positive component evidence only: all 12 category means differ by at most 6.6 minutes/day; those category means do not measure changes within activities or lived experience.
Direction: Qualified positive U.S. aggregate component only; no whole-outcome completion.
Magnitude: Whole-target magnitude remains unresolved; small mean differences do not establish equivalence.
Timing: The U.S. component fits 2025; whole-outcome timing remains unjudgeable, without a reset deadline.
Scope: BLS civilian U.S. population ages 15+, cross-sectional primary-activity diaries, not a panel: approximately 7,700 respondents in 2024 and 6,100 in 2025. Shutdown omitted September 30–November 11 diaries; later fourth-quarter observations were reweighted, effects unquantified. Annual averages include pre-issue January/early February. Work fell 3.43→3.32 hours/day; leisure rose 5.07→5.16. Coarse categories can hide changed tasks, productivity, technology use or experience; no global extrapolation or causal AI estimate. Later-updated author post; contemporaneous February 2025 reporting corroborates the relevant passage.
Shared evidence: Low-information persistence baseline; strongly dependent on Altman’s diffusion forecasts, not an independent capability forecast.
Evidence confidence: Moderate for aggregate component evidence; insufficient for the original whole-outcome verdict.
Draft formula inputs
No draft score: out of scope. No vote, not zero.
Gary Marcus26 Jan 2025Expected GPT-5 or a similarly impressive model within the three-year outlook, with the supplier unspecified.
GPT-5 demonstrated substantive successor capability while retaining reliability limits.
OutcomeRightDirectionRightMagnitudeQualitatively supportedTimingWithin original window
2025-01-26
Further evidence: Right for the modest positive component that a substantially capable successor would emerge, not merely acquire a new model name. Multiple task evaluations support actual advance.
Direction: Capability advanced, while reliable general intelligence was neither promised by this component nor established.
Magnitude: No numerical gain was forecast. Impressive is qualitative; this is not a verdict on the separate claim that advances become more incremental or leads quickly vanish.
Timing: The observed successor arrived within the surrounding three-year outlook. This is contextual-window credit, not a forecast of its exact release date.
Scope: Low-specificity positive capability forecast. Separate incremental-rate, supplier-lead and AGI predictions remain ungraded here; first-party benchmarks do not establish all-task superiority.
Evidence confidence: Moderate: first-party multidomain evaluations and existing limitations, no independent all-task census
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Daniel Kokotajlo7 Jan 2025Impressive-looking, though flawed, autonomous research and development is likely by 2025.
A primary report published April 10, 2025 demonstrated a substantive manuscript workflow, supporting the central prediction.
OutcomePartly rightDirectionNot separately gradedMagnitudeNot quantifiedTimingWithin original window
2025-01-07T23:08:38.541Z
Original horizon: 2025
Further evidence: Human selection and quality gaps remain; benchmark dominance is unverified, dependable research replacement is not established, and related 2024 workflows limit novelty. A real manuscript workflow supports the central component, not benchmark dominance or dependable research replacement.
Direction: Not separately graded in the historical record.
Magnitude: No separately documented rationale is available.
Timing: The April 10, 2025 report falls within the original window for the supported workflow component.
Scope: The illustrative RE-Bench superiority claim remains unresolved, not an observed miss. Treating it as essential leaves the full conjunction unjudgeable. The result is a selected-run report, not a general autonomous-research success rate.
Evidence confidence: Not separately rated.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Gary Marcus7 Jan 2025AGI definitions and proposed thresholds will continue shifting substantially during 2025.
Altman used a different human-level, many-fields formulation in 2025 and publicly negotiated alternative thresholds. Whole outcome unresolved.
OutcomeUnresolvedDirectionPartly rightMagnitudeNot quantifiedTimingTiming unresolved
2025-01-07
Further evidence: The amount of industry-wide change and whether these were formal revisions remain unestablished. Actual semantic variation supports a bounded component, but the substantial industry-wide claim and stronger goalpost-shifting interpretation are not fully resolved.
Direction: Primary dated 2025 sources contain substantively different formulations, rather than merely repeating the old economic definition.
Magnitude: No quantitative threshold for a lot more; evidence is concentrated on one prominent speaker.
Timing: The observed instances occurred within 2025, but there is no full timing credit for the unmeasured breadth claim.
Scope: Related June 15, 2024 wording was edited June 22 to withdraw the Kurzweil downgrade example; first-publication wording is not independently archived. Its broader major-player expectations component remains unresolved. Commentator updates do not satisfy that actor scope and earn no extra credit, motive inference or reset of the 2025 definition-change target.
Evidence confidence: Moderate for bounded semantic movement; low for broad prevalence or motive.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Jensen Huang7 Jan 2025Chart grade 75 / 100Expects deployment of software-engineering, digital-marketing campaign-management and customer-service agents during 2025.
Existing dated coding and customer-service workflow evidence, plus the newly dated Advolve campaign-management case, support real deployment in all three roles during 2025.
OutcomePartly rightDirectionRightMagnitudeUnresolvedTimingWithin original window
2025-01-07
Further evidence: The result is bounded and partly continuation of existing use, not workforce replacement or an established industry take-off. Approximately right for the frozen three-role deployment conjunction: all roles now have actual tool-using-work evidence, including the previously missing campaign-management predicate. First-party accounts and human oversight limit strength; broader take-off interpretation remains unmeasured.
Direction: Operational examples support enterprise agent use across the named roles.
Magnitude: No prevalence threshold or labor-cost share was fixed; selected cases do not establish broad adoption or replacement.
Timing: Reports establish use during the stated year, not the date of first-ever deployment. Advolve may have started preissue, reducing novelty rather than supplying a new invention date.
Scope: Three-role deployment conjunction; tool-using enterprise work with humans allowed. Broad take-off language has no specified scale. NVIDIA internal plans and all-engineer policy are separate, not scored.
Evidence confidence: Moderate for bounded three-role deployment; first-party reports and prior-use baseline limit inference. Broader adoption magnitude remains unresolved.
Current edition contribution · Jensen Huang
Graded credit: 75 / 100.
- Recency weight
- 100%
- Credit × weight endpoint products
- 75
- Last documented backing
- 2025-01-07 to 2025-01-07
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 75 / 100
- Recency weight
- 100%
- Weighted credit term
- 75
- Same-claim backing date
- 2025-01-07 to 2025-01-07
Existing reviewed grade for the original scope; time intrinsic to that scope is retained.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
75,
75
]
},
"backingDateBounds": [
"2025-01-07",
"2025-01-07"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
75,
75
],
"weightBounds": [
1,
1
],
"normalizedBackingDateBounds": [
"2025-01-07",
"2025-01-07"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
75,
75
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Sam Altman6 Jan 2025In 2025, first workforce agents may materially change company output.
2025 accounts: Eight Sleep reported tripled weekly analytics output; Engine cancellation workflows were reported in April and 15% lower case-handling time in June.
OutcomePartly rightDirectionRightMagnitudePartly supportedTimingTiming unresolved
6 January 2025 UTC; 5 January US-local dating
Further evidence: Qualified early-wave reading; an inseparable literal-first-2025 target remains unresolved.
Direction: Action-taking work, not just launches; pre-2025 assisted coding/support limits novelty.
Magnitude: Departmental effects, not universal/economy-wide gains or uniform correctness.
Timing: Dated 2025 outputs, but first attainment unresolved; no full-target timing hit or 2026 backdating.
Scope: Original page later updated; contemporary wording corroborated. Commercial self-reports, not audited company-wide net effects; task mix, baselines, review/error costs and durability unknown. Engine acknowledged unintended cancellations and a confirmation safeguard. March efficiency/annual-savings quantities were aims; annual savings remain uncredited. Public clip transcript, not verified audio; exact post day unknown.
Shared evidence: Related deployment forecasts share the trajectory, not independent skill confirmation.
Evidence confidence: Moderate-to-low for the qualified reading: original wording has contemporary corroboration, while outcomes are commercially interested self-reports. Literal chronology and representativeness remain limitations.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Gary Marcus1 Jan 20252025: AI chip suppliers prosper.
NVIDIA reported $130.387B operating income and $120.067B net income for its fiscal year ending January 25, 2026, covering most of 2025.
OutcomeRightDirectionRightMagnitudeQualitatively supportedTimingWithin original window
2025-01-01
Further evidence: Not a pure AI-hardware margin or exact calendar-year total. Documented profit supports the scoped hardware component.
Direction: Hardware-associated supplier profit was substantial.
Magnitude: Large profit direction is directly supported.
Timing: Fiscal period overlaps most of 2025; exact calendar-year offset retained.
Scope: MiniMax’s full-calendar 2025 disclosure reports positive gross profit but statutory and adjusted company losses. Most statutory loss is preferred-share remeasurement, not operating cash burn. Applications and platform/enterprise revenue are mixed; model-only profit is not isolated. Adjusted figures do not replace IFRS. EY agreed announcement amounts to audited statements but did not assure the announcement. This closes the company’s partial-period gap, not the industry-wide model-profit conjunction; the hardware judgment is unchanged.
Evidence confidence: high for documented company result; moderate for wider direction
Draft formula inputs
No draft score: out of scope. No vote, not zero.
Gary Marcus1 Jan 2025Chart grade 100 / 1002025: AI safety institutes lack strong independent enforcement.
The examined US and UK institutions retained advisory or testing roles rather than independent release-veto powers.
OutcomeRightDirectionNot separately gradedMagnitudeNot quantifiedTimingWithin original window
2025-01-01
Further evidence: This supports a scoped institutional-continuity prediction, not a conclusion about every safety institute or the strength of all AI regulation. Examined US and UK roles support the limited continuity prediction, with relatively low novelty.
Direction: Not separately graded in the historical record.
Magnitude: No separately documented rationale is available.
Timing: The assessment concerns the 2025 window; later UK retrospective documentation is not backdated publication.
Scope: This is not an exhaustive global legal census. Evidence includes later retrospective reporting as well as contemporary institutional documents.
Evidence confidence: Not separately rated.
Current edition contribution · Gary Marcus
Graded credit: 100 / 100.
- Recency weight
- 100%
- Credit × weight endpoint products
- 100
- Last documented backing
- 2025-01-01 to 2025-01-01
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 100 / 100
- Recency weight
- 100%
- Weighted credit term
- 100
- Same-claim backing date
- 2025-01-01 to 2025-01-01
Existing reviewed grade for the original scope; time intrinsic to that scope is retained.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
100,
100
]
},
"backingDateBounds": [
"2025-01-01",
"2025-01-01"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
100,
100
],
"weightBounds": [
1,
1
],
"normalizedBackingDateBounds": [
"2025-01-01",
"2025-01-01"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
100,
100
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Gary Marcus1 Jan 2025Chart grade 100 / 1002025: AI hallucinations persist.
Factual errors remained in late-2025 evidence despite substantial improvements.
OutcomeRightDirectionNot separately gradedMagnitudeNot quantifiedTimingWithin original window
2025-01-01
Further evidence: That supports the prediction of persistence, not technological stagnation, a specified everyday-user error rate or any measured error rate at the October 2026 review cutoff. Observed improvement coexisted with factual errors, matching persistence rather than stagnation.
Direction: Not separately graded in the historical record.
Magnitude: No error-rate threshold.
Timing: The dated late-2025 evidence falls within the forecast’s original calendar window.
Scope: The historical 2025 result does not quantify later error rates or justify a claim of no progress.
Evidence confidence: Not separately rated.
Current edition contribution · Gary Marcus
Graded credit: 100 / 100.
- Recency weight
- 100%
- Credit × weight endpoint products
- 100
- Last documented backing
- 2025-01-01 to 2025-01-01
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 100 / 100
- Recency weight
- 100%
- Weighted credit term
- 100
- Same-claim backing date
- 2025-01-01 to 2025-01-01
Existing reviewed grade for the original scope; time intrinsic to that scope is retained.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
100,
100
]
},
"backingDateBounds": [
"2025-01-01",
"2025-01-01"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
100,
100
],
"weightBounds": [
1,
1
],
"normalizedBackingDateBounds": [
"2025-01-01",
"2025-01-01"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
100,
100
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Gary Marcus1 Jan 2025Chart grade 100 / 1002025: material AI reasoning errors persist.
Multiple controlled evaluations in 2025 found residual reasoning failures alongside large gains and strong mathematical performance.
OutcomeRightDirectionNot separately gradedMagnitudeNot quantifiedTimingWithin original window
2025-01-01
Further evidence: That supports persistence of errors, not general inability to reason, no progress, or a measured everyday-user error rate. Tested failures persisted alongside large gains, matching the modest continuity target rather than general inability.
Direction: Not separately graded in the historical record.
Magnitude: No separately documented rationale is available.
Timing: The controlled evaluations document residual failures during the original 2025 window.
Scope: Severity unquantified. This is a low-novelty persistence call sharing a reliability trajectory with related annual forecasts. Related 2022 wording for 2023 is retained as ungraded history, with its architecture conditions; it does not replace this 2025 deadline.
Evidence confidence: Not separately rated.
Earlier statement: 2022-12-25 (Earlier source pointer): Whole numbered slot 2, 2023; rumor-based unchanged-architecture/same-playbook conditions. Undisclosed internals and the causal explanation are unestablished. No 2023 adjudication, no replacement of the 2025 deadline, and no additional forecast.
Current edition contribution · Gary Marcus
Graded credit: 100 / 100.
- Recency weight
- 100%
- Credit × weight endpoint products
- 100
- Last documented backing
- 2025-01-01 to 2025-01-01
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 100 / 100
- Recency weight
- 100%
- Weighted credit term
- 100
- Same-claim backing date
- 2025-01-01 to 2025-01-01
Existing reviewed grade for the original scope; time intrinsic to that scope is retained.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
100,
100
]
},
"backingDateBounds": [
"2025-01-01",
"2025-01-01"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
100,
100
],
"weightBounds": [
1,
1
],
"normalizedBackingDateBounds": [
"2025-01-01",
"2025-01-01"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
100,
100
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Gary Marcus1 Jan 20252025: open-ended agents stay unreliable, barring narrow exceptions.
Broad open-ended reliability remained limited in 2025 while constrained systems delivered real value.
OutcomeRightDirectionNot separately gradedMagnitudeNot quantifiedTimingWithin original window
2025-01-01
Further evidence: The technical component is supported; marketing-rhetoric intensity was not independently measured. Broad reliability limits coexist with useful bounded deployments.
Direction: Not separately graded in the historical record.
Magnitude: No separately documented rationale is available.
Timing: The supported technical-reliability evidence falls within the original 2025 forecast window.
Scope: Marketing/reliability conjunction unresolved. The finding does not imply agents were useless, undeployed or confined to one industry; related reliability forecasts are dependent.
Evidence confidence: Not separately rated.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Gary Marcus1 Jan 2025Chart grade 75 / 1002025: OpenAI previews persist months before solid, widely available, accessibly priced releases.
Qualified continuation: staged o3 and Operator-derived releases; GPT-4.1 launched immediately.
OutcomePartly rightDirectionPartly rightMagnitudePartly supportedTimingWithin original window
2025-01-01
Further evidence: Staged o3 and Operator-derived releases support continuation. Unavailability bounds the joint endpoint, not measured quality/price attainment. Immediate GPT-4.1 is counterevidence to uniformity; Operator continuity/configuration remains uncertain.
Direction: Continuation observed, with shorter or immediate launches also present.
Magnitude: Months-long examples exist; no representative lag distribution.
Timing: Continuation observed in 2025; exact joint-endpoint attainment remains unknown.
Scope: No all-products rule or fixed quality/price thresholds; years-long delays optional. Evolving product lineages and uncertain Operator access continuity limit exact lag estimates.
Note: Shared evidence
Evidence confidence: Moderate for qualified continuation and documented access dates; lower for cohort breadth, continuous Operator restriction, reliability and affordability endpoints.
Current edition contribution · Gary Marcus
Graded credit: 75 / 100.
- Recency weight
- 100%
- Credit × weight endpoint products
- 75
- Last documented backing
- 2025-01-01 to 2025-01-01
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 75 / 100
- Recency weight
- 100%
- Weighted credit term
- 75
- Same-claim backing date
- 2025-01-01 to 2025-01-01
Existing reviewed grade for the original scope; time intrinsic to that scope is retained.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
75,
75
]
},
"backingDateBounds": [
"2025-01-01",
"2025-01-01"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
75,
75
],
"weightBounds": [
1,
1
],
"normalizedBackingDateBounds": [
"2025-01-01",
"2025-01-01"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
75,
75
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Gary Marcus1 Jan 20252025: limited, mainly Western/fair-weather driverless use; human driving persists.
Observed mixed: deployment remained bounded and human driving substantial; IEA lists 2025 paid driverless service in 11 Chinese cities versus five US cities.
OutcomeMixedDirectionMixedMagnitudeUnresolvedTimingTiming unresolved
2025-01-01
Further evidence: Observed support and contrary geographic evidence coexist; missing weather evidence does not cause the mixed grade. Alternative interpretations remain open.
Direction: Expansion and substantial human employment coexist with the contrary city-distribution result.
Magnitude: No numerical cutoff; city counts do not measure trip, fleet or usage shares.
Timing: Original-year evidence; exact endpoint and whole-bundle timing remain unresolved, not a delayed-adoption miss.
Scope: Weather, trip-weighted shares and US-only interpretation remain unresolved. Paid public service excludes free/test use; one intact forecast, not separate component votes.
Evidence confidence: Moderate for observed mixed components under unrestricted deployment geography; conditional on interpretation, with US-only and usage-weighted readings unresolved.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Gary Marcus1 Jan 2025Chart grade 100 / 1002025: AI copyright litigation continues.
Court records in May and December 2025 establish continuing litigation, matching the forecast.
OutcomeRightDirectionNot separately gradedMagnitudeNot quantifiedTimingWithin original window
2025-01-01
Further evidence: This is a comparatively low-novelty continuity call about ongoing proceedings. Continued court activity supports the forecast, though it was a low-novelty continuity expectation.
Direction: Not separately graded in the historical record.
Magnitude: No volume, merits, liability or damages target.
Timing: May and December 2025 court records fall within the original calendar window.
Scope: The result concerns historical continuation, not current legal advice or an exhaustive litigation census.
Evidence confidence: Not separately rated.
Current edition contribution · Gary Marcus
Graded credit: 100 / 100.
- Recency weight
- 100%
- Credit × weight endpoint products
- 100
- Last documented backing
- 2025-01-01 to 2025-01-01
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 100 / 100
- Recency weight
- 100%
- Weighted credit term
- 100
- Same-claim backing date
- 2025-01-01 to 2025-01-01
Existing reviewed grade for the original scope; time intrinsic to that scope is retained.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
100,
100
]
},
"backingDateBounds": [
"2025-01-01",
"2025-01-01"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
100,
100
],
"weightBounds": [
1,
1
],
"normalizedBackingDateBounds": [
"2025-01-01",
"2025-01-01"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
100,
100
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Gary Marcus1 Jan 2025Chart grade 100 / 1002025: AI energy use rises; disclosure stays limited.
Infrastructure estimates and a 13-provider disclosure audit support rising AI-related electricity pressure and sparse model-level reporting.
OutcomeRightDirectionNot separately gradedMagnitudeNot quantifiedTimingWithin original window
2025-01-01
Further evidence: Efficiency gains and transparent developers remain important counterexamples; the evidence is not exact global metering or proof of universally absent disclosure. Rising electricity pressure and sparse model-level disclosure support both central components, with documented exceptions.
Direction: Not separately graded in the historical record.
Magnitude: No separately documented rationale is available.
Timing: The assessment concerns 2025 conditions; the later infrastructure report provides retrospective estimates, not contemporaneous measurements.
Scope: The evidence combines infrastructure estimates and disclosure review, not a global generative-AI electricity total. Physical bottlenecks support concern but do not quantify a welfare verdict.
Evidence confidence: Not separately rated.
Current edition contribution · Gary Marcus
Graded credit: 100 / 100.
- Recency weight
- 100%
- Credit × weight endpoint products
- 100
- Last documented backing
- 2025-01-01 to 2025-01-01
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 100 / 100
- Recency weight
- 100%
- Weighted credit term
- 100
- Same-claim backing date
- 2025-01-01 to 2025-01-01
Existing reviewed grade for the original scope; time intrinsic to that scope is retained.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
100,
100
]
},
"backingDateBounds": [
"2025-01-01",
"2025-01-01"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
100,
100
],
"weightBounds": [
1,
1
],
"normalizedBackingDateBounds": [
"2025-01-01",
"2025-01-01"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
100,
100
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Gary Marcus1 Jan 20252025: model convergence limits durable technical advantages.
US–China benchmark competition supports partial convergence, but regional and domain gaps remain.
OutcomePartly rightDirectionNot separately gradedMagnitudeMixed scale evidenceTimingWithin original window
2025-01-01
Further evidence: European catch-up and absent durable technical/business advantages remain unverified. Competition and partial convergence are supported, but meaningful regional and task gaps qualify the result.
Direction: Not separately graded in the historical record.
Magnitude: Domain gaps persist; benchmarks cannot establish business advantages.
Timing: Competition evidence supports the 2025 component; later comparisons are not silently backdated to that window.
Scope: No uniform parity.
Evidence confidence: Not separately rated.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Gary Marcus1 Jan 2025Chart grade 100 / 1002025: broad AI production adoption stays tentative.
An enterprise survey supports a gap between experimentation or limited deployment and use at broad production scale.
OutcomeRightDirectionNot separately gradedMagnitudeNot quantifiedTimingWithin original window
2025-01-01
Further evidence: Real deployments and growth are substantial counterevidence to universal nonadoption; selected large-firm results do not establish prevalence across all businesses. The experimentation-to-scale gap is supported, while real successful deployments rule out a no-adoption interpretation.
Direction: Not separately graded in the historical record.
Magnitude: No separately documented rationale is available.
Timing: The assessment concerns 2025 adoption; later reports and retrospectives are kept distinct from their fieldwork dates.
Scope: Limited deployments are not equivalent to scaling across most functions. Separate 2026 evidence and selected success stories do not supply population prevalence or a hard reliability ceiling.
Evidence confidence: Not separately rated.
Current edition contribution · Gary Marcus
Graded credit: 100 / 100.
- Recency weight
- 100%
- Credit × weight endpoint products
- 100
- Last documented backing
- 2025-01-01 to 2025-01-01
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 100 / 100
- Recency weight
- 100%
- Weighted credit term
- 100
- Same-claim backing date
- 2025-01-01 to 2025-01-01
Existing reviewed grade for the original scope; time intrinsic to that scope is retained.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
100,
100
]
},
"backingDateBounds": [
"2025-01-01",
"2025-01-01"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
100,
100
],
"weightBounds": [
1,
1
],
"normalizedBackingDateBounds": [
"2025-01-01",
"2025-01-01"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
100,
100
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Gary Marcus1 Jan 2025Chart grade 100 / 1002025: Sora’s physical inconsistencies persist.
Release documentation and automated evaluation in 2025 showed residual physical inconsistencies alongside substantial quality gains.
OutcomeRightDirectionNot separately gradedMagnitudeNot quantifiedTimingWithin original window
2025-01-01
Further evidence: Those examples support the persistence target, but establish neither a universal failure rate nor a conclusion about the limits of the architecture. Progress and residual physical failures coexist, matching the actual persistence target.
Direction: Not separately graded in the historical record.
Magnitude: No prevalence target or stagnation.
Timing: The relevant release documentation and evaluation both fall within the 2025 window.
Scope: Specific remaining errors, not universal failure or absence of improvement. Automated grading, incomplete version identification and sensitivity of a separate physics benchmark limit stronger inferences.
Evidence confidence: Not separately rated.
Current edition contribution · Gary Marcus
Graded credit: 100 / 100.
- Recency weight
- 100%
- Credit × weight endpoint products
- 100
- Last documented backing
- 2025-01-01 to 2025-01-01
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 100 / 100
- Recency weight
- 100%
- Weighted credit term
- 100
- Same-claim backing date
- 2025-01-01 to 2025-01-01
Existing reviewed grade for the original scope; time intrinsic to that scope is retained.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
100,
100
]
},
"backingDateBounds": [
"2025-01-01",
"2025-01-01"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
100,
100
],
"weightBounds": [
1,
1
],
"normalizedBackingDateBounds": [
"2025-01-01",
"2025-01-01"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
100,
100
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}François Chollet20 Dec 2024Reasoning cost-performance improves sharply over months/years, soon competing with human work.
December 2024 low-compute o3 preview: 75.7%, then-estimated $17–20/task.
OutcomePartly rightDirectionRightMagnitudePartly supportedTimingTiming unresolved
2024-12-20
Further evidence: By July 17, 2026, the evaluator reported Inkling at 79.5% and $0.30 per task on the same semi-private benchmark category. This is cheaper at higher aggregate performance, not merely a cheaper weaker configuration. Exact tasks and errors need not match. A separate July 2026 study reports public ARC-1 two-guess performance of 67.25% at $0.62/task, versus H-ARC’s 60.2% human two-attempt mean. Human-session pay allocated roughly $2–2.20 per assigned task: $10/five plus a possible $1 bonus, including study overhead, not a measured pure labor price. Independent human-task evidence supports qualified ARC-economic competitiveness; the broader human-work alternative remains unresolved.
Direction: A dated comparison supports real local improvement.
Magnitude: Large benchmark inference-price improvement; human comparisons support competitiveness, not exact universal savings or fully loaded parity.
Timing: Roughly 19 months fits the qualitative horizon; no exact deadline or independent timing success.
Scope: ARC-AGI-1; original pricing estimates, not later edits. Qualified marginal task economics, not general-work success or replacement-cost parity. Public-set tuning and possible pretraining exposure limit generalization. Human tests used first outputs and feedback; exact protocol equivalence is unverified. Human compensation includes instructions/descriptions; model token prices omit training, engineering and execution overhead. No statistical superiority is established.
Note: Shared evidence
Evidence confidence: Moderate for the benchmark-economic interpretation; lower for exact human/model protocol equivalence and general productive-work transfer.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
François Chollet17 Dec 2024Chart grade 75 / 100During 2025, inference-time search would become a major research theme and numerous efforts would seek open-source counterparts to o1.
January 2025 brought Sky-T1, s1, OpenThoughts and Open-R1.
OutcomePartly rightDirectionPartly rightMagnitudePartly supportedTimingWithin original window
2024-12-17
Further evidence: The first two directly addressed o1-preview-like capability, while the latter two expanded open reasoning data and reconstruction of the R1 pipeline. The s1 paper also demonstrated controlled extra inference computation improving a fixed model on its reported math evaluation. Preexisting OpenR/OpenO1 make this a low-to-moderate novelty continuation forecast. Several distinct projects launched or publicly released in January 2025 explicitly pursued open reasoning or o1-like test-time capabilities, with code/data/weights rather than merely commentary. This supports the research-effort forecast under ordinary o1-like replication language. The broad year-of-search slogan is less determinate than the concrete efforts.
Direction: The new 2025 projects materially extended an already existing 2024 open-reasoning research line. This is continuation, not a prediction of the first such project.
Magnitude: Sky-T1, s1, OpenThoughts, and Open-R1 supply four named 2025 efforts. Two directly target o1-preview-like capabilities; two target the wider open reasoning/R1 reproduction ecosystem. This is a qualitative plurality, not an invented numerical definition of many or a field census.
Timing: The named efforts appeared within the explicit calendar-2025 window. Their January appearance is an early realization within a one-year original horizon, not evidence that the original horizon was only one month.
Scope: One research-wave target from the primary interviewer’s exclusive response. The adjacent repeated ARC-AGI solution clause is retained as a dependent annex, not another vote or a reset of FC-2024-ARC-HN. Exact private o1 algorithm reproduction, universal benchmark equivalence, and field-wide compute share are not implied by evidence of replication efforts. If the entire response including full ARC solution is treated as one compound, content and timing remain unresolved; this card assesses the separately retained research-wave target. The preceding tweet’s economics are not adjudicated here.
Evidence confidence: Moderate for the approximately-right research-wave verdict; high for existence and within-window public release of the named efforts. Not a proof of exact replication or inference-time search dominance.
Current edition contribution · François Chollet
Graded credit: 75 / 100.
- Recency weight
- 100%
- Credit × weight endpoint products
- 75
- Last documented backing
- 2024-12-17 to 2024-12-17
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 75 / 100
- Recency weight
- 100%
- Weighted credit term
- 75
- Same-claim backing date
- 2024-12-17 to 2024-12-17
Existing reviewed grade for the original scope; time intrinsic to that scope is retained.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
75,
75
]
},
"backingDateBounds": [
"2024-12-17",
"2024-12-17"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
75,
75
],
"weightBounds": [
1,
1
],
"normalizedBackingDateBounds": [
"2024-12-17",
"2024-12-17"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
75,
75
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Ajeya CotraDec 2024 · rangeRetrospectively attested: ≈$17B end-2025 combined annualized OpenAI/Anthropic/xAI revenue.
Organizer: $30.4B; attested $17B: $13.4B/44% low.
OutcomeMostly wrongDirectionRightMagnitudeUnderestimatedTimingNot separately applicable
13–14 December 2024; submission-day uncertainty
Further evidence: Qualified miss; ungraded interval.
Direction: Growth supported.
Magnitude: Amount underestimated.
Timing: Endpoint—not arrival.
Scope: Indexed only; full/immutable submission uninspected. Unknown statistic/distribution: no mean/median/calibration/ranking verdict. Stale author/organizer: $4.5B/$4.7B. Updated $6.4B mitigates growth criticism, not amount error. Author outcome: ≈$30.5B. December 13 attestation and December 14 public survey field are not independently reconciled; midnight/timezone semantics are unknown. Company disclosures corroborate scale, not an audited December-revenue-times-12 sum. January 2026 CFO report: OpenAI over $20B 2025 ARR; April 2026 company report: Anthropic about $9B at end-2025 run-rate. Its filing uses trailing 28-day consumption fees ×13 plus monthly subscriptions ×12, not GAAP or independently verified. Current company pages may carry later edits. Not full-year revenue, profit, funding, valuation, GDP or a sector census. No probability score.
Evidence confidence: Moderate for discounted author attribution and submission period; moderate for organizer-resolved point error; low for unrecovered individual distribution and exact audited monthly-total convention.
Draft formula inputs
No draft score: out of scope. No vote, not zero.
Yoshua Bengio12 Dec 2024Generated videos become more striking in a few years, in the context of increasing realism.
Veo3’s January 2026 updated card reports overall human preference gains over pre-issuance Sora Turbo; this is not a verified realism-specific score.
OutcomePartly rightDirectionRightMagnitudePartly supportedTimingTiming unresolved
2024-12-12
Further evidence: Bounded quality improvement; narrower independent realism reading remains partial-only.
Direction: Continuation of an already-strong baseline, not first invention.
Magnitude: Subjective intensity; no numerical target.
Timing: Few years is vague; compatible observations, not deadline/first-attainment credit.
Scope: December 2024 is the edited interview’s publication clock; September-event utterance unverified. The card first appeared May 2025, but evaluation days/revisions are unspecified: no backdating. Video-only and audio-video tests differ; no Sora-specific muted-realism rate or numeric margin is given. Provider-run evaluation omits rater counts/full matching details; complex motion, scene consistency and artifacts remain problematic. Neither independent visual-realism superiority, universal indistinguishability nor film-length coherence is established.
Shared evidence: Related forecasts and same-provider reports are dependent, not replications.
Evidence confidence: Moderate for bounded qualitative improvement; lower for independent realism-specific magnitude and exact timing.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Gary Marcus12 Dec 2024Substantial GenAI-enabled cybercrime will occur in coming years.
Two distinct 2025 investigations report consequential multi-organization AI-assisted theft/intrusion.
OutcomePartly rightDirectionRightMagnitudePartly demonstratedTimingNo fixed deadline
2024-12-12
Further evidence: Repeated criminal use supports occurrence; full scale unmeasured.
Direction: Material operational use, not simulation.
Magnitude: Selected incidents do not establish global frequency, growth or losses.
Timing: Coming years is an explicit long-run horizon without a separate fixed deadline.
Evidence confidence: Moderate for reported occurrence and role; limited for independent corroboration and global magnitude
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Ajeya Cotra10 Dec 2024End 2025 or early 2026: broad expert week-scale performance falls short and remains uneven.
Dated tests show uneven performance; late-2025 GPT-5.2 GDPval results provide substantial counterevidence. Whole outcome unresolved.
OutcomeUnresolvedDirectionPartly rightMagnitudePartly supportedTimingTiming unresolved
2024-12-10
Further evidence: The original October 2025 RLI evaluation used earlier models and constrained setups. A dated July 2026 update also reports GPT-5.2. METR’s software-heavy estimates were later corrected. No matched endpoint duration-by-domain evaluation resolves the broad negative. Whole negative endpoint unresolved.
Direction: Local heterogeneity only, not absence of useful agents.
Magnitude: Measured variation is partial support; broad expert thresholds remain unresolved.
Timing: No full timing verdict or replacement deadline.
Scope: Publisher transcript: recorded 10 December 2024, published 16 January 2025; audio not independently checked. GPT-5.2 Thinking’s 70.9% GDPval wins/ties across 44 occupations are provider-reported aggregate counterevidence, not a week-scale subgroup result. GDPval includes multiweek tasks, but its earlier duration breakdown cannot be assigned to GPT-5.2. Human task duration is not model runtime. No invented reliability threshold, universal inability, universal perfection or 2026 employment inference. Earlier limited results cannot establish later unrestricted capability. The original October RLI computer-use setup had a one-hour timeout. Runs ended below $30; budget exhaustion was not demonstrated. CAIS’s July 1, 2026 post reports GPT-5.2 at 2.50% in its historical comparison; this dates publication, not the run. It corrects a general high-effort description to model-default settings; the later edit date is unknown and an immutable pre-cutoff version was not independently archived. The later board separately labels the corroborated 2.50% row medium-effort, not a matched comparison with GDPval’s heavy configuration. Newer-model scaffolds allow up to 24 hours and worker–critic revision; these conditions are not securely linked to the older GPT-5.2 run. The post’s text describes flat or slightly rising success against human duration, not monotonic decline; individual graph curves were not visually verified. Later-model advances are not backdated endpoint outcomes; current-board-only values are excluded.
Evidence confidence: Moderate for local, measured heterogeneity; insufficient for the full negative endpoint or unrestricted latent-capability claim.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
François Chollet14 Nov 2024ARC will be solved within a couple of years.
Preview clears the contextual threshold, not full solution or efficient open-source prize criteria. “Solved” is interpretation-sensitive; approximate credit.
OutcomePartly rightDirectionRightMagnitudeThreshold met, scope qualifiedTimingWithin original window
2024-11-14
Direction: Benchmark progress.
Magnitude: 87.5% exceeds implied 85%, not 100%; public-budget 75.7%.
Timing: Approximate window met, not month accuracy.
Scope: Any architecture; no AGI/risk verdict. Released o3 differs and scored lower; public training exposure disclosed. Pricing is not backdated.
Note: Shared evidence
Evidence confidence: Moderate: strong benchmark result, but solved and cost/rules are scope-sensitive.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Dario Amodei11 Nov 2024SWE-bench performance approaches 90% in another year, restated as at least 90% in another ten months.
Anthropic reported 93.9% on the original 500-task SWE-bench Verified, averaged over five trials, in an April 2026 system card.
OutcomeRightDirectionNot separately gradedMagnitudeWithin stated rangeTimingLate realization
2024-11-11
Original horizon: Another year; later in the same interview another ten months. Preserve both approximate autumn-2025 formulations.
Further evidence: This exceeds the target roughly five to seven months late; contamination concerns and absent independent replication limit broader coding-ability conclusions. The reported score crosses the original benchmark threshold, not an independently certified general software-engineering threshold.
Direction: Not separately graded in the historical record.
Magnitude: The later reported 93.9% exceeds approximately 90%; original-window results of 77.2% and 82% remain below target.
Timing: The April 7–8, 2026 report window is about five to seven months late; first internal attainment remains unknown.
Scope: The headline includes all 500 tasks and is a five-trial mean, not best-of-five selection or an easier filtered subset. Maximum-effort settings were used; the complete Verified-specific harness and token budget were not established. Developer-run contamination checks do not prove clean measurement. The current PDF is not an archived first-day snapshot; no global first is claimed. Both approximate interview horizons remain one forecast, and the original-window shortfall is retained.
Evidence confidence: Not separately rated.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Elon Musk7 Oct 2024By end 2025, AI produces a requested short movie; probably at least 15 minutes.
January 2025 FilmAgent generated narrative shorts from 15 selected ideas in constructed Unity settings/actions; human plot rating was 3.53/5, not overall 3.98.
OutcomePartly rightDirectionRightMagnitudePartly supportedTimingWithin original window
7 October 2024 publication; recording day unknown
Further evidence: Bounded narrative shorts supported; an inseparable 15-minute reading remains unresolved.
Direction: Real system capability; preforecast demonstrations limit distinctive foresight.
Magnitude: Probable 15-minute duration and general reliability unverified.
Timing: Bounded shorts documented within the window; no full-duration hit or known first attainment.
Scope: Developer evaluation, not independent replication. Full sample video not personally viewed. Human-built assets alone do not disqualify capability. Earlier Showrunner demonstrations and later scene-oriented limits counter promotional runtime claims. No professional-quality credit; 2026 evidence not backdated.
Shared evidence: Related 2022 undated formulation remains excluded; no retroactive horizon repair.
Evidence confidence: Moderate for qualified short-form judgment; original is coherently contextualized third-party transcription with corroborated public event/date, not independently authenticated speech. Full-duration result unresolved.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Gary Marcus26 Sep 2024Chart grade 25 / 100AI companies will record every keystroke typed in Microsoft Word during 2025.
A maintained Word product remained designed for fully disconnected operation throughout 2025, contradicting universal unavoidable AI-company collection.
OutcomeMostly wrongDirectionUnresolvedMagnitudeOverstated collection scopeTimingTiming unresolved
2024-09-26
Further evidence: Enabled Microsoft 365/Copilot configurations nevertheless process content and telemetry; no comprehensive absence-of-logging claim is made. Approximate miss only under literal universal reading; documented permanently offline Word architecture is a concrete counterexample. Rhetorical/cloud-only readings remain unresolved.
Direction: Actual narrower content processing and telemetry are real but were already present before the forecast; this evidence alone cannot demonstrate predicted new escalation.
Magnitude: Every keystroke across unqualified Microsoft Word use exceeds documented scope, including maintained disconnected LTSC 2024.
Timing: No onset of universal collection occurred under the stated literal reading; no separate deadline timing inference for a narrower replacement claim.
Scope: Literal universal reading only. Rhetorical or enabled-cloud interpretations remain unresolved. Offline-product evidence is not an audit of all Word; real cloud content processing and telemetry remain concerns.
Evidence confidence: moderate; strong product-scope evidence, interpretation-sensitive and no direct independent LTSC endpoint audit
Current edition contribution · Gary Marcus
Graded credit: 25 / 100.
- Recency weight
- 100%
- Credit × weight endpoint products
- 25
- Last documented backing
- 2024-09-26 to 2024-09-26
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 25 / 100
- Recency weight
- 100%
- Weighted credit term
- 25
- Same-claim backing date
- 2024-09-26 to 2024-09-26
Existing reviewed grade for the original scope; time intrinsic to that scope is retained.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
25,
25
]
},
"backingDateBounds": [
"2024-09-26",
"2024-09-26"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
25,
25
],
"weightBounds": [
1,
1
],
"normalizedBackingDateBounds": [
"2024-09-26",
"2024-09-26"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
25,
25
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Gary Marcus10 Sep 2024AI-generated misinformation is likely to drive increasing market manipulation.
FCA’s December 2025 guidance describes growing synthetic-video impersonation in pump-and-dump schemes.
OutcomePartly rightDirectionRightMagnitudeNot quantifiedTimingTiming unresolved
10 September 2024
Further evidence: FINRA’s January 2025 report describes growing adversarial GenAI use, including stock-price manipulation. Qualified qualitative continuation supported; specifically post-issuance growth remains unresolved.
Direction: Matched FCA characterization, with broader FINRA corroboration.
Magnitude: No numerical rate, scale or loss threshold was promised; no measured magnitude accuracy.
Timing: Contextual coming-years horizon, no fixed endpoint. Later publication does not date observations or onset.
Scope: Coming-years context precedes the specific clause; attachment is interpretive, not a repeated deadline. FCA guidance supplies no observation dates, counts or methods-level trend estimate. FINRA’s umbrella increase is not a measured increase for every subtype; its investment-group complaints are not established AI-generated. Preexisting misuse limits novelty. No first-emergence, precise post-forecast rate or distinctive-foresight claim.
Shared evidence: Distinct market-manipulation target; strongly related to broader synthetic misuse, not extra votes for the societal umbrella or each source.
Evidence confidence: Moderate-to-low for qualitative continuation; primary regulatory provenance but unknown observation windows and no methods-level trend measurement.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Andrej Karpathy5 Sep 2024Hope-qualified expectation of some Tesla camera-driving equivalency with Waymo within a few years.
NHTSA corroborates restricted 2026 driverless passenger deployment.
OutcomePartly rightDirectionRightMagnitudePartly supportedTimingTiming unresolved
2024-09-05 publication; recording unknown
Further evidence: Dated proxy context reasonably links deployed Cybercab to Tesla’s camera-only strategy; this is corporate-system inference, not independently certified per-vehicle hardware. Qualified local service convergence, not full Waymo parity.
Direction: Practical unattended service supports weak directional expectation.
Magnitude: Then-Waymo citywide 24/7 access was broader; operational maturity, reliability and safety parity unresolved.
Timing: Roughly two-year observations fit the outlook; vague endpoint and unresolved full equivalency preclude precise arrival credit.
Scope: Third-party, error-prone transcript; attribution inferred, audio unauthenticated. Hope may express aspiration rather than forecast; former Tesla affiliation. Mutable FAQ mentions cameras plus unspecified sensors, not a historical hardware audit. Regulator deployment corroboration is not safety approval. Broader equivalency and aspiration-only readings remain unresolved/unscored alternatives. No invented fleet, revenue, universal geography or zero-assistance requirement; prior autonomy limits novelty.
Shared evidence: Related vision/autonomy claims and shared Tesla outcomes are dependent, not extra votes.
Evidence confidence: Moderate for the bounded practical service comparison and camera-system inference; lower for original transcript exactness, aspiration-versus-forecast modality, broader equivalency and independent predictive information.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Gary Marcus28 Jul 2024The generative-AI bubble will begin bursting within 12 months.
Original bubble onset unresolved.
OutcomeUnresolvedDirectionMostly wrongMagnitudeUnresolvedTimingTiming unresolved
2024-07-28
Further evidence: Financing and infrastructure growth ran against a broad downturn interpretation but do not settle onset. Financial expansion can coexist with early, uneven or temporary bursting; it establishes neither profit nor fair valuation.
Direction: Checked financing and infrastructure-demand indicators oppose a broad downturn reading; this retained descriptive appraisal does not resolve original bubble onset.
Magnitude: Bubble-onset threshold and collapse magnitude unresolved; no stronger collapse target substituted.
Timing: Onset unjudgeable; no definitive missed date or reset of the original 2025-07-28 deadline.
Evidence confidence: Moderate for the scoped adverse commercial-direction evidence; insufficient for a full bubble-onset verdict.
Draft formula inputs
No draft score: out of scope. No vote, not zero.
Gary Marcus21 Jun 2024Chart grade 100 / 100GPT-5 will not be released during 2024.
OpenAI introduced GPT-5 on August 7, 2025.
OutcomeRightDirectionNot applicableMagnitudeNot applicableTimingCorrect lower bound
2024-06-21
Further evidence: The named model arrived after the excluded 2024 release window.
Direction: No independent directional capability claim in this record.
Magnitude: No quantitative capability magnitude forecast.
Timing: Correct not-before boundary; do not credit an exact August 2025 forecast.
Evidence confidence: high for named public-release result
Current edition contribution · Gary Marcus
Graded credit: 100 / 100.
- Recency weight
- 100%
- Credit × weight endpoint products
- 100
- Last documented backing
- 2024-06-21 to 2024-06-21
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 100 / 100
- Recency weight
- 100%
- Weighted credit term
- 100
- Same-claim backing date
- 2024-06-21 to 2024-06-21
Existing reviewed grade for the original scope; time intrinsic to that scope is retained.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
100,
100
]
},
"backingDateBounds": [
"2024-06-21",
"2024-06-21"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
100,
100
],
"weightBounds": [
1,
1
],
"normalizedBackingDateBounds": [
"2024-06-21",
"2024-06-21"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
100,
100
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Gary Marcus21 Jun 2024Chart grade 100 / 100GPT-5 will still hallucinate and make conspicuous errors when released.
Launch-era evaluations reported residual factual errors and unsupported answers despite substantial reductions from preceding models.
OutcomeRightDirectionRightMagnitudeFrequency not quantifiedTimingNot separately applicable
2024-06-21
Further evidence: The released model retained factual hallucinations and conspicuously unsupported answers. Developer evaluations establish this without relying on viral examples.
Direction: Residual unreliability persisted, while large measured improvements also occurred. Persistence is not a prediction that error rates would remain unchanged.
Magnitude: The original gives no operational quantity or severity threshold. Error rates vary greatly by task, browsing and model variant; no global frequency is inferred.
Timing: Capability was assessed at the specified release event; there is no independent calendar timing forecast here. The separate no-2024 forecast is D827.
Evidence confidence: Moderate-high for persistence; first-party evaluation and model-grader limits prevent population-wide frequency inference.
Current edition contribution · Gary Marcus
Graded credit: 100 / 100.
- Recency weight
- 100%
- Credit × weight endpoint products
- 100
- Last documented backing
- 2024-06-21 to 2024-06-21
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 100 / 100
- Recency weight
- 100%
- Weighted credit term
- 100
- Same-claim backing date
- 2024-06-21 to 2024-06-21
Existing reviewed grade for the original scope; time intrinsic to that scope is retained.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
100,
100
]
},
"backingDateBounds": [
"2024-06-21",
"2024-06-21"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
100,
100
],
"weightBounds": [
1,
1
],
"normalizedBackingDateBounds": [
"2024-06-21",
"2024-06-21"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
100,
100
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Kai-Fu Lee13 Jun 2024Chart grade 0 / 100Generative AI enters every existing app within 1.5–2 years.
Vivaldi still excluded integrated AI in June 2026; WhatsApp added optional summaries.
OutcomeWrongDirectionRightMagnitudeOverestimated at deadlineTimingOriginal deadline missed
2024-06-13
Further evidence: Literal universal target contradicted by Vivaldi.
Direction: WhatsApp illustrates real diffusion.
Magnitude: Universal coverage contradicted; adoption share unmeasured.
Timing: Counterexample documented after the latest deadline.
Scope: This counterexample does not measure overall adoption share. A rhetorical interpretation would remain unresolved.
Evidence confidence: High for literal counterexample; moderate overall because every may be rhetorical.
Current edition contribution · Kai-Fu Lee
Graded credit: 0 / 100.
- Recency weight
- 100%
- Credit × weight endpoint products
- 0
- Last documented backing
- 2024-06-10 to 2024-06-13
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 0 / 100
- Recency weight
- 100%
- Weighted credit term
- 0
- Same-claim backing date
- 2024-06-10 to 2024-06-13
This state-at-time, annual trajectory or original-period market/adoption predicate already includes time in its meaning. There is no separate event-arrival penalty to add back; preserve the reviewed original credit and temporal scope.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
0,
0
]
},
"backingDateBounds": [
"2024-06-10",
"2024-06-13"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
0,
0
],
"weightBounds": [
1,
1
],
"normalizedBackingDateBounds": [
"2024-06-10",
"2024-06-13"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
0,
0
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Kai-Fu Lee13 Jun 2024Inference costs: 10× lower within one year; 100× within two.
Studies estimate 5–10× and roughly 13× annual benchmark-matched cost declines over differing windows, partly supporting the scale of improvement. Whole outcome unresolved.
OutcomeUnresolvedDirectionRightMagnitudePartly supportedTimingTiming unresolved
2024-06-13
Further evidence: These are selected fixed-capability frontiers, not broader market rates. OECD’s broader quality-adjusted token-price index fell approximately 80% from January 2024 to April 2026. Zhu’s 2026 preprint estimates 0.728 log points of annual decline in a broader unweighted quality-adjusted posted-price index, January 2025–August 2026. Price-performance gains within measured scopes do not establish full numeric fulfillment; the original measurement unit is unspecified.
Direction: The contemporary observation window overlaps the forecast period and documents major fixed-performance price reductions across three benchmark domains.
Magnitude: Partial magnitude support applies to selected frontiers; broader indices are slower. Do not square pooled annual rates or equate different estimands.
Timing: Different observation windows; no matched endpoint ratios or numeric timing success/failure.
Scope: Frontier minima and broader market indices measure different objects and share Artificial Analysis inputs. Published token/list prices are not internal serving costs or observed transaction prices; task consumption and discounts matter. Zhu is a preprint with benchmark and window sensitivity, and its task-price sign is uncertain. Matched endpoints remain unverified; no numeric deadline verdict. Task and capability-age variation, benchmark limits, model switching and mixed API/rented-hardware costs remain. Zhu’s task-price interval includes declines; an alternative window reverses the point-estimate sign.
Evidence confidence: High for material price-performance improvement within measured scopes; moderate and method-sensitive for approximate magnitude; full numeric and deadline adjudication unresolved.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
François Chollet11 Jun 2024Chart grade 0 / 100Doubt that an LLM reaches 80% on ARC within a year, while allowing benchmark flaws or extensive similar-task training to produce high scores.
The December 20, 2024 high-compute preview scored 87.5%, challenging LLM-based timing, not proving AGI.
OutcomeNot applicableDirectionNot separately gradedMagnitudeNot quantifiedTimingIncorrect lower bound
2024-06-11
Original horizon: 2025-06-11
Further evidence: Qualified skepticism; ultimate capability unadjudicated.
Direction: Not separately graded in the historical record.
Magnitude: No separately documented rationale is available.
Timing: Predeadline report; first attainment unknown.
Scope: Original ARC; no added cost/release condition. Unchanged-pretraining claims unadjudicated.
Shared evidence: FC-C012, FC-2024-ARC-HN, FC-2024-ARC-COST, GM-C028: shared forecaster/evaluator evidence, not independent replication; no deadline reset.
Evidence confidence: Not separately rated.
Current edition contribution · François Chollet
Graded credit: 0 / 100.
- Recency weight
- 100%
- Credit × weight endpoint products
- 0
- Last documented backing
- 2024-06-11 to 2024-06-11
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
Selected deadline or scoped criterion only. This is not a whole-outcome grade. Archive timing: Incorrect lower bound.
- Credit
- 0 / 100
- Recency weight
- 100%
- Weighted credit term
- 0
- Same-claim backing date
- 2024-06-11 to 2024-06-11
Existing reviewed grade for the original scope; time intrinsic to that scope is retained.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
0,
0
]
},
"backingDateBounds": [
"2024-06-11",
"2024-06-11"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
0,
0
],
"weightBounds": [
1,
1
],
"normalizedBackingDateBounds": [
"2024-06-11",
"2024-06-11"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
0,
0
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Elon Musk23 May 2024Chart grade 100 / 100Grok could become competitive with OpenAI or Gemini by year-end 2024.
August 2024 comparisons place Grok-2 in the contemporary frontier-model range, with task-specific deficits retained.
OutcomeRightDirectionRightMagnitudeNot quantifiedTimingWithin original window
2024-05-23
Further evidence: The modest competitive-quality target is supported by multiple heterogeneous evaluations.
Direction: Relative capability improved into a credible competitive range.
Magnitude: No numeric margin or universal task threshold was specified.
Timing: Documented before year-end; no exact-date skill or internal first-attainment claim.
Evidence confidence: Moderate; original event reporting and developer evaluations, not independent reproduction.
Current edition contribution · Elon Musk
Graded credit: 100 / 100.
- Recency weight
- 100%
- Credit × weight endpoint products
- 100
- Last documented backing
- 2024-05-23 to 2024-05-23
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 100 / 100
- Recency weight
- 100%
- Weighted credit term
- 100
- Same-claim backing date
- 2024-05-23 to 2024-05-23
Existing reviewed grade for the original scope; time intrinsic to that scope is retained.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
100,
100
]
},
"backingDateBounds": [
"2024-05-23",
"2024-05-23"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
100,
100
],
"weightBounds": [
1,
1
],
"normalizedBackingDateBounds": [
"2024-05-23",
"2024-05-23"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
100,
100
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Sam Altman7 May 2024Chart grade 100 / 100Expects AI economic effects and U.S. leadership to be an issue in the 2024 U.S. election, perhaps less prominent than he advocates.
The 2024 major-party platforms explicitly addressed AI economic policy and innovation before the November election.
OutcomeRightDirectionRightMagnitudeNot quantifiedTimingWithin original window
2024-05-07
Further evidence: This establishes formal campaign issue presence, not voter salience or influence. Official party platforms establish the bounded issue-presence expectation; the advice that everyone should prioritize it is not graded.
Direction: AI economic and innovation policy appeared in campaign agendas.
Magnitude: No quantified issue prominence or voter share was forecast.
Timing: Dated July/August 2024 platforms appeared after the May forecast and before the November election.
Scope: AI-adjacent; low-information continuation of existing policy attention. No major-issue, voter-priority or decisive electoral-impact credit.
Evidence confidence: High for bounded official issue presence; no salience judgment.
Current edition contribution · Sam Altman
Graded credit: 100 / 100.
- Recency weight
- 100%
- Credit × weight endpoint products
- 100
- Last documented backing
- 2024-05-07 to 2024-05-07
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 100 / 100
- Recency weight
- 100%
- Weighted credit term
- 100
- Same-claim backing date
- 2024-05-07 to 2024-05-07
Existing reviewed grade for the original scope; time intrinsic to that scope is retained.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
100,
100
]
},
"backingDateBounds": [
"2024-05-07",
"2024-05-07"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
100,
100
],
"weightBounds": [
1,
1
],
"normalizedBackingDateBounds": [
"2024-05-07",
"2024-05-07"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
100,
100
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Jensen Huang24 Apr 2024Natural-language-understanding performance improves about twofold annually toward reliable answers.
A developer comparison disclosed before the first anniversary found roughly halved MMLU error between April-2024 GPT-4 Turbo and o3-high. Whole outcome unresolved.
OutcomeUnresolvedDirectionRightMagnitudePartly supportedTimingTiming unresolved
2024-04-24
Further evidence: Reading-comprehension and factuality counterweights improved less on different metrics. The broad continuing rate and real-world reliability endpoint remain unresolved. No named benchmark or full NLU denominator; selected tests cannot settle the continuing broad claim.
Direction: Same-suite comparison supports material capability gains.
Magnitude: One central language-understanding metric approximately matches contextual rate; reading-comprehension and factuality counterweights are weaker and differently measured.
Timing: Evidence predates first anniversary, but cannot establish ongoing annual rate or full reliability.
Scope: Accuracy/error ambiguity remains: contextual error-halving, not literal doubling of a percentage. No original benchmark, prompt, lineage, denominator or precise stopping threshold was specified. The same-event historical six-month assertion does not replace this annual forward claim. The April 21, 2025 repository commit pins disclosure, not an original April-2024 evaluation date. Developer-suite prompts and reasoning settings differ; no constant-compute or efficiency result follows. DROP is F1; SimpleQA correct fraction includes abstentions, so their complements are not hallucination probabilities. Exact published run counts, dataset hashes and run logs remain unverified; no sample size or uncertainty interval is invented. Related H-C023 shares a progress mechanism, not an independent validation.
Evidence confidence: High for reported table and chronology; limited for broad annual-rate inference.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Gary Marcus12 Apr 2024Doubts reliable unfamiliar-film comprehension, humor recognition and accurate spoiler-free summaries by end-2025.
2025 full-movie benchmarks show real comprehension alongside substantial narrative-reliability limits.
OutcomePartly rightDirectionPartly rightMagnitudePartly matched scopeTimingTiming unresolved
2024-04-12
Further evidence: Neither directly tests the full original conjunction. Approximately right for continuing gaps in ordinary film narrative comprehension and factual consistency, not for a categorical inability to understand movies. The full humor and spoiler-free synopsis conjunction is not adjudicated.
Direction: Two relevant primary evaluations find meaningful comprehension but persistent narrative errors and human-performance gaps. Title-only controls show why memorized plot knowledge cannot settle genuine viewing comprehension.
Magnitude: The weakness is substantive, not zero ability. Tested systems answer many narrative questions successfully; no benchmark rate is converted into the fraction of whole films understood.
Timing: Relevant limitations were observed in 2025, but the full conjunction and all late-2025 systems were not tested. No categorical deadline or perpetual-ceiling credit.
Evidence confidence: moderate-low for a partial historical narrative-reliability judgment; full target and later frontier coverage unresolved
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Gary Marcus12 Apr 2024Doubts AI off-road driving without maps, across streams and around obstacles such as fallen trees, by end-2025.
Field trials materially contradict the broad capability doubt, while full map-free obstacle conjunction and general reliability remain less completely measured.
OutcomeMostly wrongDirectionMostly wrongMagnitudeUnderestimated capabilityTimingTiming unresolved
2024-04-12
Further evidence: Substantial real off-road autonomy, including previously unseen terrain and creek-crossing courses, contradicts the core capability doubt. Exact joint performance on every listed obstacle without prior maps is not independently quantified.
Direction: The forecast was too pessimistic about practical off-road navigation; this is not merely a product announcement or road-driving proxy.
Magnitude: Program reports demonstrate a meaningful range of obstacles and terrain, but not universal field reliability. Remaining interventions and environmental limits prevent a categorical full-task refutation.
Timing: Core off-road performance was documented before end-2025, including trials predating the forecast. A January 2026 retrospective explicitly describes no-premapped-route capability and fall-2025 tests, but the full map-free/obstacle conjunction lacks an exact common dated protocol; no binary timing score proposed.
Evidence confidence: Moderate for substantial contrary capability evidence; sponsor/participant reports, no independent all-condition validation.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Gary Marcus12 Apr 2024AI is unlikely to clean unfamiliar houses or apartments by end-2025.
An April 2025 study demonstrated autonomous multi-step tidying components in three previously unseen homes, with substantial task progress and important limitations.
OutcomeMostly wrongDirectionMostly wrongMagnitudeUnderestimatedTimingTiming unresolved
2024-04-12
Further evidence: Real unfamiliar-home generalization challenges the pessimistic component; it is not proof of complete-house capability.
Direction: More task generalization arrived than this skeptical direction suggested.
Magnitude: Underestimated the attainable component capability; measured progress is not whole-task success.
Timing: Component counterevidence arrived before 2025 year-end; full-house timing remains unresolved, not a categorical deadline loss.
Evidence confidence: moderate; author-run experiments, cancelled trials excluded, limited homes and chores
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Geoffrey Hinton2024–2025 · rangeLong-run neural learning needs additional timescales, including temporary weight changes.
Nested Learning implements multiple update frequencies. Whole outcome unresolved.
OutcomeUnresolvedDirectionPartly rightMagnitudeUnresolvedTimingNo fixed deadline
Recorded April 2024; archived June 2025; intervening public issuance unknown.
Further evidence: Author-run classification and language-model experiments offer bounded support, but results are mixed. Memory and compute differences limit comparisons; some are omitted. Ablations report benefits without uncertainty intervals. Optimizer overhead remains; catastrophic forgetting is not generally solved. Full thesis unresolved.
Direction: Bounded mechanism corroboration.
Magnitude: Necessity and breadth unresolved.
Timing: No timing success claimed.
Scope: Necessity thesis, not merely one useful architecture; hardware conditional is dependent. Long run; no fixed deadline. December 2025 inspected revision; not earliest attainment. Implementation does not establish necessity, eventual dominance or universal deployment.
Shared evidence: One target; shared research lineage, not independent replications. Archive is not renewed endorsement.
Evidence confidence: Moderate for coherent attributed host paraphrase and reported research mechanism; lower for exact wording and general necessity. Automated transcript explicitly warns errors; outcome experiments are author-run and not independent replications.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Andrew Ng27 Mar 2024Chart grade 75 / 100Agentic workflows drive significant AI progress during 2024.
Qualified success: 2024 studies found substantial workflow-enabled gains in coding, math, QA and simulated service planning.
OutcomePartly rightDirectionRightMagnitudeUnresolvedTimingWithin original window
2024-03-27
Further evidence: Reflection sometimes hurt; practical reliability and field-wide contribution were not established. The previous evidence covered only software engineering. Two independent 2024 primary studies now add material gains in mathematical reasoning/question answering and multi-step service planning, while holding the execution model fixed. These satisfy a modest central reading of significant workflow-enabled progress across AI tasks. Quality remains limited and self-reflection sometimes degrades results; the verdict is approximate, not an unqualified hit.
Direction: Observed positive gains across coding, mathematics, QA and simulated service workflows, not only paper count or feature availability.
Magnitude: Significant has no numerical original threshold. Effects are material in their respective metrics, but no defensible all-field attribution percentage or contribution ranking is estimated.
Timing: All three primary outcome versions are from May–October 2024, after March 27 and before year-end. Later 2025 paper revisions are not used.
Scope: One combined workflow forecast. Added studies include fixed execution models but extra inference and optimizer/domain knowledge; not equal-compute, uniformly successful reflection, or autonomous production reliability.
Evidence confidence: Moderate for bounded multi-domain workflow capability gains; field-wide ranking, deployment reliability and equal-compute efficiency remain unestablished.
Current edition contribution · Andrew Ng
Graded credit: 75 / 100.
- Recency weight
- 100%
- Credit × weight endpoint products
- 75
- Last documented backing
- 2024-03-27 to 2024-03-27
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 75 / 100
- Recency weight
- 100%
- Weighted credit term
- 75
- Same-claim backing date
- 2024-03-27 to 2024-03-27
Existing reviewed grade for the original scope; time intrinsic to that scope is retained.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
75,
75
]
},
"backingDateBounds": [
"2024-03-27",
"2024-03-27"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
75,
75
],
"weightBounds": [
1,
1
],
"normalizedBackingDateBounds": [
"2024-03-27",
"2024-03-27"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
75,
75
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Elon Musk25 Mar 2024Chart grade 25 / 100Dedicated AI compute will grow by roughly 100 times annually for the next few years.
Epoch chip-sales capacity estimates grew about 3.8 times in year one and 10.4–10.5 times over two years, far below the projected rate.
OutcomeMostly wrongDirectionRightMagnitudeOverestimatedTimingNot separately applicable
2024-03-25 publication; recording day unverified
Further evidence: Rapid growth occurred, but the projected hardware-growth magnitude was substantially too high under this reading.
Direction: Dedicated accelerator capacity grew strongly.
Magnitude: Matched sales-derived hardware proxy was far below 100-fold annual growth; precise installed-compute error ratio is not established.
Timing: Not separately scored: the annual pace error is already in magnitude.
Evidence confidence: moderate; original transcription and metric ambiguity plus estimated sales rather than measured deployed capacity
Current edition contribution · Elon Musk
Graded credit: 25 / 100.
- Recency weight
- 100%
- Credit × weight endpoint products
- 25
- Last documented backing
- 2024-03-25 to 2024-03-25
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 25 / 100
- Recency weight
- 100%
- Weighted credit term
- 25
- Same-claim backing date
- 2024-03-25 to 2024-03-25
Existing reviewed grade for the original scope; time intrinsic to that scope is retained.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
25,
25
]
},
"backingDateBounds": [
"2024-03-25",
"2024-03-25"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
25,
25
],
"weightBounds": [
1,
1
],
"normalizedBackingDateBounds": [
"2024-03-25",
"2024-03-25"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
25,
25
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Elon Musk25 Mar 2024Electrical power will constrain AI growth in 2025 and beyond.
Microsoft stated in October 2025 that space/power availability constrained infrastructure and capacity remained short.
OutcomeRightDirectionRightMagnitudeNot quantifiedTimingWithin original window
2024-03-25 publication; recording day unverified
Further evidence: A major AI infrastructure operator confirmed the predicted material constraint.
Direction: Power availability remained a limiting factor as demand grew.
Magnitude: No numerical share, shortfall or universal exclusivity stated.
Timing: Constraint documented during 2025; this does not establish onset in 2025.
Evidence confidence: moderate; third-party original transcript with corroborated event identity, official outcome transcript
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Jensen Huang20 Mar 2024Within roughly five to ten years, real-time AI-generated pixels will largely characterize gaming and non-gaming experiences.
GameNGen supplied a post-issue interactive Doom proof of concept at 20 fps on one TPU. Whole outcome unresolved.
OutcomeUnresolvedDirectionPartly rightMagnitudePartly supportedTimingTiming unresolved
2024-03-20 publication; GTC press Q&A that week, exact speaking day unverified
Further evidence: It learned from existing gameplay, not a new game created freely from a prompt. The full gaming/non-gaming diffusion target remains unresolved. One research demonstration does not establish broad gaming/non-gaming diffusion.
Direction: Real-time neural generation of an interactive Doom environment is meaningful movement toward the proposed paradigm.
Magnitude: Prototype capability is supported; industry prevalence and cross-experience scope are unmeasured.
Timing: The multi-year transition window is open. Early component realization is not early fulfillment of the entire target.
Scope: Rough five-to-ten-year S-curve transition, not a first-ever existence claim or an exact 2030 deadline. Jarred Walton’s firsthand press transcription was edited for clarity; audio was not independently verified. Short memory, state errors, incomplete exploration and new-game creation limits remain. No conventional-game-quality parity, all-game-code generation or industry transition is established. No consumer-PC compute requirement is imported from reporter commentary. Related game-production-cost work remains held; this is one dependent paradigm target, not per-game or per-modality successes. Initial paper August 27, 2024; inspected version April 24, 2025.
Evidence confidence: High for existence and method limits; low for full diffusion outcome.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Yann LeCun7 Mar 2024Future Llama generations improve scale and multimodality, then pursue world-model planning.
Llama 3/3.2 supplied larger models, language-benchmark gains and tested visual capabilities. Whole outcome unresolved.
OutcomeUnresolvedDirectionRightMagnitudePartly matched scopeTimingNo fixed deadline
2024-03-07
Further evidence: Initial scale, language and visual milestones are supported; later world-model/planning stage remains unresolved.
Direction: The model lineage expanded scale, improved comparable language benchmarks and acquired visual input capability.
Magnitude: Several qualitative capability components materialized; no complete planning/world-model scope or numerical target established.
Timing: Original response declines a product-line research timetable. No fixed deadline, early/late label, or deadline success is assigned.
Scope: Only the initial capability stage is supported. Later planning remains unresolved; company benchmarks are not independent replication. This is a modest continuation forecast.
Evidence confidence: Moderate-high for the modest milestone; benchmarks are developer-reported and not universal capability tests.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Jensen Huang1 Mar 2024Host reports every-human-test capability in as little as five years.
2025 IMO gold-standard work and strong medical text-question results support progress. Whole outcome unresolved.
OutcomeUnresolvedDirectionRightMagnitudeUnresolvedTimingFuture window open
2024-03-01
Further evidence: Image exclusions and untested exams remain. The universal examination scope remains unresolved. Neither two favorable domains nor a selected question subset establishes every human test.
Direction: New post-issue systems achieved demanding competition and medical knowledge assessment results, supporting continued exam-performance progress.
Magnitude: All-test coverage and a common definition of passing remain unestablished. The medical study excludes image questions, while the IMO result concerns a special research model.
Timing: Five years after the March 2024 event is approximately March 2029, still future at cutoff. No premature full success or deadline miss.
Scope: Direction only. Host-report timing is not a newly verified verbatim hard deadline; all-test coverage and clinical competence remain unestablished. The inspected October 2026 HLE revision reports late-2024/early-2025 models, not a current-frontier retest. Adversarial selection, automated grading and expert disagreement limit inference; there is no standardized human pass mark. Specialized medical exams are included; existing bar-exam success was baseline evidence, not new credit. Human-mind equivalence remains a separately undefined target. The medical text subset is not a full licensing exam; no clinical-practice competence is inferred. Polish specialty results used a pre-issue model, not a current-frontier retest or post-issue capability gain. The later April 2024 benchmark-list formulation is narrower and ungraded; it does not reset the March wording or imply a 2026 endorsement.
Evidence confidence: High for repaired host-report attribution and scoped outcomes; moderate for directional inference only.
Later statement: 2024-04-24 (Later related benchmark-defined formulation; not a new independent target): Host transcript gives a five-year benchmark-list expectation distinct from ordinary AGI. This is narrower than every conceivable human test. Deadline: Within five years in this April version only; original March timing unchanged. Not counted separately. No adjudication of this version.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Demis Hassabis28 Feb 2024Chart grade 100 / 100Tentatively expect contextual camera, phone or glasses interaction in next-generation multimodal systems within roughly one year to eighteen months.
A Google announcement on April 7, 2025 described live camera-context interaction rolling out in March and expanding in April.
OutcomeRightDirectionNot separately gradedMagnitudeWithin stated rangeTimingWithin original window
2024-02-28
Original horizon: Publication-proxy window 2025-02-28 to 2025-08-28. Relative to publication proxy, not authenticated recording date. One-year-to-eighteen-month phrasing is approximate, not a precise all-or-nothing deadline.
Further evidence: This matches the specific interaction target within the forecast window, not universal understanding or autonomous execution. Live camera-context interaction realizes the specific forecast without implying broader intelligence or autonomy.
Direction: Not separately graded in the historical record.
Magnitude: No separately documented rationale is available.
Timing: The described March–April 2025 rollout falls within the original approximate window.
Scope: Demonstration, preview and rollout form one progression, not three independent prediction trials. The forecast window is measured from a publication-date proxy; recording date is unverified.
Evidence confidence: Not separately rated.
Current edition contribution · Demis Hassabis
Graded credit: 100 / 100.
- Recency weight
- 100%
- Credit × weight endpoint products
- 100
- Last documented backing
- 2024-02-28 to 2024-02-28
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 100 / 100
- Recency weight
- 100%
- Weighted credit term
- 100
- Same-claim backing date
- 2024-02-28 to 2024-02-28
Existing reviewed grade for the original scope; time intrinsic to that scope is retained.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
100,
100
]
},
"backingDateBounds": [
"2024-02-28",
"2024-02-28"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
100,
100
],
"weightBounds": [
1,
1
],
"normalizedBackingDateBounds": [
"2024-02-28",
"2024-02-28"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
100,
100
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Gary Marcus23 Feb 2024Chart grade 75 / 100Hallucination-free reliable chatbots will not arrive within about one year.
Independent legal-RAG tests in 2024 and leading-system disclosures around February 2025 documented residual errors, despite substantial improvements.
OutcomePartly rightDirectionNot applicableMagnitudeNot applicableTimingCorrect lower bound
2024-02-23
Further evidence: The practical forecast is supported by multiple leading systems; approximate credit avoids claiming an exhaustive universal impossibility proof.
Direction: No independent ultimate-capability direction is asserted.
Magnitude: No error-rate threshold is inferred for the separate undated claim.
Timing: Evidence immediately before and after the approximate one-year boundary supports the practical lower bound, not an exact-day census.
Evidence confidence: moderate; practical leading-system inference, not exhaustive proof of every chatbot
Current edition contribution · Gary Marcus
Graded credit: 75 / 100.
- Recency weight
- 100%
- Credit × weight endpoint products
- 75
- Last documented backing
- 2024-02-23 to 2024-02-23
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 75 / 100
- Recency weight
- 100%
- Weighted credit term
- 75
- Same-claim backing date
- 2024-02-23 to 2024-02-23
Existing reviewed grade for the original scope; time intrinsic to that scope is retained.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
75,
75
]
},
"backingDateBounds": [
"2024-02-23",
"2024-02-23"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
75,
75
],
"weightBounds": [
1,
1
],
"normalizedBackingDateBounds": [
"2024-02-23",
"2024-02-23"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
75,
75
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Demis Hassabis19 Feb 2024Chart grade 75 / 100Tentatively expects active, learning, task-accomplishing agents in roughly a couple of years, perhaps sooner.
AgentFly (2025) and related Memento-Skills (2026) report retained experience improving later tool-assisted tasks on held-out tests.
OutcomePartly rightDirectionRightMagnitudePartly supportedTimingTiming unresolved
2024-02-19
Further evidence: This supports a qualified research-capability match. Research demonstrations now support the previously missing learning component within integrated task agents. Qualitative scope, limited transfer and unreplicated author experiments warrant partial rather than full credit.
Direction: Task performance and experience-dependent adaptation both have measured support, unlike labels alone.
Magnitude: Broader step-change remains qualitative; limited task distributions do not establish open-world reliability or general user experience.
Timing: No exact crossing of the qualitative target is established. Pre-cutoff demonstrations fit rough chronology, but tentative horizon is not converted into categorical timing success or failure.
Scope: Author-run studies, not independent replications or broad deployment. Feedback and reference-answer judging assist adaptation; task transfer is limited, contamination risks remain, and headline multi-attempt results are not single-attempt reliability. Prior Mariner failure remains counterevidence. The original specifies neither weight updates nor a reliability percentage; the learning-and-task conjunction is retained. No exact first crossing or hard deadline is inferred.
Evidence confidence: Moderate for demonstrated capability component; lower for qualitative breadth and first attainment.
Current edition contribution · Demis Hassabis
Graded credit: 75 / 100.
- Recency weight
- 100%
- Credit × weight endpoint products
- 75
- Last documented backing
- 2024-02-19 to 2024-02-19
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 75 / 100
- Recency weight
- 100%
- Weighted credit term
- 75
- Same-claim backing date
- 2024-02-19 to 2024-02-19
Existing reviewed grade for the original scope; time intrinsic to that scope is retained.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
75,
75
]
},
"backingDateBounds": [
"2024-02-19",
"2024-02-19"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
75,
75
],
"weightBounds": [
1,
1
],
"normalizedBackingDateBounds": [
"2024-02-19",
"2024-02-19"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
75,
75
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Yoshua Bengio5 Feb 2024Tentatively, advanced-AI cyber threats become the next major concern after disinformation, perhaps one–two years after February 2024.
Provider-reported September 2025 AI-assisted espionage and separate controlled competence support emerging material threat; human decisions and model errors remained.
OutcomePartly rightDirectionRightMagnitudePartly supportedTimingWithin original window
2024-02-05
Further evidence: Bounded threat emergence supported; conditional infrastructure/catastrophe readings ungraded.
Direction: Actual misuse plus controlled competence, not merely generic coding gains.
Magnitude: Reliable autonomous end-to-end compromise, industrial breadth, comparative growth and generated-data causality unproved.
Timing: Bounded 2025 observations fit the tentative interval; no exact deadline, first-arrival or full-threshold credit.
Scope: Incident attribution/compromises lack independent verification or autonomy audit; published speed wording was corrected. AISI component tests neither validate that incident nor form one reliably autonomous system. Near-issue Microsoft reporting describes pre-existing misuse with limited visibility, not global absence or measured acceleration. Regulatory-antecedent and bare-possibility readings remain unscored; actual misuse cannot make a possibility-only forecast successful.
Shared evidence: Shared studies and related trajectory forecasts are dependent, not independent replications.
Evidence confidence: Moderate for qualified qualitative emergence; lower for independent incident attribution, broad infrastructure threshold and comparative/causal claims.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Gary Marcus27 Jan 2024Expects price competition among language-model suppliers.
Competing suppliers made substantial API price reductions later in 2024.
OutcomePartly rightDirectionRightMagnitudeNot quantifiedTimingWithin original window
2024-01-27
Further evidence: Observed price compression supports the central commercial direction.
Direction: Prices fell across competing suppliers.
Magnitude: No numerical cut was promised.
Timing: Cuts occurred within the article’s annual 2024 frame.
Evidence confidence: moderate; scope not separately specified.
Draft formula inputs
No draft score: out of scope. No vote, not zero.
Gary Marcus27 Jan 2024OpenAI’s Microsoft relationship will receive considerable scrutiny during 2024.
The CMA continued substantive information gathering during 2024, later concluding the partnership did not qualify for merger review.
OutcomeRightDirectionRightMagnitudeQualitatively supportedTimingWithin original window
2024-01-27
Further evidence: Documented continued inquiry and multiple information responses directly match scrutiny of the named relationship.
Direction: Institutional examination persisted after the forecast, rather than only pre-existing publicity.
Magnitude: The breadth and repeated information gathering support considerable scrutiny qualitatively; no count or adverse decision was promised.
Timing: 2024 actions fall inside the explicit annual framing. The 2025 decision authenticates prior activity but is not backdated.
Scope: Scrutiny component only, not wrongdoing or internal mission conflict. Very low novelty: FTC and CMA inquiries were already underway.
Evidence confidence: High for the narrow occurrence and dates; moderate for qualitative intensity
Draft formula inputs
No draft score: out of scope. No vote, not zero.
Gary Marcus27 Jan 2024OpenAI will survive with Microsoft support, but enthusiasm will fade.
OpenAI survived; October 2024 issuer announcement reported $6.6B financing at $157B valuation and more than 250M weekly ChatGPT users.
OutcomeMixedDirectionMixedMagnitudeMixed scale evidenceTimingTiming unresolved
2024-01-27
Further evidence: These contradict fading financial/adoption enthusiasm, not prove profits or universal public sentiment. Genuine opposing components produce the mixed judgment.
Direction: Survival right; broad financing/adoption fading approximately wrong.
Magnitude: Financial enthusiasm exceeded the pessimistic direction; sentiment is not fully quantified.
Timing: Undefined fading threshold prevents precise timing adjudication.
Evidence confidence: moderate; scope not separately specified.
Draft formula inputs
No draft score: out of scope. No vote, not zero.
Gary Marcus24 Jan 2024Chart grade 100 / 100Substantial generative-AI copyright litigation will continue during 2024.
Several major new newspaper and music-generation actions were filed in 2024.
OutcomeRightDirectionRightMagnitudeQualitatively supportedTimingWithin original window
2024-01-24
Further evidence: New filed actions support the forecast.
Direction: Litigation continued across multiple providers and media.
Magnitude: Qualitative intensity is supported; no numerical record inferred.
Timing: Actions followed the forecast within 2024.
Evidence confidence: moderate-high; scope not separately specified.
Current edition contribution · Gary Marcus
Graded credit: 100 / 100.
- Recency weight
- 100%
- Credit × weight endpoint products
- 100
- Last documented backing
- 2024-01-24 to 2024-01-24
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 100 / 100
- Recency weight
- 100%
- Weighted credit term
- 100
- Same-claim backing date
- 2024-01-24 to 2024-01-24
Existing reviewed grade for the original scope; time intrinsic to that scope is retained.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
100,
100
]
},
"backingDateBounds": [
"2024-01-24",
"2024-01-24"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
100,
100
],
"weightBounds": [
1,
1
],
"normalizedBackingDateBounds": [
"2024-01-24",
"2024-01-24"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
100,
100
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Paul Christiano1 Jan 202470% (unscored): by end-2024, an agent solves the specified 4×4 letter grid or comparable held-out replacements.
On 1 January 2025, Jessica Taylor reported seven valid comparable grids and one failure, explicitly crediting Paul.
OutcomePartly rightDirectionRightMagnitudePartly matched scopeTimingTiming unresolved
1 January 2024; same-day edit.
Further evidence: Qualified success under permitted replacements; exact original-grid performance remains unverified.
Direction: Successful comparable constraint composition, not general reasoning parity.
Magnitude: Seven observed successes, one failure; comparable difficulty is qualitative, with no repeatability or representative accuracy estimate.
Timing: Original 2024 deadline unverified: no hit, strict miss or one-day capability lateness inferred.
Scope: Original task: one constant row/column, another column with three equal letters, other rows/columns distinct. Comparable held-out replacements were allowed; no human error hints or fixed success-rate requirement. The 5×5 row/column/corners and 2×2 monochrome-block example supports qualitative comparability. Deterministic checks validate seven printed final grids, not every explanatory sentence or a new model test; the exact original grid is absent. A perimeter-alternation task still failed after clarification; another prompt clarified size. The shared messages are dated January 1, 2025, 20:40–21:03 UTC. Observation is not first capability acquisition. December 5 o1 availability does not fix the December 31 runtime: the system card’s December 19 addition describes December 17 improvements and production variation. Taylor’s credit is not formal bet settlement or substitution of her four-of-eight forecast. The explicit .70 event remains unscored: no binary resolution, Brier or log score. No later same-scope endorsement is inferred.
Shared evidence: One target and shared conversation context, not eight independent forecasts.
Evidence confidence: Moderate: exact original/probability, dated firsthand tests and inspectable outputs; subjective comparable difficulty and unverified deadline.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Yann LeCun1 Jan 2024Chart grade 75 / 100AI-glasses traction grows; leading companies expand wearable-AI efforts.
Counterpoint estimated non-AR smart-glasses shipments grew 210% in 2024 to over two million; Meta exceeded 60% share.
OutcomePartly rightDirectionRightMagnitudePartly supportedTimingWithin original window
2024-01-01
Further evidence: Snap released developer Spectacles and announced an OpenAI partnership in September. Qualified realization.
Direction: Tracked shipments and industry development increased.
Magnitude: Traction unquantified.
Timing: 2024 deadline. The market report appeared February 2025; later rival launches are not backdated.
Scope: Counterpoint’s proprietary estimate includes non-AI glasses but excludes AR-display glasses; Snap’s AR product is separate effort evidence, not added shipments. Its AI category requires local AI-capable processing, voice and camera support, not wholly local large-model inference. Shipments are not active users; Meta concentration limits industry breadth. Snap’s September 17 offering was developer-only, not mass consumer availability. Existing Ray-Bans, partnership rumors and 156% market growth in 2023 limit novelty; not invention or Meta scheduling. Comments corroborate themes only. No later same-scope endorsement is authenticated.
Shared evidence: Signoux, 2023-12-30; LeCun-endorsed. Dependent.
Evidence confidence: Moderate. Explicit author endorsement and dated corroboration; underlying edited text has no recovered revision history. Proprietary market estimates and developer-only counterevidence limit scope.
Current edition contribution · Yann LeCun
Graded credit: 75 / 100.
- Recency weight
- 100%
- Credit × weight endpoint products
- 75
- Last documented backing
- 2024-01-01 to 2024-01-01
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 75 / 100
- Recency weight
- 100%
- Weighted credit term
- 75
- Same-claim backing date
- 2024-01-01 to 2024-01-01
Existing reviewed grade for the original scope; time intrinsic to that scope is retained.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
75,
75
]
},
"backingDateBounds": [
"2024-01-01",
"2024-01-01"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
75,
75
],
"weightBounds": [
1,
1
],
"normalizedBackingDateBounds": [
"2024-01-01",
"2024-01-01"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
75,
75
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Yann LeCun1 Jan 2024Competition erodes ChatGPT’s assistant primacy; valuation falls.
ChatGPT retained tracked leadership; OpenAI’s (proxy) February employee tender was reported at $86B, versus $157B post-money in October financing.
OutcomeMostly wrongDirectionMixedMagnitudeNot quantifiedTimingOriginal window missed
2024-01-01
Further evidence: Some enterprise and regional mobile shares shifted to competitors. Qualified central bundle miss, not improvement on every competitive indicator.
Direction: Enterprise/regional erosion coexisted with leading tracked popularity and higher disclosed company valuation.
Magnitude: Declines unquantified; financial instruments and market denominators differ.
Timing: 2024 deadline was missed under the central reading; later changes do not reset it or resolve eventual status.
Scope: Google analogy unresolved; no 90% or Search-replacement claim; rank one does not exclude relative erosion. Erosion alone: mixed. Standalone value unavailable; neutral repricing untested. No authenticated January 1 valuation exists: February is not a pre-endorsement baseline. Tender and new-money post-money valuations differ; no exact return, stock-price or every-interim-mark claim. The tender excerpt relies on an unnamed source; OpenAI/Thrive declined comment. Cloudflare aggregates service domains in its resolver population, not all interactions; embedded products and regional coverage remain incomplete. Only 2024 observations are used from its March 2025 retrospective. Sensor Tower measures downloads/revenue, not population active use; US Q3 share of 45% is not global monopoly. Menlo’s enterprise foundation-model share fell from 50% to 34%; it surveyed 600 US IT decision-makers September 24–October 8 and disclosed Anthropic investment. Enterprise model share is not consumer-interface share. Carr’s January 6, 2025 report gave December visits of 3.7B, down 2.7% monthly; its inconsistent printed year-on-year year is excluded. Comments corroborate themes only. No later same-scope endorsement is authenticated; the numbered bundle is not split.
Shared evidence: Signoux, 2023-12-30; LeCun-endorsed. Dependent.
Evidence confidence: Moderate: explicit endorsement with dated thematic corroboration, but unknown edits; company financing and proprietary market measurement have distinct scope limitations.
Draft formula inputs
No draft score: AI link unclear. No vote, not zero.
Yann LeCun1 Jan 2024No significant model breakthrough; iterative gains enable cross-industry use.
2024 brought wider reported use, persistent factual errors and substantial reasoning gains. Whole outcome unresolved.
OutcomeUnresolvedDirectionPartly rightMagnitudePartly supportedTimingTiming unresolved
2024-01-01
Further evidence: The whole negative/positive bundle remains unresolved. Breakthrough/basic AGI undefined; bundle unresolved.
Direction: Practical usefulness and persistent unreliability partly match; genuine reasoning advances oppose the broad negative.
Magnitude: Adoption and factuality estimates are sample-bound. Technique-specific causal contributions remain unmeasured.
Timing: 2024 deadline; observations fit the year, not a full-bundle timing success. The adoption report appeared March 2025.
Scope: Edited source; timing/extent unknown. Contemporaneous comments corroborate themes only. GPT-5: illustrative. No perfection or release-as-resolution criterion. Persistent errors do not establish intrinsic impossibility or every intervention’s failure. OpenAI’s December 5 system-card evaluation reports SimpleQA accuracy of 47% for o1 versus 38% for GPT-4o, and hallucination rates of 44% versus 61%; PersonQA also improved without eliminating errors. Evaluated checkpoints may differ from production. SimpleQA’s 4,326 short factual questions mostly target GPT-4o/GPT-3.5 hallucinations; roughly 3% dataset error was estimated from a sample. No browsing; challenge-biased results are not everyday error prevalence or validated long-form performance. OpenAI’s September 12 comparison reports AIME single-attempt accuracy of 74% for o1 versus 12% for GPT-4o; 83%/93% require 64-sample consensus/1,000-sample reranking, not comparable single attempts. Evaluated o1 differs from the initial preview; maximum test-time compute is generally used. Later access notices are excluded. McKinsey’s July 16–31, 2024 survey had 1,491 respondents across 101 nations, GDP-weighted; 42% worked at firms above $500M revenue. Reported regular organizational generative-AI use in at least one business function was 71%, versus 65% in early 2024; functions included marketing, development, service, software and IT. Most users generated text, but other modalities were included. More than 80% reported no tangible enterprise-level EBIT impact. Self-report, not a representative organization census or causal technique test. The 2023 survey already found about one-third reporting regular organizational generative-AI use: 1,684 respondents, April 11–21, GDP-weighted. Samples are not a longitudinal panel; existing cross-industry use limits novelty. No later same-scope endorsement is authenticated; components are not separate votes.
Shared evidence: Signoux, 2023-12-30; LeCun-endorsed. Dependent.
Evidence confidence: Moderate for bounded local outcomes and issuance; low for a complete breakthrough/basic-AGI resolution.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Yann LeCun1 Jan 2024Chart grade 75 / 100Efficiency/sustainability drive small, better-quantized models into consumer devices.
Apple deployed a roughly 3B compressed on-device model with its October 28, 2024 rollout.
OutcomePartly rightDirectionRightMagnitudePartly supportedTimingWithin original window
2024-01-01
Further evidence: SpinQuant reported matched low-bit gains; Samsung reported Galaxy AI on over 100M devices, including a local translation feature. Google expanded its small-model offerings. Sustainability causation unmeasured; strict reading partial.
Direction: Models, quantization quality and consumer availability advanced, continuing existing trends.
Magnitude: Global acceleration/net emissions unmeasured.
Timing: 2024 deadline; only 2024 study versions and actual features count, not 2025/2026 updates or promised releases.
Scope: Apple links memory, power and inference costs to compression. Its production 3.7-bit model retained normalized 94.8% AlpacaEval 2.0 and 96.0% GSM8K scores: not lossless general performance. Its July 29 v1 is the technical anchor, not later-updated web text. October availability required supported hardware and US English; Apple/Samsung combine local and cloud processing. SpinQuant’s October 7 v3 Llama 2-7B eight-task mean at 4-bit weights/activations/KV was 64.0 versus LLM-QAT 44.9 and SmoothQuant 39.0; full precision was 66.9. Study authors reran baselines; Meta research is not independent validation. Samsung’s aggregate 100M figure is vendor-reported hybrid-device scale, not unique users of local small models; 200M was a future goal. Its July 12 publication refers to a June 11 event: date ambiguity is retained. Live Translate runs locally, but a company demonstration is not an accuracy guarantee. Google’s February 2B/7B Gemma releases, May additions and millions of downloads do not measure unique consumers or local use. Comments corroborate themes only. No later same-scope endorsement is authenticated.
Shared evidence: Signoux, 2023-12-30; LeCun-endorsed. Dependent.
Evidence confidence: Moderate: explicit endorsement, uncertain edit history, strong primary technical and availability evidence, vendor-reported scale and qualitative original magnitude.
Current edition contribution · Yann LeCun
Graded credit: 75 / 100.
- Recency weight
- 100%
- Credit × weight endpoint products
- 75
- Last documented backing
- 2024-01-01 to 2024-01-01
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 75 / 100
- Recency weight
- 100%
- Weighted credit term
- 75
- Same-claim backing date
- 2024-01-01 to 2024-01-01
Existing reviewed grade for the original scope; time intrinsic to that scope is retained.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
75,
75
]
},
"backingDateBounds": [
"2024-01-01",
"2024-01-01"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
75,
75
],
"weightBounds": [
1,
1
],
"normalizedBackingDateBounds": [
"2024-01-01",
"2024-01-01"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
75,
75
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Yann LeCun1 Jan 2024Chart grade 75 / 100Present-risk discussion outweighs existential-risk discussion.
Qualified approximate: matched-year government and selected news samples support greater present-risk emphasis.
OutcomePartly rightDirectionPartly rightMagnitudePartly supportedTimingWithin original window
2024-01-01
Further evidence: Selected government/news samples support greater present-risk emphasis; annual matching, selection and label/version limitations preclude a global conclusion.
Direction: The conservative present-risk union exceeds the broad existential/catastrophic comparator each quarter and excluding the two largest jurisdictions. China, Japan, Russia, the UK and UN reverse that pattern.
Magnitude: Dominance unquantified. The gap persists across risk mappings and utterance/document units; counts do not estimate global debate.
Timing: 2024 deadline. Outcome records fall within that calendar year; publication dates are later, not occurrence dates.
Scope: Not a global census; uneven coverage, automated tags, contrary jurisdictions and an imperfect news study limit confidence. Comments corroborate themes only. Risks, not necessarily realized harms.
Shared evidence: Signoux, 2023-12-30; LeCun-endorsed. Dependent.
Evidence confidence: Moderate-low: triangulation supports a qualified direction/content assessment, but exact-source edits, nonrepresentative sampling and automated classification limit certainty.
Current edition contribution · Yann LeCun
Graded credit: 75 / 100.
- Recency weight
- 100%
- Credit × weight endpoint products
- 75
- Last documented backing
- 2024-01-01 to 2024-01-01
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 75 / 100
- Recency weight
- 100%
- Weighted credit term
- 75
- Same-claim backing date
- 2024-01-01 to 2024-01-01
Existing reviewed grade for the original scope; time intrinsic to that scope is retained.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
75,
75
]
},
"backingDateBounds": [
"2024-01-01",
"2024-01-01"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
75,
75
],
"weightBounds": [
1,
1
],
"normalizedBackingDateBounds": [
"2024-01-01",
"2024-01-01"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
75,
75
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Daniel Kokotajlo29 Nov 2023Within four years, AI assistants implement most of Kokotajlo’s proposed experiments while he designs them and interprets results.
The counterparty conceded the personal-workflow target on August 16, 2026, before the November 29, 2027 deadline.
OutcomeRightDirectionNot separately gradedMagnitudeNot quantifiedTimingWithin original window
2023-11-29T19:48:45.734Z
Original horizon: 4 years; deadline 2027-11-29.
Further evidence: This is accepted early settlement, not an independent demonstration of most experiments, a first-capability date or general replacement of AI researchers. Explicit counterparty concession supports the preserved personal-workflow target, without extending it to general research replacement.
Direction: Not separately graded in the historical record.
Magnitude: No separately documented rationale is available.
Timing: Settlement preceded the original deadline; its lead time is not a point-date error or exact attainment date.
Scope: The original deadline is still future at the review cutoff. Actual first attainment remains unknown, and counterparty acceptance is not an independent capability audit.
Evidence confidence: Not separately rated.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Yoshua Bengio10 Nov 2023AI helps yield scientific breakthroughs over the next decade.
2024 public results reported new quantum-design patterns and a physically tested AI-assisted mechanism.
OutcomePartly rightDirectionRightMagnitudeUnresolvedTimingWithin original window
10 November 2023 publication; exact interview day unstated
Further evidence: Qualified approximate scientific contributions, beyond benchmark gains; humans remain essential.
Direction: AI contributed to new scientific findings.
Magnitude: Breakthrough significance is undefined; no numerical, prize or field-revolution threshold is supplied.
Timing: Post-issue public results fall within the decade; first private conception dates and whole-decade completion are not established.
Scope: Six of twenty theoretical targets generalized; two patterns were new. That theoretical study supplied neither physical implementation nor universal formal proof. A separate experiment was human-led; no independent replication checked. Prior frameworks/physics and uncertain private discovery dates limit novelty. Original version history and a dated institutional account establish 2024 publicity despite a later HTML dateline; 2026 peer review is not backdated. Institutional corroboration is not independent replication. No autonomous science or uniform field transformation.
Evidence confidence: Moderate: authenticated interview and primary studies, but qualitative breakthrough interpretation and some discovery-date uncertainty.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Elon Musk10 Nov 2023Around 2024, AI compute bottlenecks would shift from silicon availability toward voltage-transformer supply that constrains powering the chips.
Hydra Host faced transformer constraints for a planned AI facility.
OutcomePartly rightDirectionPartly rightMagnitudeNot quantifiedTimingTiming unresolved
10 November 2023 publication; recording day unknown.
Original horizon: About one year; exact transition and tolerance unknown.
Further evidence: Suppliers reported scarcity; Microsoft identified power rather than chips as its December 2024 constraint.
Direction: Qualified support across different operators, not an industry-wide ranking.
Magnitude: No numerical scale specified.
Timing: Timing remains unjudgeable.
Limits: Transformers were scarce before issuance. Cooling and sites also constrained Hydra Host; Microsoft did not identify transformers specifically. Blackwell remained backlogged. No universal chip glut or exclusive transformer dominance is established.
Shared evidence: Separate equipment-supply target; no duplicate vote for the related general-electricity branch.
Evidence confidence: Moderate; cross-source inference, not a measured industry-wide ranking.
Provenance: Host transcript and reporting; audio not independently authenticated.
Draft formula inputs
Not in this 424-record calculation edition. No score assigned here.
Stuart Russell6 Nov 2023Next-generation systems in 2024 would be ten times more powerful than contemporary GPT-4.
Matched 2024 technical-chat evaluations improved; multimodal gains and contrary text/code parity support uneven progress, not a tenfold overall-power result. Whole outcome unresolved.
OutcomeUnresolvedDirectionPartly rightMagnitudeUnresolvedTimingTiming unresolved
6 November 2023 publication; earlier interview, exact day unknown.
Further evidence: Undefined unit: neither a tenfold hit nor miss follows.
Direction: Arena-Hard gains against GPT-4-0314; GPT-4o parity with Turbo limits generality.
Magnitude: Preference scores, task accuracy, speed and compute are not interchangeable.
Timing: Directional observations fit 2024; the original window ended but the full target remains unresolved.
Scope: The original first called the question difficult and speculative; no numeric probability was supplied. Adjacent model/data scaling does not define power as training compute. Dutch interview publication, not an asserted immutable snapshot. Arena-Hard Auto v0.1 has 500 mostly technical single-turn prompts: GPT-4-0314 is anchored at 50; January 2024 GPT-4-0125-preview scores 78.0 and April GPT-4-Turbo-2024-04-09 scores 82.6 with a GPT-4 judge. January scores 76.3 with Claude 3 Opus; no separate Claude-judge result for April. These transformed preference scores are not accuracy or intelligence ratios; selection, verbosity and self-bias remain. OpenAI’s May 13 GPT-4o report describes multilingual/vision/audio improvements but English-text/code parity with GPT-4 Turbo; launch availability was narrower than demonstrated modalities. ControlBench’s April 4 v1 has human experts judge 147 undergraduate control problems: GPT-4 solves 67 versus Claude 3 Opus 86, or 70 versus 101 with self-checking. On 100 multiple-choice questions GPT-4 initially leads 64–59; Claude leads after self-checking 83–78. The GPT-4 snapshot is unspecified, so this is not the exact 2023 baseline anchor. Sampling variability, persistent errors and task/elicitation dependence prevent a universal gain inference.
Shared evidence: Related general-progress forecasts and shared evidence are not independent replication.
Evidence confidence: Moderate for directional progress; low for the undefined full magnitude.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Gary Marcus5 Nov 2023Within a few years, the self-driving industry would likely be viewed as a major failure because of difficult edge cases and inadequate reasoning.
GM ended Cruise robotaxi funding in December 2024, but other operators subsequently reported substantial paid or operational driverless service and public launches in the US, China and UAE.
OutcomeMostly wrongDirectionMostly wrongMagnitudeOverstated industry scopeTimingTiming unresolved
2023-11-05
Further evidence: Approximately wrong on the broad industry-failure trajectory: multiple operating services expanded substantially after the forecast, rather than the whole field being defeated by technical outliers. The literal worldwide reputational verdict and sector profitability are not measured.
Direction: Expansion and commercial service across several countries contradict the central generalization. Cruise’s withdrawal is genuine supporting counterevidence, so this is not a categorical declaration of industry success.
Magnitude: The whole-industry characterization overgeneralized a real and important firm-level failure. No quantitative profitability or service threshold was supplied.
Timing: A few years is not an exact deadline. Assess observed direction through the fixed cutoff, not a binary November 2026 miss or a permanent verdict.
Evidence confidence: Moderate for the scoped trajectory judgment; operator statistics, undefined reputation and unresolved economics limit the full target.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Andrej Karpathy2023–2024 · rangeWithin a few years, one LLM-centered system combines knowledge, tools, multimodality, deliberation, rewarded improvement, customization and model communication.
Gemini integrates visual/media interaction and short music; ChatGPT integrates tools; R1 develops rewarded reasoning; Anthropic deploys model coordination. Whole outcome unresolved.
OutcomeUnresolvedDirectionRightMagnitudePartly supportedTimingTiming unresolved
November 2023 slide month; exact issue day unverified
Further evidence: Components, not a verified complete system. Full integrated-system and all-subject knowledge-superiority target unresolved.
Direction: Post-2023 integration progressed; not first invention.
Magnitude: Partial coverage; all-subject human comparison and completion percentage unverified.
Timing: Components appeared roughly 1–2.3 years later; no full-target crossing or exact deadline hit.
Scope: Tools/other models allowed; neither literal OS replacement nor shared weights required. Author-attributed, contemporaneously linked slides lack an immutable contemporary archive; audio wording remains unverified. Pre-2023 functions and affiliated customization plans add little predictive information. Reward learning is domain-limited and pretrained; deliberation need not be literal tree search. No unrestricted self-modification. Custom GPTs configure rather than fine-tune weights. Providers report access limits, errors and coordination costs; whole-system reliability remains unverified. One reviewer’s three short tracks had mixed quality, not general musical-quality or commercial-fitness evidence. Shared studies are dependent.
Evidence confidence: Moderate for broad realized functionality; lower for complete system integration, universal knowledge comparison and exact original-publication provenance.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Dario Amodei9 Oct 2023During 2024, reliability, task length, tool use, multimodality and commercial applicability improve.
SWE-agent raised matched GPT-4 Turbo SWE-bench resolution 1.31%→12.47%.
OutcomePartly rightDirectionRightMagnitudePartly supportedTimingTiming unresolved
9 October 2023 host memo; recording day unknown
Further evidence: Historical HCAST: GPT-4 0314 0.23 versus old/new Claude 3.5 Sonnet 0.38/0.46; GPT-4o 0.30 equaled GPT-4 1106. AgentDojo Claude 3→3.5 Sonnet benign utility rose 53.10→78.22. Qualified bounded basket progress; stronger field-wide reading unresolved. Commercial improvement is inferred from capability gains plus use, not measured before/after.
Direction: Additional useful capability, not universal newer-model improvement.
Magnitude: Low success and adversarial failures limit broad reliability; original strong adjectives supply no precise threshold.
Timing: 2024 releases/use are dated; later evaluations cannot establish contemporaneous full-basket attainment.
Scope: 2024 voice/video releases broadened modalities; provider robustness limits remain. Surveyed UK journalists used AI in 2024: self-report, nonresponse, broad AI definition; no causal productivity. Synthetic/selected software tasks, later scaffolds, added inference/custom interfaces and imperfect human baselines limit generality. No horizon multiplier, future-model backdating or blanket timing hit.
Shared evidence: Separate investment/science branches ungraded. Related trajectories/shared studies are dependent; prior progress and commercial influence limit novelty.
Evidence confidence: Moderate for bounded progress; lower for faithful strength/qualification of the original because the available source is the host’s firsthand episode summary, not authenticated speaker audio or a verbatim transcript.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Sam AltmanSep–Nov 2023 · rangeChart grade 75 / 100Two-year progress in multimodality, reasoning/reliability and personal/external-data use.
Reasoning, multimodality and deployed personal/external-data functions advanced substantially in 2024–July 2025.
OutcomePartly rightDirectionRightMagnitudeUnresolvedTimingWithin original window
2024-01-11 publication; recording inferred September 25–November 16, 2023
Further evidence: Substantial, not universal, progress across the forecast basket.
Direction: All named areas advanced.
Magnitude: No numerical improvement threshold or prevalence was set. Comparative importance remains qualitative and unresolved; do not turn the best-of-10,000 aspiration into a promised score.
Timing: Supporting outcomes occur before September 2025, within the inferred original two-year window. Exact completion date for a broad basket is not defined; no January 2026 reset or claim every aspect finished.
Scope: Reliability remains mixed; comparative importance and universal performance are unverified. Recording interval inferred September–November 2023; publication does not reset it. One multi-part capability-development outlook. Affiliated forecast with privileged knowledge; not a named imminent product delivery schedule. Later reasoning models can hallucinate more; audio task failures, policy restrictions and unvalidated connector reliability remain.
Shared evidence: Earlier related version: AP reported June 2023 Delhi remarks anticipating substantial hallucination improvement and reduced practical concern in 18–24 months, approximately December 2024–June 2025. Exact day and audio are unverified; not a zero-error promise. Full practical reliability remains unresolved. This earlier related forecast is not a separate vote: the later basket neither resets this window nor inherits its assessment.
Evidence confidence: Moderate: primary original, developer quantitative reasoning evidence, independent preliminary audio evaluation, and dated developer product functionality. Broad qualitative target lowers information value.
Current edition contribution · Sam Altman
Graded credit: 75 / 100.
- Recency weight
- 99.3917808219178–100%
- Credit × weight endpoint products
- 74.54383561643836–75
- Last documented backing
- 2023-09-25 to 2023-11-16
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 75 / 100
- Recency weight
- 98.98630137–100%
- Weighted credit term
- 74.23972603–75
- Same-claim backing date
- 2023-09-25 to 2023-11-16
Existing reviewed grade for the original scope; time intrinsic to that scope is retained.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
75,
75
]
},
"backingDateBounds": [
"2023-09-25",
"2023-11-16"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
75,
75
],
"weightBounds": [
0.9898630136986302,
1
],
"normalizedBackingDateBounds": [
"2023-09-25",
"2023-11-16"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
75,
75
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Dario Amodei25 Sep 2023Within 24–36 months, scaling existing approaches should yield major capability gains without algorithmic advances.
Controlled familiar-method scaling projected downstream performance across four compute orders; pretrained Llama3 70B→405B: MMLU rose 79.3→85.2, MATH rose 41.4→53.8; RACE fell 59.0→58.1.
OutcomePartly rightDirectionRightMagnitudeUnresolvedTimingWithin original window
25 September 2023 publication; exact recording day unknown
Further evidence: Qualified gains; huge frontier leap unestablished; exact zero-innovation counterfactual unmeasured. Benchmark regressions; shared developer evidence.
Direction: Gains supported.
Magnitude: Original huge/amazing magnitude and 100-fold investment scenario remain unestablished; no numerical threshold invented.
Timing: July 2024 evidence predates the approximate 2025–2026 endpoint; no minimum waiting period or exact first crossing.
Scope: Data/compute growth allowed; identical code or fixed hyperparameters are not prerequisites. Architecture, data, configurations varied; developer study, not independent replication. No all-task superiority, AGI, autonomous work, unlimited scaling or economic fulfillment. Affiliated-lab continuation expectation, not exceptional foresight; no later same-scope endorsement established. Final benchmark comparisons alone do not establish causation.
Shared evidence: Shared Llama evidence is dependent. Related September 2023 TechCrunch wording adds no target; investment/inference branches remain ungraded.
Evidence confidence: Moderate for qualified finite familiar-method scaling; lower for the exact zero-innovation counterfactual and ambitious frontier magnitude.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Gary Marcus21 Sep 2023Chart grade 75 / 100Cautiously expects actual AI legislation within six months.
December 2023 NDAA enacted limited defense AI-governance provisions; the named National AI Commission bill remained introduced.
OutcomePartly rightDirectionPartly rightMagnitudePartly supportedTimingWithin original window
2023-09-21
Further evidence: Limited binding legislation supplies partial fulfillment.
Direction: Actual legislation moved forward in a narrower setting.
Magnitude: Broader civilian oversight was not delivered.
Timing: NDAA enactment preceded the six-month boundary.
Evidence confidence: moderate; narrow statutory fulfillment versus broader civilian context
Current edition contribution · Gary Marcus
Graded credit: 75 / 100.
- Recency weight
- 99.32602739726028%
- Credit × weight endpoint products
- 74.4945205479452
- Last documented backing
- 2023-09-21 to 2023-09-21
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 75 / 100
- Recency weight
- 98.87671233%
- Weighted credit term
- 74.15753425
- Same-claim backing date
- 2023-09-21 to 2023-09-21
Existing reviewed grade for the original scope; time intrinsic to that scope is retained.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
75,
75
]
},
"backingDateBounds": [
"2023-09-21",
"2023-09-21"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
75,
75
],
"weightBounds": [
0.9887671232876712,
0.9887671232876712
],
"normalizedBackingDateBounds": [
"2023-09-21",
"2023-09-21"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
75,
75
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Ben Goertzel19 Sep 2023Over coming years, language models transform professional software by converting loose requests into structured tool inputs.
Data Formulator 2: eight company participants completed supplied charts using language plus GUI controls; six needed hints.
OutcomePartly rightDirectionRightMagnitudePartly supportedTimingTiming unresolved
19 September 2023.
Further evidence: TaskLens: 32 beginners completed prepared Blender tasks; authors report an animation benefit, but no statistically established simpler-task time advantage. Approximately right only for bounded functional tool use.
Direction: Useful language-to-executable interfaces.
Magnitude: Partial, engineered-task attainment; full revolution unresolved.
Timing: Post-issue evidence; soft horizon, no full-revolution completion date.
Scope: No randomized productivity comparator in Data Formulator 2; generated transformations differ from GUI-specified charts. TaskLens used prepared interfaces and human refinement; its ANOVA degrees of freedom present an unresolved reporting/model-specification discrepancy, so no independently validated effect size/significance claim. ScaffoldUI/TaskLens are one dependent lineage. Government Copilot evaluations were nonrandom/self-reported and identified Excel limitations; overall prose benefits do not verify this mechanism. No broad adoption or sustained workplace transformation established.
Evidence confidence: moderate for bounded functional interpretation; lower for broad transformation
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Dario Amodei8 Aug 2023AI research assistance progresses eventually toward models leading scientific work.
AlphaEvolve reported verified algorithm improvements, including reducing Gemini training time and expert kernel-development effort. Whole outcome unresolved.
OutcomeUnresolvedDirectionRightMagnitudeUnresolvedTimingNo fixed deadline
2023-08-08 publication; recording day unknown
Further evidence: This supports the assistance stage, not models becoming the main contributor to scientific progress. The complete trajectory is unresolved. Model-led science across the forecast scope is not established by a narrow algorithm-discovery system.
Direction: Substantive AI-assisted improvements to AI infrastructure and algorithm research occurred after the statement.
Magnitude: No global contribution-share measure is supplied; a kernel speedup is not a scientific-productivity multiplier.
Timing: The eventual endpoint is explicitly long-run but undated. No endpoint timing credit; the adjacent two-to-three-year conversational target is not borrowed.
Evidence confidence: Moderate for narrow assistance direction; low for global endpoint resolvability.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Dario Amodei8 Aug 2023Chart grade 75 / 100Expects better model-behavior diagnosis and control methods over two to three years, not a binary solution to alignment.
By March 2025, Anthropic reported new circuit-tracing diagnostics for concerning model behavior.
OutcomePartly rightDirectionRightMagnitudeUnresolvedTimingWithin original window
2023-08-08
Further evidence: February 2025 classifier experiments reduced tested jailbreak success from 86% to 4.4%, with residual failures and overhead. Alignment-faking experiments also exposed unresolved control weaknesses. Concrete new diagnostic and control methods support incremental progress, not the full safety of more powerful models.
Direction: Both behavior-understanding tools and measured robustness improvements appeared after the forecast.
Magnitude: No specific improvement threshold; experiments cannot quantify overall catastrophic-risk reduction.
Timing: Limited progress was documented before the outer August 2026 bound. This is timing of partial realization only, not a claim that alignment was solved.
Evidence confidence: Moderate; primary developer-reported experiments establish specific progress, not overall safety.
Current edition contribution · Dario Amodei
Graded credit: 75 / 100.
- Recency weight
- 98.6027397260274%
- Credit × weight endpoint products
- 73.95205479452055
- Last documented backing
- 2023-08-08 to 2023-08-08
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 75 / 100
- Recency weight
- 97.67123288%
- Weighted credit term
- 73.25342466
- Same-claim backing date
- 2023-08-08 to 2023-08-08
Existing reviewed grade for the original scope; time intrinsic to that scope is retained.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
75,
75
]
},
"backingDateBounds": [
"2023-08-08",
"2023-08-08"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
75,
75
],
"weightBounds": [
0.9767123287671233,
0.9767123287671233
],
"normalizedBackingDateBounds": [
"2023-08-08",
"2023-08-08"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
75,
75
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Noam ShazeerAug–Sep 2023 · rangeChart grade 75 / 100Within a few years, leading-company AI capabilities could become attainable in academic labs or garages.
Ai2/University of Washington released Tülu 3 405B on January 30, 2025, showing broad text-capability diffusion with mixed comparisons to November 2024 GPT-4o.
OutcomePartly rightDirectionRightMagnitudePartly supportedTimingTiming unresolved
25 September 2023 publication; recorded August, exact day unknown.
Further evidence: Qualified approximate diffusion in one academic/institute model, not merely s1’s narrow mathematics result.
Direction: A joint academic/institute project reported broad text capability and released model artifacts.
Magnitude: No complete 2023 capability basket, exact parity or garage-affordability threshold established.
Timing: Release followed within eighteen months; few years is not an exact deadline. A later comparator does not establish original-basket timing.
Scope: Meta pretraining, commercial teacher outputs and 256 GPUs remain dependencies; incremental post-training is not total system cost. Mixed English-text benchmarks: stronger BBH/instruction-following, weaker MMLU/math/code and preference scores; long-context, multi-turn, multilingual and tool-use coverage is inadequate. Development-set overfitting and missing broader held-out 405B comparisons limit inference. AlpacaEval’s 805 instructions use length-adjusted model judgments against November 2023 GPT-4 preview; 51.4 versus 65.0 is preference performance, not factuality or comprehensive parity. Pinned standard-baseline code cannot rule out an unreported run override. January’s repository revision lists weights, but commits do not establish public visibility; dated announcement anchors release. Model/data terms restrict access; no weights were run or benchmarks independently reproduced. April 14, 2025 report v5 is not the smaller-model November 2024 release. s1’s January/March 2025 evidence retains Qwen/Gemini dependence, mathematics gains and weaker GPQA; not broad parity or a lone garage experiment. Prior open-model adaptation limits novelty. Could is not numeric probability; repeated NS-C058 adds no vote or present endorsement.
Evidence confidence: Moderate for limited diffusion; low for comprehensive scope or temporal precision.
Current edition contribution · Noam Shazeer
Graded credit: 75 / 100.
- Recency weight
- 98.4876712328767–98.98082191780821%
- Credit × weight endpoint products
- 73.86575342465753–74.23561643835616
- Last documented backing
- 2023-08-01 to 2023-08-31
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 75 / 100
- Recency weight
- 97.47945205–98.30136986%
- Weighted credit term
- 73.10958904–73.7260274
- Same-claim backing date
- 2023-08-01 to 2023-08-31
Existing reviewed grade for the original scope; time intrinsic to that scope is retained.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
75,
75
]
},
"backingDateBounds": [
"2023-08-01",
"2023-08-31"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
75,
75
],
"weightBounds": [
0.9747945205479452,
0.983013698630137
],
"normalizedBackingDateBounds": [
"2023-08-01",
"2023-08-31"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
75,
75
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Ajeya Cotra27 Jul 2023Chart grade 75–100 / 100Greater than 50% probability that over half of WebArena’s tasks would be solved by end-2024.
Event resolved under the ordinary maintained-benchmark reading: author-run ScribeAgent-Small with GPT-4o reported 51.3% on all 812 tasks in November 2024; December’s larger-model revision reported 53.0%.
Probability>50%2023-07-27EventOccurredconditionalBrier loss[0, 0.25)lower is better
2023-07-27
Original probability bound: 2023-07-27: p(event)>50%. This is an inequality, not an exact probability.
Event resolution: More than half of original WebArena tasks solved by end-2024. Event outcome=1 (yes, under the ordinary benchmark interpretation).
Algebraic score ranges: Supplied algebraic ranges (numeric endpoints as stored), from the inequality and event outcome only: Brier ∈ [0, 0.25); natural-log loss ∈ [0, 0.6931471805599453) nats. These are ranges, not observed point scores; lower loss is better.
Range qualification: Bounds follow algebraically from p in (0.5,1] and y=1; they are not a reported precise probability or point score. The modal event occurring is not evidence of calibration by itself.
Outcome dates: No later than 2024-11-22; corroborating revised result published 2024-12-05.
Bounded probability scope: Probability bounds/event resolution are stored separately in probability_forecast, never passed to point-probability scoring. Qualitative axes remain N/A; no precise p or loss emitted.
Interpretation: No exact probability, midpoint, Brier score or log-loss point is inferred. The event resolution is not a categorical probability win or loss, calibration estimate, or person-wide reliability score. Revisions remain the same event and add no forecast counts. All four qualitative axes remain not applicable.
Further evidence: Event resolution, not a probability-accuracy verdict.
Direction: Not separately graded for this probability event.
Magnitude: Task threshold and probability bound, not exact capability or probability points.
Timing: Deadline belongs to the event definition, not a separate timing win.
Scope: No added single-agent, cost, fine-tuning or public-product requirement; market odds are not Cotra’s. Evaluation’s user-role steps and inserted scrolling were automated; training used human-created workflows, not documented live evaluation help. The modest Small-model margin already clears the threshold despite the revised table’s inconsistent Small-only caption. Not VisualWebArena, the 158-task ablation or general real-world reliability. Maintained annotations include October 2023 bug fixes; literal frozen July 2023 equivalence was not rescored. Proprietary training data/weights limit auditability; no contamination-free or deployment-scale inference. The current team listing is not an immutable 2024 snapshot or independent trajectory reproduction. The repository was archived in October 2026 and alone does not date attainment. Benchmark task completions are not latent probabilities for arbitrary tasks; no extra confidence-interval hurdle. One event; the two paper versions add no observations.
Evidence confidence: High original attribution and horizon; moderate outcome confidence from dated author-run evaluations and benchmark-team listing, without independent reproduction of the full trajectories.
Current edition contribution · Ajeya Cotra
Graded credit: 75–100 / 100.
- Recency weight
- 98.40547945205479%
- Credit × weight endpoint products
- 73.80410958904109–98.40547945205479
- Last documented backing
- 2023-07-27 to 2023-07-27
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
Selected probability event only. This is not a whole-outcome grade. Archive timing: Not separately applicable.
- Credit
- 75–100 / 100
- Recency weight
- 97.34246575%
- Weighted credit term
- 73.00684932–97.34246575
- Same-claim backing date
- 2023-07-27 to 2023-07-27
- Authored probability
- 50–100%
- Event outcomes retained
- 1
Brier credit on the original event, including its stated window. No separate timing deduction.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "binary_probability",
"probabilityBounds": [
0.5,
1
],
"outcomes": [
1
],
"probabilityClosed": [
false,
true
]
},
"backingDateBounds": [
"2023-07-27",
"2023-07-27"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
75,
100
],
"weightBounds": [
0.9734246575342466,
0.9734246575342466
],
"normalizedBackingDateBounds": [
"2023-07-27",
"2023-07-27"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
75,
100
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Geoffrey Hinton29 Jun 2023Over five years, large models develop with video/visual/text training.
Gemini 2023 and Qwen2-VL 2024 explicitly report multimodal training; Flamingo 2022 already established this model class.
OutcomeRightDirectionRightMagnitudeNot quantifiedTimingWithin original window
29 June 2023 publication; 28 June event inferred
Further evidence: Training on video, images and text is documented, not merely visual-input acceptance.
Direction: Continued development across two independent model efforts.
Magnitude: No model-count, adoption, accuracy or compute threshold was specified.
Timing: 2023/2024 reports fall within the original five-year window; early realization, not first invention.
Scope: Firsthand university attribution, not verified recording; institution affiliated with speaker. Gemini comes from his former employer; separate developers do not constitute independent external validation. Qwen’s knowledge-data cutoff is not its training date; later revisions are not backdated. Developer training reports are not dataset audits, unrestricted temporal understanding, all-task superiority, human parity or safety results.
Evidence confidence: Moderate: original is firsthand reported attribution rather than verified recording; matched developer training reports are explicit.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Noam Shazeer23 Jun 2023High-capacity personalized memory would become economical to serve at scale.
September 2026 DolphinBench tested three synthetic personas with roughly 500k user-message tokens each.
OutcomePartly rightDirectionPartly rightMagnitudePartly supportedTimingTiming unresolved
2023-06-23
Further evidence: Mem0/Hermes/GPT-5.6-Luna passed 424/600 personalized-action tasks at reported $96.21 ingestion/testing cost, versus 394/600 and $61.48 with built-in memory. Qualified joint engineering feasibility; representative concurrent commercial operation remains unresolved.
Direction: Memory-dependent actions strengthen prior component support.
Magnitude: Partial: failures and three-persona clustering; greater success costs more; no numeric target.
Timing: Publisher-framed 6–12 months, not an unambiguous personal deadline. 2025–2026 evidence is not literal-window fulfillment.
Scope: Field advance, not a Character.AI launch or professional replacement; no exact capacity, price, user-count or profit target. Underlying interview date unknown. MemUse: matched-generator offline integration improved, but direct answers and spontaneous fact use remained weak. Extra capacity did not improve satisfaction over a shared summary; this was not memory versus none. Cost experiments include ingestion, retrieval and answer-model calls, not full deployment costs; synthetic cost and four-dialogue accuracy tests were separate. Backbone and internal-state choices materially affect costs. Million-token managed-platform results are first-party graded scores, not binary accuracy or the independent test configuration; compact retrieval excludes ingestion/infrastructure. Repository defaults are not cutoff-pinned cloud evidence. A tiny independent test found only 6–11% correct answers; nonsignificance does not establish equivalence. Observed ChatGPT memories establish use, not downstream efficacy or serving economics. No identical-stack, independent-replication, fixed-token or full-cost-accounting prerequisite for justified transfer. New joint evidence reinstates, without retroactively validating earlier cross-configuration inference. Early developer tests used ten conversations; retrieved-token savings were not complete pipeline costs. Existing 100k context: background, not a threshold; larger windows alone are not economic advances. All-check task pass, not average recall or satisfaction. Memory was frozen during tests; oracle screening shared Luna. No concurrency, ongoing-history or real-user test; no audited costs or scaling law. Synthetic 2027 dates are scenario timestamps, not later observations. Reported total differs by $0.01 from rounded components.
Evidence confidence: Moderate-low: a pinned developer preprint now jointly measures history capacity, personalized actions and processing cost. Synthetic data, three personas, model/judge dependence, incomplete cost audit and unmeasured concurrent serving limit the inference.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Noam Shazeer23 Jun 2023Audio/video integration can make language-model interactions more engaging, connected and enjoyable.
In CHI 2025 comparative interviews, some students reported greater engagement, enjoyment and connection with voiced visual tutors; all questionnaire/preference tests were nonsignificant.
OutcomePartly rightDirectionPartly rightMagnitudePartly supportedTimingTiming unresolved
2023-06-23
Further evidence: Contextual capability supported; average causal superiority unresolved.
Direction: Selected users, not general superiority.
Magnitude: Qualitative support; generally large uplift unestablished; no numerical threshold.
Timing: Publisher-framed 6–12 months, no exact personal deadline; decisive 2025 publication later, not on-time evidence.
Scope: Field-level, not product readiness, clinical efficacy or universal superiority; availability is insufficient. Same GPT-4o/RAG, not identical outputs: text, lecturer-video and voiced mascot. 23/45 volunteers completed a 14-week course; only three early weekly exposures were counterbalanced, then free choice. Study calendar dates unestablished. First preferences: 11 text, 8 lecturer, 4 mascot. Names, familiar-lecturer identity, backgrounds, latency and prompts varied. Coordinator conducted 20 interviews/primary analysis; secondary review, attrition, fatigue and one-course sampling limit generalization. Developer-built tutor, not independent replication; no average causal superiority, isolated-modality effect or learning gain. Nulls do not establish equivalence or forbid qualitative support. Earlier holds remain justified for then-available evidence. Revised MIT/OpenAI study: psychosocial endpoints null; differing prompts preclude clean modality attribution. FutureYou randomized engagement differences were nonsignificant. PubMed’s positive comparative avatar result is abstract-only; full methods unavailable. MDPI avatar engagement evidence is excerpt-only; no audited effect size. 2024 CEUR integrated system demonstrates positive experience, not relative improvement. JMIR pilot: 80 students, ten minutes; abstract-only, unreviewed and no longer under consideration. Experiential reports lack detailed uncertainty; modality mood differences nonsignificant. Language-partner survey is self-selected and cross-sectional; associations are not causal modality effects. Blossom adds physical embodiment and speech, not video; qualitative connection/enjoyment, but optional use and duration nonsignificant; allocation uncertain. Shopping-assistant study: LLM backend and direct enjoyment unestablished. Educational robot: companionship/enjoyment differences nonsignificant; LLM backend unestablished.
Evidence confidence: Moderate-low: direct comparative experience evidence now matches the conjunction, but small selected completer sample, attrition, bundled design and interviewer/analyst involvement limit inference; quantitative findings are mixed or null.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Gary Marcus8 Apr 2023Chart grade 75 / 100GPT-5 will not transform the world into a new AGI regime in Q4 2023.
OpenAI introduced GPT-4 Turbo in November 2023 and publicly introduced GPT-5 on August 7, 2025.
OutcomePartly rightDirectionPartly rightMagnitudeNo quantitative thresholdTimingCorrect lower bound
2023-04-08
Further evidence: Stanford’s 2024 review of 2023 reports significant AI advances alongside remaining reasoning, planning and mathematics limitations. Together these support the narrow negative 2023 endpoint, not all broader scientific or military skepticism in the essay. The explicit 2023 regime-transition endpoint did not occur on the ordinary public-world reading. Confidence is qualified because regime is not operationalized and a named-model release is not itself a universal capability test.
Direction: No GPT-5-driven AGI regime transition occurred in the named quarter; this is not a forecast of no AI progress.
Magnitude: The extreme world-regime shift was absent. No calibrated numerical magnitude or comprehensive military-advantage conclusion is claimed.
Timing: The negative Q4 2023 boundary is closed; not an invented date for eventual AGI or all defense impacts.
Scope: Only the explicitly dated regime-transition endpoint is proposed. The same sentence allows some defense and security impact without a calendar deadline. That positive clause remains attached as context and is not declared fully realized. Fusion, nanotechnology, starships and permanent LLM capability claims are not separately counted.
Evidence confidence: Moderate for the bounded public-world endpoint; undefined AGI-regime threshold and low discriminatory information.
Current edition contribution · Gary Marcus
Graded credit: 75 / 100.
- Recency weight
- 96.59726027397261%
- Credit × weight endpoint products
- 72.44794520547946
- Last documented backing
- 2023-04-08 to 2023-04-08
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 75 / 100
- Recency weight
- 94.32876712%
- Weighted credit term
- 70.74657534
- Same-claim backing date
- 2023-04-08 to 2023-04-08
Existing reviewed grade for the original scope; time intrinsic to that scope is retained.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
75,
75
]
},
"backingDateBounds": [
"2023-04-08",
"2023-04-08"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
75,
75
],
"weightBounds": [
0.9432876712328767,
0.9432876712328767
],
"normalizedBackingDateBounds": [
"2023-04-08",
"2023-04-08"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
75,
75
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Eliezer Yudkowsky6 Apr 2023Alignment will not be solved in a few years.
The February 2026 international scientific assessment still reports limits to robust behavioural assurance.
OutcomePartly rightDirectionRightMagnitudeNot quantifiedTimingTiming unresolved
2023-04-06 publication; recording date not independently fixed
Further evidence: A May 2026 multi-model study finds persistent, heterogeneous objective failures alongside effective mitigations. Qualified support, not permanent unsolvability.
Direction: Difficulty persisted despite improvements.
Magnitude: Unquantified.
Timing: Three years observed; five-year endpoint unclaimed.
Evidence confidence: moderate; public scientific-state assessment and empirical support, not a theorem of unsolvability
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Eliezer Yudkowsky6 Apr 2023Chart grade 75 / 100Future near-human AI will have a nonhuman profile: faster human-like output with incongruous weaknesses.
GPT-5.2 Thinking matched or beat expert outputs in 70.9% of GDPval comparisons, with reported output production over eleven times faster.
OutcomePartly rightDirectionPartly rightMagnitudePartly supportedTimingNo fixed deadline
2023-04-06 publication; recording date unverified
Further evidence: BabyVision reports 34.4% accuracy versus adults’ 94.1%, including maze scores of 15% versus 95%. Qualified profile match: expert-comparable output, speed and concrete human-incongruous failures.
Direction: Unevenness, not independent evidence.
Magnitude: Bounded asymmetry, not a general human-distance or speed scale.
Timing: Undated long run; no first-crossing or timing credit.
Scope: Qualified practical profile, not universal cognition. Provider-reported output speed is not speech rate or workflow savings. GDPval used heavy reasoning; BabyVision used maximum effort, not identical settings or runs. Selected visual tasks and sixteen educated adults limit generalization; no architecture-cause inference. Very low novelty; future persistence remains open.
Evidence confidence: Moderate for bounded practical-profile fulfillment; lower for cross-study configuration transfer, general human-range cognition, literal talk-speed and universal persistence.
Current edition contribution · Eliezer Yudkowsky
Graded credit: 75 / 100.
- Recency weight
- 96.56438356164384%
- Credit × weight endpoint products
- 72.42328767123288
- Last documented backing
- 2023-04-06 to 2023-04-06
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 75 / 100
- Recency weight
- 94.2739726%
- Weighted credit term
- 70.70547945
- Same-claim backing date
- 2023-04-06 to 2023-04-06
Existing reviewed grade for the original scope; time intrinsic to that scope is retained.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
75,
75
]
},
"backingDateBounds": [
"2023-04-06",
"2023-04-06"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
75,
75
],
"weightBounds": [
0.9427397260273973,
0.9427397260273973
],
"normalizedBackingDateBounds": [
"2023-04-06",
"2023-04-06"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
75,
75
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Eliezer Yudkowsky6 Apr 2023Chart grade 100 / 100Algorithmic progress will continue improving AI capability per unit compute.
Post-issuance model studies show gains in benchmark capability for comparable or lower estimated training resources.
OutcomeRightDirectionRightMagnitudeNot quantifiedTimingNo fixed deadline
2023-04-06 publication; exact recording date unverified
Further evidence: Modest continuation supported.
Direction: Algorithmic gains, not merely cheaper hardware.
Magnitude: Unquantified.
Timing: Undated; no timing credit.
Evidence confidence: moderate-high for broad observed direction; benchmark and compute-estimation limits
Current edition contribution · Eliezer Yudkowsky
Graded credit: 100 / 100.
- Recency weight
- 96.56438356164384%
- Credit × weight endpoint products
- 96.56438356164384
- Last documented backing
- 2023-04-06 to 2023-04-06
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 100 / 100
- Recency weight
- 94.2739726%
- Weighted credit term
- 94.2739726
- Same-claim backing date
- 2023-04-06 to 2023-04-06
Existing reviewed grade for the original scope; time intrinsic to that scope is retained.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
100,
100
]
},
"backingDateBounds": [
"2023-04-06",
"2023-04-06"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
100,
100
],
"weightBounds": [
0.9427397260273973,
0.9427397260273973
],
"normalizedBackingDateBounds": [
"2023-04-06",
"2023-04-06"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
100,
100
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Eliezer Yudkowsky6 Apr 2023Bets against GPT-4 being the final capability ceiling, while allowing it.
2025 developer evaluations show later-model gains with regressions; baselines and prompts differ from original GPT-4.
OutcomeRightDirectionRightMagnitudeNot quantifiedTimingNo fixed deadline
2023-04-06 publication; recording unverified
Direction: Supported, not universal.
Magnitude: Unquantified.
Timing: Undated; no timing credit.
Scope: Low-specificity verbal bet, not probability, AGI or smooth scaling. Eligibility restored; original grades retained.
Evidence confidence: moderate-high for broad continuation; weaker for an exact matched original-GPT-4 delta
Draft formula inputs
Not yet updated in the supplied scoring edition. This ledger restores eligibility; the original grades are retained.
Ilya Sutskever27 Mar 2023Chart grade 75 / 100New 2025 models will support richer applications while older models remain adequate for some uses.
AlphaEvolve used Gemini 2.0 Pro and Flash in 2025 for algorithm discovery and computing-infrastructure optimization.
OutcomePartly rightDirectionRightMagnitudeNot quantifiedTimingWithin original window
2023-03-27 publication; recording day unknown
Further evidence: Its primary paper reports improvements over earlier FunSearch and an ablation showing benefit from stronger models. A concrete richer application exists and the stronger model contributes, supporting the modest claim. No controlled 2024-model comparison establishes necessity or general superiority.
Direction: Stronger models participate in a broader application with practical results.
Magnitude: Interesting is subjective; no application count, quality threshold, adoption share or economic premium specified.
Timing: Reported application and 2025 model release fall within the explicit 2025 target year. This is application evidence, not credit for a release alone.
Evidence confidence: Moderate for narrow content and timing; no inference on anti-commoditization economics.
Current edition contribution · Ilya Sutskever
Graded credit: 75 / 100.
- Recency weight
- 96.4%
- Credit × weight endpoint products
- 72.30000000000001
- Last documented backing
- 2023-03-27 to 2023-03-27
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 75 / 100
- Recency weight
- 94%
- Weighted credit term
- 70.5
- Same-claim backing date
- 2023-03-27 to 2023-03-27
Existing reviewed grade for the original scope; time intrinsic to that scope is retained.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
75,
75
]
},
"backingDateBounds": [
"2023-03-27",
"2023-03-27"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
75,
75
],
"weightBounds": [
0.94,
0.94
],
"normalizedBackingDateBounds": [
"2023-03-27",
"2023-03-27"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
75,
75
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Jürgen SchmidhuberFeb–Mar 2023 · rangeChart grade 75 / 100In coming years, AI changes journalists’, lawyers’, advertising copywriters’ and programmers’ work toward directing tasks and refining outputs.
Actual post-issue use and human review are documented in all four roles; adoption remains uneven and tenfold net productivity is not established.
OutcomePartly rightDirectionRightMagnitudePartly matched scopeTimingTiming unresolved
Published 25 February 2023; updated 24 March 2023; exact interview day unverified
Further evidence: Approximate workflow change, not a finding that most workers principally supervise AI.
Direction: Practitioners report delegating and refining tasks; useful drafts predated this forecast.
Magnitude: Uneven uptake; incompatible survey denominators do not establish an all-worker share or employment displacement. Occasional tenfold speed remains unverified.
Timing: Evidence concerns 2024–2025 practice, reported through May 2026; “coming years” supplies no exact deadline or first-realization date.
Scope: The inspected interview has an update date; immutable first-publication wording is unverified. Useful ChatGPT drafts were already baseline. Occasional tenfold speed was a present assertion, not a universal forecast; the interviewer’s 90% job-loss question is not credited. The UK journalist survey (1,004; late-2024 fieldwork, November 2025 report) found 56% weekly AI use with task prompts versus 34% generally. It includes older automation. Monthly copy-editing/article-part/first-draft use was 30%/16%/10%; integration was mostly limited. Frequent users were not more satisfied with complex/creative time savings. A partial invitation database, nonresponse and male skew limit representativeness. The vendor legal survey reported organizational use rising from 14% (2024) to 26% (2025), with review/research/drafting among active users. Its 1,702 cross-profession respondents came from vendor lists and a familiarity screen; changing country/respondent mixes are not a workforce panel. Victoria’s 2025 census, published in 2026, had 1,887 voluntary responses (6.4% of certificate holders), weighted on three characteristics. AI use was 36.7%, varying by sector; 89% of users answering the quality-assurance question checked accuracy. Personal editing/supervision coexisted with nonuse, low-risk wording and verification costs. The association’s 474 UK commercial writers reported 69% workplace GenAI use in February 2025 versus 59% in 2024; nearly one in five said others insisted and 54% would erase it. These are not representative-panel or productivity estimates. Only the July landing page was read; the full PDF was inaccessible. The March–April 2025 content-worker survey (169; 95% US) reported 89% AI use; 65% had content as their main job. Editing/research/brainstorming were common, with detailed prompting followed by editing or source checking. Managers/contributors were included: not a pure advertising-copywriter population. Engagement difficulties and uncontrolled speed impressions remain. Stack Overflow’s May–June 2025 survey reported 51% of professional-developer respondents using AI daily; distrust (46%) exceeded trust (33%). Almost-correct output (66%) and slower debugging (45%) were common complaints. Its 49,009 overall respondents were self-selected through developer channels; planned use is not actual use, and most did not report professional vibe coding. A May–July 2025 study of 72 GenAI-using practitioners found iterative context, correction and refinement. Network/snowball recruitment included overlapping researchers (64%) and programmers (60%); complex-code/debugging reliability remained limited. The October 2025 preprint’s January 2026 revision supports a workflow mechanism, not occupational prevalence or causal productivity. Narrow maintainer trial found slower work.
Shared evidence: One four-occupation forecast, not four accuracy observations. Different surveys are not pooled as a workforce estimate; the shared METR study is not another independent replication.
Evidence confidence: Moderate for qualitative cross-occupation workflow change; limited for representative reach, net productivity and exact timing.
Current edition contribution · Jürgen Schmidhuber
Graded credit: 75 / 100.
- Recency weight
- 95.9068493150685%
- Credit × weight endpoint products
- 71.93013698630138
- Last documented backing
- 2023-02-25 to 2023-02-25
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 75 / 100
- Recency weight
- 93.17808219%
- Weighted credit term
- 69.88356164
- Same-claim backing date
- 2023-02-25 to 2023-02-25
Existing reviewed grade for the original scope; time intrinsic to that scope is retained.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
75,
75
]
},
"backingDateBounds": [
"2023-02-25",
"2023-02-25"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
75,
75
],
"weightBounds": [
0.9317808219178082,
0.9317808219178082
],
"normalizedBackingDateBounds": [
"2023-02-25",
"2023-02-25"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
75,
75
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Paul Christiano18 Feb 2023General and giant AI systems would generate roughly $1B revenue in 2023, possibly much more, and $10B within two to three years or sooner.
OpenAI retrospectively reports $1B within a year of ChatGPT’s launch; firsthand reporting of audited statements gives $13.07B actual 2025 revenue.
OutcomePartly rightDirectionRightMagnitudePartly supportedTimingWithin original window
18 February 2023 comment; same-day edit
Further evidence: Anthropic’s filing separately reports $41M in 2023 and $4.585B in 2025. Central monetization trajectory approximately realized, not exact sector totals.
Direction: Realized revenue growth, not financing, valuation or annualized run rates.
Magnitude: Billion-to-ten-billion scale, not exact aggregate point estimates; companies are not summed into a census.
Timing: 2025 actuals fit the two-to-three-year window. Initial 2023 company chronology is retrospective, not an audited calendar-year table; no precise first-crossing date or early-arrival credit.
Scope: Not all deep-learning advertising revenue. Category boundaries, accounting and related-party revenue remain uncertain. An exhaustive-sector reading remains unresolved. Underlying audited accounts and Financial Times verification were not independently inspected. Not profit, GDP or a takeoff verdict; the separate zero-further-progress capacity conjecture is ungraded.
Shared evidence: Related investment thesis, not independent replication.
Evidence confidence: Moderate: exact dated original, primary corporate chronology/filing, first-hand reporting of 2025 audited documents; incomplete sector accounting.
Draft formula inputs
No draft score: out of scope. No vote, not zero.
Gary Marcus11 Feb 2023Maturing AI ethical guardrails will take years.
Leading safety research through 2025–2026 found remaining adversarial weaknesses alongside large improvements and useful production defenses.
OutcomePartly rightDirectionPartly rightMagnitudeNo quantitative thresholdTimingTiming unresolved
2023-02-11
Further evidence: Approximately right for the scoped practical warning that robust guardrails need multi-year development. Material residual adversarial weaknesses persisted, while defenses became substantially more useful; no literal perfect-safety victory is claimed.
Direction: Observed development combined large safety gains with remaining weaknesses over 2024–2026, consistent with a temporary maturation warning rather than permanent impossibility.
Magnitude: No numerical success or failure threshold was forecast. Selected adversarial tests cannot establish routine user risk or the share of all systems that remain immature.
Timing: Unjudgeable as an exact timing score: years supplies a genuinely long horizon but neither an exact maturity definition nor a calendar endpoint. Do not manufacture a two-year deadline or infer that no practical protection existed earlier.
Scope: Practical multi-year maturation only. Strong safety gains coexist with residual adversarial weaknesses; selected tests do not estimate ordinary user risk, universal immaturity or permanent failure.
Evidence confidence: Moderate for bounded multi-year development and residual weakness; limited for a universal maturity threshold.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Gary Marcus3 Feb 2023AI edge-case brittleness will probably remain the norm for another few years without a methodological change.
Matched evaluations support continuing fragility, while real deployment value and stronger robust reasoning limit the breadth of the warning.
OutcomePartly rightDirectionPartly rightMagnitudeOverstated scopeTimingTiming unresolved
2023-02-03
Further evidence: Controlled robustness tests and production-practitioner evidence support continuing fragility through 2024–2025. Useful successful systems materially limit the sweeping lab-versus-world rhetoric, so the matched verdict is approximate rather than full right.
Direction: Residual generalization and reliability difficulties persisted despite strong improvements, matching the central warning.
Magnitude: No representative all-AI denominator establishes that edge-case failure is the norm. Actual useful deployment and robust performance on some perturbations are substantive counterweights, not mere missing data.
Timing: The evidence occurs around two to three years later, consistent with the qualitative window, but there is no precise original endpoint for a clean timing score.
Evidence confidence: Moderate for scoped persistence; limited for all-AI prevalence and exact timing
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Gary Marcus31 Jan 2023Chart grade 75 / 100Erroneous synthetic articles will keep slipping through inadequate checking, a whole lot more during 2023.
Later publisher corrections and direct observational evidence support recurrence; global growth and the precise overtrust mechanism remain unmeasured.
OutcomePartly rightDirectionRightMagnitudeScale of increase unresolvedTimingWithin original window
2023-01-31
Further evidence: Approximately right: recurrent publication and checking failures occurred, including a disclosed LLM-assisted article that its publisher corrected. The broad incidence and psychological mechanism are not fully established.
Direction: The predicted publication-risk recurrence is supported. Observed content-farm proliferation is additional directional context, not a controlled estimate of error growth.
Magnitude: A substantial worldwide increase and most users’ inability to check are unresolved; detected website counts are not counts of factual errors.
Timing: Documented recurrence occurred during the original 2023 window; early occurrence is credited without treating the prior CNET baseline as outcome.
Evidence confidence: Moderate: primary publisher admissions support recurrence, while causal psychology and population growth remain uncertain.
Current edition contribution · Gary Marcus
Graded credit: 75 / 100.
- Recency weight
- 95.4958904109589%
- Credit × weight endpoint products
- 71.62191780821918
- Last documented backing
- 2023-01-31 to 2023-01-31
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 75 / 100
- Recency weight
- 92.49315068%
- Weighted credit term
- 69.36986301
- Same-claim backing date
- 2023-01-31 to 2023-01-31
Existing reviewed grade for the original scope; time intrinsic to that scope is retained.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
75,
75
]
},
"backingDateBounds": [
"2023-01-31",
"2023-01-31"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
75,
75
],
"weightBounds": [
0.9249315068493151,
0.9249315068493151
],
"normalizedBackingDateBounds": [
"2023-01-31",
"2023-01-31"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
75,
75
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Sam Altman2023 · uncertainExpects substantial API price reductions alongside improving models to continue over the long run.
Selected API workflows support qualified continuation.
OutcomePartly rightDirectionRightMagnitudePartly supportedTimingTiming unresolved
2023 Stripe Sessions; exact day unestablished
Further evidence: Ordinary input/output per million tokens: November 2023 Turbo $10/$30 versus GPT-4 $30/$60; GPT-4o-2024-08-06 $2.50/$10; April 2025 GPT-4.1 mini $0.40/$1.60 and GPT-4.1 $2/$8. Unit prices are not task bills. Bounded joint improvement, not all-task superiority; an indefinitely validated future remains unresolved, not wrong.
Direction: Selected Arena-Hard technical prompts favor dated 2024 Turbo checkpoints over GPT-4-0314; judge, selection and verbosity limits remain. November 2023’s preview is a different checkpoint.
Magnitude: 2024–2025 cuts support qualitative “substantial,” not a universal capability/price scalar or numerical annual rate.
Timing: Observed 2024–2025 continuation; no terminal year, deadline hit or first-attainment claim.
Scope: Aider’s 225-task diff-format runs: GPT-4o-2024-08-06 (30 December 2024), 52 solved/$7.0286; GPT-4.1 mini (14 April 2025), 73/$1.9918; GPT-4.1 (same date), 118/$9.8556. Mini solves more for less; full GPT-4.1 costs more despite cheaper tokens. Two-attempt coding results, not first-shot reliability or general intelligence. Six-language exercises were selected from 697 using seven models, including GPT-4o, with at most three solving each. Harness versions/commits and prompt placement differ: no controlled model-only attribution. Aider evaluates its own workflow; historical costs are best-effort run-time estimates, not invoice/cache audits. Quoted unit rates exclude cached-input/batch discounts; token use, retries and tools can change bills. Vendor mini comparisons are mixed, including weaker SWE-bench/multilingual results than GPT-4o; 23 SWE-bench tasks omitted. Schema validity is not semantic correctness. No pure hardware/training-cost claim.
Shared evidence: Earlier GPT-3.5 Turbo already advertised cheaper/improved capability; its mutable page separates original launch from a 2024 update. CEO control and a known trajectory limit novelty. One correlated commercial target, not independent replication.
Evidence confidence: Moderate for bounded observed continuation; lower for generality and long-run persistence. Vendor prices are authoritative offers, not actual hardware resource costs; independent evaluation has harness and selection limits.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Gary Marcus29 Dec 2022Chart grade 100 / 100LLMs will be widely adopted during 2023 despite their flaws.
Pew found 18% of US adults had used ChatGPT by July 2023; Microsoft reported over one million paid Copilot users and 37,000 subscribing organizations in October.
OutcomeRightDirectionRightMagnitudeQualitatively supportedTimingWithin original window
2022-12-29
Further evidence: Independent population evidence and paid organizational use support substantial uptake.
Direction: Adoption expanded.
Magnitude: Qualitative widespread reach supported; no numerical population share was promised.
Timing: Both observations fall in the forecast 2023 window.
Evidence confidence: moderate-high, with US population and vendor-count scope limits
Related statement: 2022-12-31 (later broad societal-reach umbrella; uptake aspect overlaps the adoption forecast): Expected major societal AI impact entering the remaining 2020s. Subsequent uptake and institutional response support broad reach, but total magnitude, net benefit and the timing implied by soon remain unmeasured. No additional main claim, independent trajectory or scorecard vote.
Current edition contribution · Gary Marcus
Graded credit: 100 / 100.
- Recency weight
- 94.95342465753424%
- Credit × weight endpoint products
- 94.95342465753424
- Last documented backing
- 2022-12-29 to 2022-12-29
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 100 / 100
- Recency weight
- 91.5890411%
- Weighted credit term
- 91.5890411
- Same-claim backing date
- 2022-12-29 to 2022-12-29
Existing reviewed grade for the original scope; time intrinsic to that scope is retained.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing. The 2022-12-31 broad-societal-impact umbrella overlaps uptake but is not an explicit same-scope renewal of the narrower adoption claim.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
100,
100
]
},
"backingDateBounds": [
"2022-12-29",
"2022-12-29"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
100,
100
],
"weightBounds": [
0.9158904109589041,
0.9158904109589041
],
"normalizedBackingDateBounds": [
"2022-12-29",
"2022-12-29"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
100,
100
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Gary Marcus25 Dec 2022Chart grade 75 / 100During 2023, GPT-4 will seem more capable and impressive than its predecessors.
In March–June 2023, blind developer preference testing and independent human-comparison research favored GPT-4.
OutcomePartly rightDirectionRightMagnitudeQualitatively supportedTimingWithin original window
2022-12-25
Further evidence: Varied benchmark gains supported the comparison while serious limitations remained. Comparative improvement is supported; subjective impressiveness and limited samples warrant approximate rather than universal credit.
Direction: Human-preference and benchmark comparisons consistently favor stronger GPT-4 capability.
Magnitude: Substantive qualitative gain, not an invented numeric forecast or a guarantee for every task.
Timing: Observed within the original 2023 annual outlook; March realization is early and does not reset the window.
Scope: Comparative apparent capability, not AGI, reliability, public-attention volume, release schedule or undisclosed parameter count.
Evidence confidence: Moderate to high for comparative gain; limited for subjective impressiveness.
Current edition contribution · Gary Marcus
Graded credit: 75 / 100.
- Recency weight
- 94.88767123287671%
- Credit × weight endpoint products
- 71.16575342465754
- Last documented backing
- 2022-12-25 to 2022-12-25
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 75 / 100
- Recency weight
- 91.47945205%
- Weighted credit term
- 68.60958904
- Same-claim backing date
- 2022-12-25 to 2022-12-25
Existing reviewed grade for the original scope; time intrinsic to that scope is retained.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
75,
75
]
},
"backingDateBounds": [
"2022-12-25",
"2022-12-25"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
75,
75
],
"weightBounds": [
0.9147945205479452,
0.9147945205479452
],
"normalizedBackingDateBounds": [
"2022-12-25",
"2022-12-25"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
75,
75
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Gary Marcus25 Dec 20222023: GPT-4 remains unreliable for simple direct program/assistant integration.
Direct-output, native-call and late-year component tests show substantial successes and task-dependent errors. Whole outcome unresolved.
OutcomeUnresolvedDirectionPartly rightMagnitudeNo quantitative thresholdTimingTiming unresolved
2022-12-25
Further evidence: Structured integration improved. Whole-slot adequacy and mechanism remain unresolved.
Direction: Scoped reliability concerns survive real engineering gains.
Magnitude: No numerical reliability threshold; benchmark scores are not forecast magnitudes.
Timing: Late-2023 evidence is available; whole-slot timing unresolved.
Scope: Accessible world models and user-intent mapping; engineered tools allowed, not perfection or unaided operation. Preview-informed. API-Bank’s December 2023 proceedings report zero-shot GPT-4-0613: 63.66% supplied-API correctness, 37.04% retrieval plus call, 70% planning plus retrieval and call, and 60.24% overall. Its 73 implemented APIs, 314 annotated dialogues and 753 calls are English-only. Bracketed text is not native function calling; correctness tests database effects/results, some retrieval outputs are fixed, and multiple calls can violate prompts. Majority success and an unspecified commercially viable larger model counter general impossibility. The June 13 release added schema-described functions and structured arguments; its July 20 update is labeled separately. The provider warns about unintended tool actions and recommends trusted inputs and confirmation for consequential actions, not guaranteed intent accuracy. November 6 GPT-4-1106-preview improved parameter selection, parallel calls and JSON mode. Valid syntax is not semantic correctness; the June checkpoint cannot settle later improvements. Nexus’s notebook requests ordinary-text Python-like calls and compares ordered dummy-call arguments, not native API calls. It uses generic gpt-4, conflicting with a later GPT4-1106 label. A December 8 commit preserves mixed scores: Climate 68.09%, Places 43.75%, OTX 90.22%, VirusTotal 88%. Supplementary contemporaneous scores, not pinned Turbo identity. Microsoft researchers’ ToolTalk, published November 15, tested June GPT-4-0613 through native function calling: 92.8% success on 28 easy conversations, 50% on 50 hard ones. Incorrect-action rates of 3.8%/25.1% use different denominators. Success requires all reference calls and no incorrect actions. Users/tools are simulated; humans authored conversations from model-suggested scenarios and previous turns reset to reference history. Substantial capability and task-dependent errors, not a year-end Turbo test. December 21 T-Eval reports December 1–10 tests of gpt-4-1106-preview. It led 20 models with 86.4 overall: an average of unlike components, not task success. JSON next-tool choice scored 86.6% over 6,426 cases; review classification 94.5% over 487. Other metrics include similarity/partial credit. The 23,305 cases reuse query traces; main text/planning table say 553, Appendix A 533. Fifteen tools have curated documentation; model-generated annotations receive human filtering and several tests supply reference history. End-to-end comparison is model-judged relative quality, not absolute deployment reliability. The native-call and late-year component studies are distinct; no combined late-year end-to-end test is inferred. Successful engineering and residual errors coexist; neither benchmark proves world-model absence or universal practical inadequacy.
Evidence confidence: Moderate for scoped direct-output reliability limitations; low for full-slot or universal endpoint adjudication.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Gary Marcus25 Dec 2022In 2023 GPT-4 remains useful for brainstorming and first drafts, but not reliable unaided general intelligence.
A September 2023 controlled GPT-4 experiment supported useful ideation and drafting in selected professional tasks, with clear failures on a different analytical task. Whole outcome unresolved.
OutcomeUnresolvedDirectionRightMagnitudeQualitatively supportedTimingTiming unresolved
2022-12-25
Further evidence: Brainstorming and drafting usefulness is supported; the broader slot 5 non-AGI and specific unaided-capability conjunction is not fully adjudicated here.
Direction: Positive assistance was observed for the nominated uses.
Magnitude: Original offered no numerical effect size; qualitative usefulness is supported on selected tasks only.
Timing: Positive application evidence falls within 2023; full compound timing is not settled by the productivity study.
Scope: Full compound slot 5 retained: useful paired writing applications, non-AGI, unaided Diplomacy/car/versatile-robot limitations. Only positive writing usefulness is established by this evidence; no separate additional rows for the other clauses.
Evidence confidence: high on observed applications; moderate on grading a separable positive component of a compound slot.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Gary Marcus25 Dec 2022AI research will shift toward integrating LLMs with other techniques within a decade.
Multiple leading developers deployed tool-integrated research systems.
OutcomePartly rightDirectionRightMagnitudeUnresolvedTimingFuture window open
2022-12-25
Further evidence: Real deployed integration partially fulfills the direction.
Direction: Integration advanced alongside continuing model scaling.
Magnitude: A field-wide research-focus share is not measured.
Timing: 2032 deadline remains future; early components are not a completed timing trial.
Evidence confidence: moderate for partial direction
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Gary Marcus1 Oct 2022Mass purchases of the proposed $20,000 Optimus, yielding extensive customer data, were years away even optimistically.
The documented path remained developmental for multiple years.
OutcomeNot applicableDirectionNot applicableMagnitudeNot quantifiedTimingCorrect lower bound
2022-10-01
Further evidence: Subsequent manufacturing progress does not contradict the original lower bound. The operative claim is that mass customer adoption/data collection is not near; it does not assert permanent technical impossibility. Do not duplicate timing as an ultimate-capability grade.
Direction: No independent ultimate direction assigned. Marcus expressly allowed eventual catch-up.
Magnitude: The original gives no population, data-volume threshold or eventual effect size. Do not fabricate one.
Timing: Primary issuer status more than three years after issuance still puts mass-production preparation before the later first production-quality milestone. This supports the modest multi-year lower bound, not an exact attained-date estimate.
Evidence confidence: Moderate for scoped temporal lower bound; final consumer/data attainment not established.
Draft formula inputs
No draft score: out of scope. No vote, not zero.
Gary Marcus29 Sep 2022Chart grade 100 / 100Tesla’s promised driverless-taxi fleets were likely still years or decades away.
Issuer chronology places initial rider-supervised taxi service in 2025 and limited customer rides without an onboard monitor in January 2026, supporting the modest multi-year lower bound while preserving actual later…
OutcomeNot applicableDirectionNot applicableMagnitudeNot quantifiedTimingCorrect lower bound
2022-09-29
Further evidence: progress. No assertion of permanent impossibility; this is a temporal non-imminence forecast.
Direction: Do not award an extra direction hit for the same delay.
Magnitude: No quantified fleet target or probability, and no firm commitment to a decades-long wait.
Timing: Even the earlier supervised launch was multiple years after September 2022; the stricter no-onboard-monitor milestone was later. The lower bound is supported, without establishing broad fleet attainment or an exact date.
Evidence confidence: Moderate for temporal lower bound, not full promised-fleet completion.
Current edition contribution · Gary Marcus
Graded credit: 100 / 100.
- Recency weight
- 93.45753424657535%
- Credit × weight endpoint products
- 93.45753424657535
- Last documented backing
- 2022-09-29 to 2022-09-29
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
Selected deadline or scoped criterion only. This is not a whole-outcome grade. Archive timing: Correct lower bound.
- Credit
- 100 / 100
- Recency weight
- 89.09589041%
- Weighted credit term
- 89.09589041
- Same-claim backing date
- 2022-09-29 to 2022-09-29
Existing reviewed grade for the original scope; time intrinsic to that scope is retained.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
100,
100
]
},
"backingDateBounds": [
"2022-09-29",
"2022-09-29"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
100,
100
],
"weightBounds": [
0.8909589041095891,
0.8909589041095891
],
"normalizedBackingDateBounds": [
"2022-09-29",
"2022-09-29"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
100,
100
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Kai-Fu Lee26 Sep 2022Over the next five to ten years, deep learning remains AI’s largest underpinning platform, with new ideas extending its capabilities.
Later robotics and reasoning systems built important extensions on deep neural models. Whole outcome unresolved.
OutcomeUnresolvedDirectionRightMagnitudeUnresolvedTimingFuture window open
2022-09-26
Further evidence: The selection does not establish field-wide platform dominance or complete the 2027–2032 horizon. Full largest-platform and future-window claim unresolved.
Direction: Post-claim robotics, mathematical and language-reasoning advances continued to build on deep neural foundations rather than wholly replacing them.
Magnitude: No field-wide denominator for largest; strong individual outcomes do not supply it.
Timing: Original five-to-ten-year window remains future at cutoff; no deadline hit or miss awarded.
Evidence confidence: Moderate for continuation direction; full scope unresolved
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Eliezer Yudkowsky26 Aug 2022Chart grade 75 / 100In 2–4 years, beautiful videos would provoke initial doubt about whether AI generated them, conditional on survival.
Independent 2025/2026 human studies found substantial real/synthetic confusion, including nature scenes, while viewers remained above chance and improved with duration.
OutcomePartly rightDirectionRightMagnitudeUnresolvedTimingWithin original window
2022-08-26
Further evidence: Core ambiguity materialized; universal rhetorical scope remains unverified.
Direction: Generation became convincing enough to create authenticity uncertainty.
Magnitude: No universal first-thought or exact reference-video fidelity measurement.
Timing: Scoped phenomenon documented within August 26, 2024–August 26, 2026; no extension to the market’s end 2026 deadline.
Scope: Controlled perceptual studies support substantial ambiguity, not a population first-thought survey or universal indistinguishability. Exact illustrative moth/8k output and full rhetorical scope remain unverified.
Evidence confidence: moderate; scope not separately specified.
Current edition contribution · Eliezer Yudkowsky
Graded credit: 75 / 100.
- Recency weight
- 92.8986301369863%
- Credit × weight endpoint products
- 69.67397260273972
- Last documented backing
- 2022-08-26 to 2022-08-26
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 75 / 100
- Recency weight
- 88.16438356%
- Weighted credit term
- 66.12328767
- Same-claim backing date
- 2022-08-26 to 2022-08-26
Existing reviewed grade for the original scope; time intrinsic to that scope is retained.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
75,
75
]
},
"backingDateBounds": [
"2022-08-26",
"2022-08-26"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
75,
75
],
"weightBounds": [
0.8816438356164384,
0.8816438356164384
],
"normalizedBackingDateBounds": [
"2022-08-26",
"2022-08-26"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
75,
75
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Gary Marcus18 Aug 2022Do not expect a reliable general-purpose domestic robot product within the next several years.
Examined 2025–2026 home-robot products retained limited autonomy and testing/beta status; a strong unseen-room laundry result supplies important contrary capability evidence.
OutcomePartly rightDirectionPartly rightMagnitudePartly matched scopeTimingTiming unresolved
2022-08-18
Further evidence: The practical-readiness caution is substantially supported by documented restricted autonomy, employee testing and beta-stage deployment. Substantial autonomous chore capability also arrived; this is not evidence of general robotic incapacity.
Direction: Broad reliable household assistance remained a product-development goal in the examined offerings, while selected chores became much more capable and reliable.
Magnitude: The broad domestic-product target is not established by a strong laundry-only result. Conversely, 99.1% success in the stated folding distribution rules out a claim that domestic-task reliability barely improved.
Timing: The original supplies several years, not a numerical boundary. Dated 2025–2026 evidence supports the near-term caution but cannot earn a precise deadline score.
Evidence confidence: Moderate for the scoped practical-readiness inference; first-party evidence and incomplete global product coverage.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Gary Marcus15 Jun 2022In the long run, driverless vehicles will save lives and give many blind, elderly and disabled people greater autonomy.
Selected driverless services show substantial injury-risk reductions and experienced blind-rider independence; mortality and broad disability access remain only partly established.
OutcomePartly rightDirectionRightMagnitudePartly matched scopeTimingNo fixed deadline
2022-06-15
Further evidence: Observed injury-risk reductions and actual blind-rider independence support the central benefit direction. Literal mortality reduction and the breadth across all named populations are not fully established.
Direction: Real driverless services show lower matched injury rates and experienced mobility benefits, rather than only promising these benefits.
Magnitude: Substantial safety associations exist in selected operating domains; disability access remains uneven. No population-wide amount of lives saved or autonomy gain is established.
Timing: The original expressly says long run but supplies no numerical deadline; no timing success is assigned.
Evidence confidence: Moderate: independent crash-rate analysis and rider research, with mortality, selection and domain limits.
Earlier statement: 2012-11-24 (earlier consistent safety forecast; no additional claim count): Expected eventual automated-driving safety superiority. The separate 20–30-year legal/social extension is not resolved by restricted current services.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Gary Marcus31 May 2022Chart grade 100 / 100Tesla will not ship Level 5 self-driving cars in 2022 or 2023.
Tesla’s contemporaneous supervision requirements support the predicted non-delivery through 2023.
OutcomeNot applicableDirectionNot separately gradedMagnitudeNot quantifiedTimingCorrect lower bound
2022-05-31
Original horizon: 2023-12-31
Further evidence: This is a finite timing judgment about Level 5 cars, not a prediction that Tesla could never achieve autonomy or that later services would be impossible. The claim concerns finite non-delivery, not a separate forecast of permanent technical incapability.
Direction: Not separately graded in the historical record.
Magnitude: No separate magnitude target was specified beyond the finite non-delivery condition.
Timing: Target-matched 2023 disclosures support non-delivery within the specified period, regardless of later advances.
Scope: Supervised assistance and another operator’s geofenced service are not the target. This is not a new census of Tesla capability in 2026.
Evidence confidence: Not separately rated.
Current edition contribution · Gary Marcus
Graded credit: 100 / 100.
- Recency weight
- 91.46849315068494%
- Credit × weight endpoint products
- 91.46849315068494
- Last documented backing
- 2022-05-31 to 2022-05-31
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
Selected deadline or scoped criterion only. This is not a whole-outcome grade. Archive timing: Correct lower bound.
- Credit
- 100 / 100
- Recency weight
- 85.78082192%
- Weighted credit term
- 85.78082192
- Same-claim backing date
- 2022-05-31 to 2022-05-31
Existing reviewed grade for the original scope; time intrinsic to that scope is retained.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
100,
100
]
},
"backingDateBounds": [
"2022-05-31",
"2022-05-31"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
100,
100
],
"weightBounds": [
0.8578082191780821,
0.8578082191780821
],
"normalizedBackingDateBounds": [
"2022-05-31",
"2022-05-31"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
100,
100
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Andrej Karpathy14 Mar 2022Chart grade 75 / 100Expects the trend toward adapting and prompting pretrained foundation models, rather than training task networks from scratch, to intensify.
Primary 2024 and 2025 enterprise surveys report widespread foundation-model API use, adaptation and prompting rather than scratch training.
OutcomePartly rightDirectionRightMagnitudeNot quantifiedTimingNo fixed deadline
2022-03-14
Further evidence: A 2025 study separately measures expanding scientific use and customization through 2024. The application-development pattern is supported across enterprise and scientific samples, but there is no all-application census demonstrating displacement of scratch training.
Direction: Reuse, adaptation and prompting grew after issuance; this does not establish that every model-training activity declined.
Magnitude: The trend sentence specifies no percentage. Ten-million-fold model size in the adjacent conditional 2055 scenario is a separate unresolved quantitative extrapolation, not silently reduced to a growth-direction win.
Timing: Explicit long-run context extends to 2055, but this trend sentence has no terminal deadline. No full 2055 outcome or timing success is claimed.
Evidence confidence: Moderate for a broad continuation trend; sample selection and incomplete industry-wide denominators limit stronger grading.
Current edition contribution · Andrej Karpathy
Graded credit: 75 / 100.
- Recency weight
- 90.18630136986302%
- Credit × weight endpoint products
- 67.63972602739726
- Last documented backing
- 2022-03-14 to 2022-03-14
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 75 / 100
- Recency weight
- 83.64383562%
- Weighted credit term
- 62.73287671
- Same-claim backing date
- 2022-03-14 to 2022-03-14
Existing reviewed grade for the original scope; time intrinsic to that scope is retained.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
75,
75
]
},
"backingDateBounds": [
"2022-03-14",
"2022-03-14"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
75,
75
],
"weightBounds": [
0.8364383561643836,
0.8364383561643836
],
"normalizedBackingDateBounds": [
"2022-03-14",
"2022-03-14"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
75,
75
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Gary Marcus10 Mar 2022Google Search will likely continue combining deep learning and symbol-manipulating methods for the foreseeable future.
Three years later, Google described Search features combining Gemini with its Knowledge Graph and existing retrieval/ranking systems.
OutcomePartly rightDirectionRightMagnitudeNot quantifiedTimingNo fixed deadline
2022-03-10
Further evidence: This supports pragmatic hybrid retention as neural capabilities expand. Approximately right for observed Search composition: the provider explicitly retains structured knowledge/retrieval alongside a neural model. Proprietary details are not independently audited and indefinite future persistence remains open.
Direction: Actual deployed AI Overviews plus experimental AI Mode use combinations rather than discarding the existing information systems.
Magnitude: No component share, performance advantage or dominance threshold was specified.
Timing: No precise date supplied; observed postforecast continuation is not proof of forever or a newly invented deadline.
Evidence confidence: Moderate, scoped primary-provider architecture descriptions.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Gary Marcus14 Feb 2022Chart grade 100 / 100Ordinary photo tagging and recognition will improve by 2025.
DINOv2 reported broad 2023 image-recognition gains over pre-forecast DINO across multiple matched benchmarks.
OutcomeRightDirectionRightMagnitudeNot quantifiedTimingWithin original window
2022-02-14
Further evidence: The modest capability-improvement forecast is supported by direct comparative research.
Direction: Recognition performance improved on varied image tasks.
Magnitude: No numeric improvement was promised.
Timing: Documented improvements preceded the 2025 horizon; early realization is not penalized.
Evidence confidence: moderate-high for benchmark direction; developer study and application limits retained
Current edition contribution · Gary Marcus
Graded credit: 100 / 100.
- Recency weight
- 89.72602739726027%
- Credit × weight endpoint products
- 89.72602739726027
- Last documented backing
- 2022-02-14 to 2022-02-14
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 100 / 100
- Recency weight
- 82.87671233%
- Weighted credit term
- 82.87671233
- Same-claim backing date
- 2022-02-14 to 2022-02-14
Existing reviewed grade for the original scope; time intrinsic to that scope is retained.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
100,
100
]
},
"backingDateBounds": [
"2022-02-14",
"2022-02-14"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
100,
100
],
"weightBounds": [
0.8287671232876712,
0.8287671232876712
],
"normalizedBackingDateBounds": [
"2022-02-14",
"2022-02-14"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
100,
100
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Andrew Ng9 Feb 2022Chart grade 75 / 100Suitable data will constrain many practical AI applications.
2024 enterprise surveys report substantial data obstacles; controlled data-design studies corroborate technical importance.
OutcomePartly rightDirectionRightMagnitudeQualitatively supportedTimingNo fixed deadline
2022-02-09
Further evidence: Qualified approximate support for the broad many-applications bottleneck forecast: observed enterprise constraints, not benchmark gains alone. Samples are selected and self-reported; data security and governance are broader than efficient acquisition of suitable training data. The architecture-maturity explanation is not causally identified.
Direction: Practical deployment reports and controlled research agree that obtaining and preparing fit-for-purpose data is a consequential constraint, after the forecast.
Magnitude: Many is qualitative and weakly informative. Substantial reported fractions support prevalence among surveyed enterprises, not a population estimate for every application or the biggest shift in AI.
Timing: Evidence appears in 2023–2024 within the answer’s explicit 2020s context. This realizes a qualitative occurrence prediction, not a claim that data remains dominant through the entire decade; no precise year was promised.
Scope: Competing barriers also limit this interpretation.
Evidence confidence: Moderate; qualified survey-backed assessment with scope and causal limits.
Current edition contribution · Andrew Ng
Graded credit: 75 / 100.
- Recency weight
- 89.64383561643835%
- Credit × weight endpoint products
- 67.23287671232876
- Last documented backing
- 2022-02-09 to 2022-02-09
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 75 / 100
- Recency weight
- 82.73972603%
- Weighted credit term
- 62.05479452
- Same-claim backing date
- 2022-02-09 to 2022-02-09
Existing reviewed grade for the original scope; time intrinsic to that scope is retained.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
75,
75
]
},
"backingDateBounds": [
"2022-02-09",
"2022-02-09"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
75,
75
],
"weightBounds": [
0.8273972602739726,
0.8273972602739726
],
"normalizedBackingDateBounds": [
"2022-02-09",
"2022-02-09"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
75,
75
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Daniel Kokotajlo2 Jan 2022Chart grade 75 / 10050% probability: a Diplomacy AI milestone with player communication during 2022.
Meta reported CICERO negotiating in natural language and placing in the top 10% among multi-game online participants in November 2022.
Probability50%2022-01-02EventOccurredconditionalBrier loss0.25lower is better
2022-01-02
Resolution basis: The outcome and scores below are conditional on this interpretation: Conditional on ordinary broad research-breakthrough meaning of milestone: y=1. No exact rank was promised. Original probability is .5, hence no favored-outcome win.
Resolution limitation: Milestone undefined; no directional win at 50%. Related 2021 scenario retained as unscored lineage, not another adopted forecast.
Proper score: 2022-01-02: p(event)=50%; outcome=1 (occurred); Brier=0.25; log loss=0.6931472 nats.
Outcome dates: 2022-11-22
Provenance confidence: Moderate: strong evidence of with-communication achievement, but original milestone threshold is qualitative.
Revision provenance: No dependent probability revision located.
Interpretation: Lower Brier and log loss are better. Revisions concern the same event, not additional forecasts. One event does not establish calibration or overall reliability.
Further evidence: Explicit probability; event resolved true, not a categorical forecast win.
Direction: At 50%, no favored direction; either outcome gives identical proper loss.
Magnitude: Original has no exact numerical performance threshold.
Timing: Event occurred within 2022; categorical timing axis not applied to probability forecast.
Scope: Original window: January 2–December 31, 2022. “Milestone” specifies no rank, game count, speed or expert population. Resolution uses a broad research-breakthrough interpretation, not a retrofitted numerical threshold. The related 2021 scenario remains unscored lineage, not another adopted forecast. Current post metadata is not immutable issue-time proof.
Evidence confidence: Moderate: strong evidence of with-communication achievement, but original milestone threshold is qualitative.
Current edition contribution · Daniel Kokotajlo
Graded credit: 75 / 100.
- Recency weight
- 89.01917808219179%
- Credit × weight endpoint products
- 66.76438356164384
- Last documented backing
- 2022-01-02 to 2022-01-02
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
Selected probability event only. This is not a whole-outcome grade. Archive timing: Not separately applicable.
- Credit
- 75 / 100
- Recency weight
- 81.69863014%
- Weighted credit term
- 61.2739726
- Same-claim backing date
- 2022-01-02 to 2022-01-02
- Authored probability
- 50%
- Event outcomes retained
- 1
Brier credit on the original event, including its stated window. No separate timing deduction.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "binary_probability",
"probabilityBounds": [
0.5,
0.5
],
"outcomes": [
1
]
},
"backingDateBounds": [
"2022-01-02",
"2022-01-02"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
75,
75
],
"weightBounds": [
0.816986301369863,
0.816986301369863
],
"normalizedBackingDateBounds": [
"2022-01-02",
"2022-01-02"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
75,
75
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Daniel Kokotajlo2 Jan 2022Chart grade 75 / 10050% probability: MMLU state of the art exceeds 70% during 2022.
October 2022 Flan-PaLM reported 72.2% direct five-shot MMLU test accuracy and 75.2% with chain-of-thought plus self-consistency.
Probability50%2022-01-02EventOccurredconditionalBrier loss0.25lower is better
2022-01-02
Resolution basis: The outcome and scores below are conditional on this interpretation: Published whole-benchmark test accuracy exceeds threshold before year-end; reported research result, not independent replication.
Resolution limitation: No directional win at 50%; one event does not establish calibration.
Proper score: 2022-01-02: p(event)=50%; outcome=1 (occurred); Brier=0.25; log loss=0.6931472 nats.
Outcome dates: 2022-10-20
Provenance confidence: High for published benchmark threshold and current original metadata; no immutable issue-time archive was inspected.
Revision provenance: No dependent probability revision located.
Interpretation: Lower Brier and log loss are better. Revisions concern the same event, not additional forecasts. One event does not establish calibration or overall reliability.
Further evidence: Both exceed 70%. Explicit probability; event resolved true, not a categorical forecast win.
Direction: At 50%, no favored direction; either outcome gives identical proper loss.
Magnitude: Threshold event, not a separate magnitude prediction.
Timing: Event occurred within 2022; categorical timing axis not applied to probability forecast.
Scope: Original window: January 2–December 31, 2022. Benchmark threshold only, not general intelligence. The author disclosed minimal deliberation and loose calibration. Developer-reported test results, not independent replication; current post metadata is not immutable issue-time proof.
Evidence confidence: High for published benchmark threshold and current original metadata; no immutable issue-time archive was inspected.
Current edition contribution · Daniel Kokotajlo
Graded credit: 75 / 100.
- Recency weight
- 89.01917808219179%
- Credit × weight endpoint products
- 66.76438356164384
- Last documented backing
- 2022-01-02 to 2022-01-02
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
Selected probability event only. This is not a whole-outcome grade. Archive timing: Not separately applicable.
- Credit
- 75 / 100
- Recency weight
- 81.69863014%
- Weighted credit term
- 61.2739726
- Same-claim backing date
- 2022-01-02 to 2022-01-02
- Authored probability
- 50%
- Event outcomes retained
- 1
Brier credit on the original event, including its stated window. No separate timing deduction.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "binary_probability",
"probabilityBounds": [
0.5,
0.5
],
"outcomes": [
1
]
},
"backingDateBounds": [
"2022-01-02",
"2022-01-02"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
75,
75
],
"weightBounds": [
0.816986301369863,
0.816986301369863
],
"normalizedBackingDateBounds": [
"2022-01-02",
"2022-01-02"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
75,
75
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Stuart Russell2022 · uncertainOver the coming decade, modest perception and dexterity advances would expand robotics across roads, warehouses, agriculture, mining and warfare.
Actual deployment expansion covers the five named settings; the central qualitative trajectory is supported, while modest-advance causal sufficiency remains unresolved.
OutcomePartly rightDirectionPartly rightMagnitudePartly supportedTimingWithin original window
2022-Spring
Further evidence: Qualified deployment trajectory, not proof that modest advances alone suffice.
Direction: Post-2022 operational expansion, not sector labels or planned purchases alone.
Magnitude: Named breadth supported; specialized, supervised operations do not establish arbitrary-environment capability or market penetration.
Timing: Observed expansion falls within 2022–2032, not a new 2026 deadline or full endpoint verdict.
Scope: Credit expansion, not invention: mining and military robotics predated issuance. Amazon’s June 2026 account reports Proteus moving carts around people at 25 US fulfillment centers; dock-area specialization and company reporting are retained. Its next-generation laboratory robot and planned 2027 deployment are not outcomes. Waymo’s December 2025 report says over 14 million public trips, over three times 2024; the later-added 15-million footnote is not used. Bounded service areas do not establish all-road/all-weather capability or profitability. Deere’s December 2025 investor presentation reports cumulative GUSS use of 600,000 autonomous hours and 2.8 million acres. This supports agricultural use, not wholly post-2022 growth; supervision remains and future retrofit plans are excluded. A May 2022 partner release already reported over 500 autonomous Cat mining trucks. Caterpillar’s January 2026 account reports nearly 700, not a precise comparable growth rate. Four autonomous trucks entered Bull Run quarry in November 2024; the operator/vendor account reports one million tons by July 2025 and over two million in the first year. Interactions with staffed machines, tailored site processes and human oversight remain; not all equipment/sites, independent safety validation or prospective construction success. USNI’s March 2025 direct program-leader interviews confirm operational deployment of two ships’ mine-countermeasure packages incorporating autonomous capability. This is a mixed crewed, remote and autonomous package after long delays and reduced scope—not autonomous whole missions, human-target selection or demonstrated warfare effectiveness. These operational examples do not isolate whether every enabling advance was modest. No universal reliability or general-intelligence breakthrough is inferred.
Evidence confidence: Moderate for qualified multi-setting deployment trajectory; lower for causal sufficiency and broad unsupervised capability.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Eliezer Yudkowsky1 Dec 2021Chart grade 0 / 100Mainline expectation: mixture-of-experts would not become a fruitful next technical trend.
Mixtral and DeepSeek-V3 became useful released MoE systems with competitive results; sparse activation offered practical benefits.
OutcomeWrongDirectionWrongMagnitudeNot quantifiedTimingNo fixed deadline
2021-12-01 public post; December 3 MIRI mirror
Further evidence: Subsequent productive systems contradict the scoped unpromising-path expectation.
Direction: MoE advanced and became practically important rather than remaining a dead end.
Magnitude: No numerical size or market-share claim.
Timing: Long-run technique discussion with no delivery deadline; no timing penalty.
Evidence confidence: high for useful post-issuance MoE progress; moderate-high for qualitative mainline interpretation
Current edition contribution · Eliezer Yudkowsky
Graded credit: 0 / 100.
- Recency weight
- 88.4931506849315%
- Credit × weight endpoint products
- 0
- Last documented backing
- 2021-12-01 to 2021-12-01
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 0 / 100
- Recency weight
- 80.82191781%
- Weighted credit term
- 0
- Same-claim backing date
- 2021-12-01 to 2021-12-01
Existing reviewed grade for the original scope; time intrinsic to that scope is retained.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
0,
0
]
},
"backingDateBounds": [
"2021-12-01",
"2021-12-01"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
0,
0
],
"weightBounds": [
0.8082191780821918,
0.8082191780821918
],
"normalizedBackingDateBounds": [
"2021-12-01",
"2021-12-01"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
0,
0
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Paul Christiano25 Nov 2021Over the next ten years, powerful ML systems will mainly learn short-horizon human behavior, then use much smaller amounts of longer-horizon feedback for fine-tuning.
InstructGPT and Llama2 used large autoregressive pretraining followed by smaller demonstration/preference tuning; exact longer-horizon requirement and future field dominance remain open. Whole outcome unresolved.
OutcomeUnresolvedDirectionPartly rightMagnitudePartly supportedTimingFuture window open
2021-11-25
Further evidence: Decade-wide dominance and the intended long-horizon feedback condition remain unresolved.
Direction: Large human-text imitation pretraining followed by feedback fine-tuning was used in important later models, including Meta outside his former employer.
Magnitude: InstructGPT compute accounting and Llama2 data scales support relatively small tuning stages locally, not a complete global census.
Timing: Original ten-year window remains pending; no deadline reset or near-term launch credit.
Evidence confidence: moderate for partial method direction; low for full 2031 forecast
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Paul Christiano22 Nov 2021Coding assistants will substantially accelerate human coding.
Controlled studies found substantial local coding-speed benefits; an experienced-maintainer trial instead found slower work.
OutcomePartly rightDirectionRightMagnitudePartly matched scopeTimingWithin original window
22 November 2021 publication; conversation 14 September 2021.
Further evidence: Local benefits; universality and exact smoothness unproven.
Direction: Heterogeneous task benefits; benchmark progress.
Magnitude: No numeric target or workforce estimate; Google’s preferred adjusted estimate remains uncertain.
Timing: Ten-year window, late-2031 endpoint open; no completed takeoff-ordering judgment.
Scope: Gradually useful imperfect assistants precede contemplated takeoff; not total research doubling. Existing Codex/Copilot: no invention credit. Peng’s 2023 report: May–June 2022 experiment randomized 95 professional Upwork programmers to one JavaScript HTTP-server task; 35 per arm completed. Completers averaged 71.17 versus 160.89 minutes, 55.8% less time (reported 95% interval 21–89%), not the same percentage increase in work rate. Timing stopped at 12 visible tests. The seven-point completion-rate difference was nonsignificant. Completer conditioning, one task and possible training-example familiarity limit inference; broader quality, security and maintenance were not evaluated. Google’s June–July 2024 trial (initial 2024-10-16; v3 2024-11-11) randomized 96 full-time engineers on one unfamiliar enterprise-style C++ logging task with internal completion/paste/language-to-code tools; 93 finished. Raw means were 96 versus 114 minutes (unadjusted log-time p=.038). Preferred adjusted savings were about 21%, but the coefficient interval [−.51,.03] crossed zero (p=.086). Apparent reversed log-time labels do not override raw times and coefficient direction. One employer and a short constructed task limit generalization. Both positive studies evaluated affiliated vendors’ tools, not independent reproductions. GPT-4 report v6 (2024-03-04; first March 2023): zero-shot HumanEval 67.0% versus GPT-3.5 48.1%; 25% contamination, clean subset 65.58%. Capability, not developer speed. METR’s July 25, 2025 v2 (first July 12) assigned 246 real-repository tasks from 16 experienced maintainers; early-2025 tools increased time 19%, contrary to perceived gains. Tasks/difficulty forecasts preceded assignment; AI use was optional. Time was self-reported with recording checks. Mature-project familiarity and maintenance/review standards limit generalization; not a workforce census or universal slowdown. February 2026 follow-up suggested improvement, but both intervals crossed zero; participation/task selection, noncompletion and concurrent-agent timing prevent a reliable reversal estimate. Unlike populations are not averaged. One forecast, not one vote per study; no later same-scope endorsement is inferred.
Shared evidence: EY-D1034 shares this conversation; dependent evidence.
Evidence confidence: Moderate for qualified application-level success; unresolved representative workforce magnitude and broader continuous-takeoff thesis.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Jensen Huang9 Nov 2021By 2024, the vast majority of new EVs would have substantial autonomous-driving capability.
Gasgoo reports roughly half of Chinese new-energy passenger cars had standard L2-category equipment in 2024 Q1. Whole outcome unresolved.
OutcomeUnresolvedDirectionPartly rightMagnitudeUnresolvedTimingTiming unresolved
2021-11-09
Further evidence: Jiuzhang reports rising 2022–2023 equipment penetration in a different sample; its classifier includes parking. For full-year 2024 Chinese NEVs, Gasgoo reported near 60% standard L2-and-above equipment; its March 8 summary reported 56.9% L2-and-above ADAS penetration. Global endpoint unresolved: capability, EV category and units-versus-models denominator are undefined.
Direction: Bounded assisted-equipment diffusion, not proven driverless use.
Magnitude: Regional roughly-half levels counter saturation, not a global falsification; no invented majority cutoff.
Timing: 2024 has elapsed; no matched global endpoint and no automatic failure from elapsed time.
Scope: Standard, optional, activated and used are different measures. Do not combine databases or selected high-price strata. Jiuzhang coverage is incompletely documented; NEV categories can include hybrids/range extenders; the original EV denominator remains unclear. Earlier supervised-AV terminology is context, not a retroactive threshold; no L3/L4 requirement is imposed. Gasgoo reports are dependent, not independent confirmations or percentages to average.
Evidence confidence: Moderate for bounded equipment diffusion, low for resolving original threshold/denominator.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Paul Christiano4 Nov 2021Roughly 2× architectural training gains without substantially tighter research returns by 2024.
Google-affiliated FLASH 2022 reports comparable-quality architectural training gains above 2x in long-context language settings, while shorter contexts show much smaller gains. Whole outcome unresolved.
OutcomeUnresolvedDirectionPartly rightMagnitudePartly matched scopeTimingWithin original window
2021-11-04
Further evidence: Google CoLT5 in 2023 documents further 35–75% training speedups on matched long-input tasks. These support continued available gains, not a measured distribution of returns per unit research effort. Typical effort-adjusted returns unverified.
Direction: Continued gains in selected studies.
Magnitude: Context-dependent gains, not typical returns.
Timing: Partial gains precede 2024, not full verification.
Scope: Language-model research, not every experiment; eventual tightening expected. No inference-speed or hardware substitution is credited.
Shared evidence: These forecasts share one conversational source; they are not independent observations.
Evidence confidence: Moderate for actual benchmark gains; low for industry-wide typical research returns.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Paul Christiano4 Nov 2021Chart grade 88.89 / 100One-third chance of genuine Tesla self-driving in 2024.
False: Tesla’s year-end report still required fully engaged drivers.
Probability33.3333333333%2021-11-04EventNot occurredBrier loss0.1111111lower is better
2021-11-04
Resolution confidence: High for required driver supervision through 2024; moderate for the informal FSD boundary.
Proper score: 2021-11-04: p(event)=33.3333333333%; outcome=0 (did not occur); Brier=0.1111111; log loss=0.4054651 nats.
Conditional branch: If Tesla achieves genuine FSD in 2024: Tesla market capitalization exceeds $3 trillion; verbal likelihood “probably” (not quantified). Condition not met; unscored.
Conditional branch: If Tesla achieves genuine FSD in 2024: Waymo rolled out to many cities; p=66.6666666667%. Condition not met; unscored.
Conditional branch: If Tesla does not achieve genuine FSD in 2024: Waymo rolled out to roughly half of large US cities; p=10%. Condition met; city denominator undefined; unscored.
Outcome dates: 2024-12-31; primary year-end Tesla report filed January 2025
Provenance confidence: High for Tesla supervised-only outcome; original is an informal conversational forecast with explicit self-qualification.
Interpretation: Lower Brier and log loss are better. Revisions concern the same event, not additional forecasts. One event does not establish calibration or overall reliability.
Conditional scope: Inactive conditions receive no score. An activated but undefined event also remains unscored. Branches are linked parts of this forecast, not additional observations.
Further evidence: Not separately applicable.
Scope: Actual unsupervised driving, not branding; no universal Level 5, weather or geographic requirement. Probability scored, not a categorical promise. Conditional branches are untriggered or insufficiently defined.
Shared evidence: These forecasts share one conversational source; they are not independent observations.
Evidence confidence: High for Tesla supervised-only outcome; original is an informal conversational forecast with explicit self-qualification.
Current edition contribution · Paul Christiano
Graded credit: 88.88888888888889 / 100.
- Recency weight
- 88.04931506849316%
- Credit × weight endpoint products
- 78.26605783866059
- Last documented backing
- 2021-11-04 to 2021-11-04
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
Selected probability event only. This is not a whole-outcome grade. Archive timing: Not separately applicable.
- Credit
- 88.88888889 / 100
- Recency weight
- 80.08219178%
- Weighted credit term
- 71.18417047
- Same-claim backing date
- 2021-11-04 to 2021-11-04
- Authored probability
- 33.33333333%
- Event outcomes retained
- 0
Brier credit on the original event, including its stated window. No separate timing deduction.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "binary_probability",
"probabilityBounds": [
0.3333333333333333,
0.3333333333333333
],
"outcomes": [
0
]
},
"backingDateBounds": [
"2021-11-04",
"2021-11-04"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
88.88888888888889,
88.88888888888889
],
"weightBounds": [
0.8008219178082192,
0.8008219178082192
],
"normalizedBackingDateBounds": [
"2021-11-04",
"2021-11-04"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
88.88888888888889,
88.88888888888889
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Paul Christiano4 Nov 2021By 2024, strong real-time translation but no ordinary video-chat integration.
Meet and Teams integrated translated captions in 2022. Whole outcome unresolved.
OutcomeUnresolvedDirectionMixedMagnitudeUnresolvedTimingTiming unresolved
2021-11-04
Further evidence: Paid tiers and language limits do not establish universal free default access. WMT text benchmarks do not establish end-to-end speech performance or population-equivalent quality. Captions are not voice dubbing. No numeric probability is inferred. Full quality and latency unresolved.
Direction: Usefulness supported; integration contradicts the exclusion.
Magnitude: Population benchmark and economics unverified.
Timing: Partial contradiction before 2024; full endpoint unjudgeable.
Scope: Bilingual mean plus one standard deviation, listening and typing. Tentative economics: Google lead, mainly free provision, about $0.01/word and tens of millions annually; unresolved.
Shared evidence: These forecasts share one conversational source; they are not independent observations.
Evidence confidence: High for dated integration; moderate for broad usefulness; insufficient for the exact bilingual quality and latency magnitude.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Ilya Sutskever6 Oct 2021Code models improve, assist programmers and change practice over coming years.
Subsequent code benchmarks improved, and controlled studies demonstrated useful assistance on selected tasks and in several firms.
OutcomePartly rightDirectionRightMagnitudeNot quantifiedTimingNo fixed deadline
2021-10-06 publication; recording date unknown
Further evidence: A separate experienced-developer study found slower work, so neither universal gains nor wholesale profession transformation is established. METR’s February 2026 follow-up suggests improvement, but selection and measurement problems prevent a reliable effect-size estimate; the early-2025 slowdown is not a universal current estimate. Selected useful assistance is supported; profession-wide change and the particular library mechanism remain unmeasured.
Direction: Later benchmarks and controlled studies support heterogeneous progress.
Magnitude: No numerical or workforce-wide threshold.
Timing: Multi-year context, not a fixed endpoint.
Scope: Especially unfamiliar libraries. Existing demonstrations are context; broader white-collar changes are not separately counted.
Shared evidence: These forecasts share the same 2021 conversation and are not independent observations.
Evidence confidence: Moderate; primary comparative evidence, partly vendor-affiliated, with independent contrary experiment.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Ilya Sutskever6 Oct 2021Chart grade 100 / 100Over coming years, faster computers, more available training data and better models.
2022–2024 primary reports document faster ML training systems, a larger curated public corpus, and improved language-model evaluation at equal training compute.
OutcomeRightDirectionRightMagnitudeNot quantifiedTimingTiming unresolved
2021-10-06 publication; recording date unknown
Further evidence: This supports the modest three-part continuation claim, not exceptional foresight or indefinite scaling. Separate postissue examples support all three components; low information content, not exceptional foresight.
Direction: Systems, usable data and measured model quality improved.
Magnitude: Observed gains are evidence, not retrospectively promised amounts.
Timing: Examples within roughly two years and four months; no exact endpoint.
Scope: One modest continuation bundle; efficiency discussion is not another forecast. No universal task improvement or AGI. System performance includes software; equal-compute comparisons do not isolate one change. Separate corpus evidence is not merely repeated training tokens.
Shared evidence: These forecasts share the same 2021 conversation and are not independent observations.
Evidence confidence: Moderate-high for bounded continuation, low information content. No general intelligence or economy-wide consequence established.
Current edition contribution · Ilya Sutskever
Graded credit: 100 / 100.
- Recency weight
- 87.57260273972602%
- Credit × weight endpoint products
- 87.57260273972602
- Last documented backing
- 2021-10-06 to 2021-10-06
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 100 / 100
- Recency weight
- 79.28767123%
- Weighted credit term
- 79.28767123
- Same-claim backing date
- 2021-10-06 to 2021-10-06
Existing reviewed grade for the original scope; time intrinsic to that scope is retained.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
100,
100
]
},
"backingDateBounds": [
"2021-10-06",
"2021-10-06"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
100,
100
],
"weightBounds": [
0.7928767123287671,
0.7928767123287671
],
"normalizedBackingDateBounds": [
"2021-10-06",
"2021-10-06"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
100,
100
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Kai-Fu Lee29 Sep 2021Chart grade 100 / 100Many relatively autonomous vehicles operate on streets in the United States, China and other countries within five years.
Actual service in the United States, China and the UAE by 2025 supports the predicted diffusion before the horizon.
OutcomeRightDirectionNot separately gradedMagnitudeNot quantifiedTimingWithin original window
2021-09-29 publication; recording date not separately established
Original horizon: Approximately 2026-09-29; recording/publication interval retained
Further evidence: Geographic and weather restrictions fit this relatively autonomous service target; they do not establish universal autonomy or superior safety. Actual service across the named regions supports bounded diffusion within the forecast’s intended scope.
Direction: Not separately graded in the historical record.
Magnitude: “Many” remains qualitative rather than specifying a numerical fleet-size threshold.
Timing: Documented 2025 operation precedes the approximate upper horizon; no unique first-arrival date is established.
Scope: Company operating data and UAE regulatory corroboration are not a global fleet or safety census. Separate safety and employment predictions remain unresolved or pending.
Evidence confidence: Not separately rated.
Current edition contribution · Kai-Fu Lee
Graded credit: 100 / 100.
- Recency weight
- 87.45753424657535%
- Credit × weight endpoint products
- 87.45753424657535
- Last documented backing
- 2021-09-29 to 2021-09-29
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 100 / 100
- Recency weight
- 79.09589041%
- Weighted credit term
- 79.09589041
- Same-claim backing date
- 2021-09-29 to 2021-09-29
Existing reviewed grade for the original scope; time intrinsic to that scope is retained.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
100,
100
]
},
"backingDateBounds": [
"2021-09-29",
"2021-09-29"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
100,
100
],
"weightBounds": [
0.790958904109589,
0.790958904109589
],
"normalizedBackingDateBounds": [
"2021-09-29",
"2021-09-29"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
100,
100
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Paul Christiano21 Sep 2021Across tasks, training compute for fixed performance tends to fall by less than 2× annually.
Post-issue 2023–2025 multi-benchmark language-model estimates support falling training compute, but central rates exceed 2× annually. Whole outcome unresolved.
OutcomeUnresolvedDirectionRightMagnitudeUnresolvedTimingTiming unresolved
21 September 2021 conversation; 25 November 2021 publication
Further evidence: This challenges the numerical prediction; it does not establish a majority of task-specific rates. Whole cross-task tendency unresolved.
Direction: Only declining compute in the observed scope is supported, not the predicted pace.
Magnitude: Central faster estimates have wide intervals including slower-than-2× rates; no whole-task rate verdict.
Timing: Annual trend, no terminal year or completed whole-field measurement.
Scope: Not inference prices or hardware speed. Pooled latent capability is not a representative task census. Calibration, scale assumptions, training recipes, hidden synthetic-data costs and differing inference compute matter. The separate FOOM antecedent is unobserved and ungraded. Distinct from per-project architectural returns.
Shared evidence: Related software-progress thesis; not an independent replication of the architecture forecast.
Evidence confidence: Moderate for bounded observed efficiency direction; insufficient for whole numerical tendency.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Eliezer YudkowskySep–Nov 2021 · rangeChart grade 75 / 100Codex-type coding capability would advance over years and attract outside imitators.
BigCode and Meta released substantial coding-model competitors in 2023, reporting meaningful benchmark gains.
OutcomePartly rightDirectionRightMagnitudeGains supported; leap unresolvedTimingNo fixed deadline
2021-11-22
Further evidence: Differing evaluation setups do not establish an exact gain or discontinuous trajectory. Central model-progress and entrant expectations materialized; discontinuity interpretation remains unproven.
Direction: External model releases and improved coding benchmarks support the direction.
Magnitude: Meaningful gains, but no original numeric target and no matched proof of a discontinuous frontier trajectory.
Timing: Multi-year, without a deadline; alternative two/five-year possibilities are not commitments.
Scope: Low-novelty multi-year progress and outside entrants, not measured discontinuity, revenue or AGI. Benchmark settings differ; no exact causal gain claimed.
Evidence confidence: Moderate for scoped approximate match; high for outside entrants; low for discontinuity.
Current edition contribution · Eliezer Yudkowsky
Graded credit: 75 / 100.
- Recency weight
- 88.34520547945206%
- Credit × weight endpoint products
- 66.25890410958904
- Last documented backing
- 2021-11-22 to 2021-11-22
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 75 / 100
- Recency weight
- 80.57534247%
- Weighted credit term
- 60.43150685
- Same-claim backing date
- 2021-11-22 to 2021-11-22
Existing reviewed grade for the original scope; time intrinsic to that scope is retained.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
75,
75
]
},
"backingDateBounds": [
"2021-11-22",
"2021-11-22"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
75,
75
],
"weightBounds": [
0.8057534246575343,
0.8057534246575343
],
"normalizedBackingDateBounds": [
"2021-11-22",
"2021-11-22"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
75,
75
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Elon Musk19 Aug 2021Tesla humanoids will perform useful general work with flexible human instructions.
Tesla reported autonomous battery handling in one facility in July 2024; broad task flexibility and dependable productive use remain unverified. Whole outcome unresolved.
OutcomeUnresolvedDirectionPartly rightMagnitudeUnresolvedTimingNo fixed deadline
2021-08-19
Further evidence: In October 2026, Musk still described substantial AI and durability work and a future non-preprogrammed demonstration. The general work target remains unresolved; constrained task execution is not generality.
Direction: Approximately right: same-company autonomous physical task work is reported, beyond merely displaying a humanoid.
Magnitude: Task breadth, reliability, assistance and labor savings remain undisclosed; no scale target manufactured.
Timing: Undated long-run expectation; no prototype deadline imported or late penalty assigned.
Scope: The later source is a publisher transcription of issuer speech, not issuer-certified, audio-verified, or its AI-generated summary. Official chronology places the call on October 21, 2026; the publisher header says October 25. It does not negate the July 2024 component report, establish general task reliability, import a 2027 deadline, or update current-belief metadata.
Evidence confidence: Moderate for issuer-reported narrow task direction; limited for full capability.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Daniel Kokotajlo11 Aug 2021AI hype will grow over the next two years as capabilities and public interaction increase, then probably crash when expectations disappoint.
By March 2023, 58% of US adults had heard of ChatGPT and 14% had used it. Whole outcome unresolved.
OutcomeUnresolvedDirectionPartly rightMagnitudeNot quantifiedTimingWithin original window
2021-08-11
Further evidence: The predicted public-exposure direction appeared; later hype crash not established. Rise-then-crash trajectory unresolved; adoption cannot measure excessive expectations or prove later reversal. The author himself calls the forecast imprecise; no calibrated score is assigned.
Direction: The explicitly predicted wider public interaction with generative AI is supported, narrowly and qualitatively.
Magnitude: No numerical magnitude was specified; US survey is not a global estimate.
Timing: Narrow initial public-exposure development occurred before August 2023; no completion date or timing credit for crash.
Evidence confidence: moderate-to-low; vague hype concept, qualitative direction only
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
François Chollet27 Jul 2021Over the coming 5–10 years, ML develops more reusable pretrained components, higher-level automated workflows, easier large-scale cloud training and wider portable deployment.
Reusable models and automated workflows are joined by production mobile execution, browser benchmarks, embedded-runtime support and deployed multi-cloud orchestration.
OutcomePartly rightDirectionPartly rightMagnitudePartly supportedTimingTiming unresolved
2021-07-27
Further evidence: Alpa reports 128–1024-GPU automatic partitioning; Glean reports completed hosted training. Qualified four-trend trajectory; the exact same-workflow hundred-GPU public-cloud versus local effort comparison remains unresolved.
Direction: Reuse, automation, cloud orchestration and portable execution each progressed.
Magnitude: Local expansion, not arbitrary portability or equal-friction training. Increasing automation need not eliminate engineering.
Timing: Post-2021 evidence fits the original 2021–2031 window; exact strongest-comparison attainment is unjudgeable. No point-deadline success or reset; stronger-contract timing can remain pending.
Scope: Sponsored interview; forecaster builds related tools. First-party deployments are not independent audits. Meta reports production migrations, not billions using each feature. Browser tests require converted models, not native-speed parity; embedded-runtime availability is not deployment prevalence. H Company’s 2,000-plus-GPU pool is not one job; its example uses 32 GPUs. SkyPilot repeats that customer evidence, not independent replication. Configuration, backends, supply constraints and migration friction persist; no user study establishes local-training ease. Alpa used a prepared Selene cluster, static JAX graphs, known shapes and configured pipelines: not public-cloud onboarding or an effort study. Glean discloses no GPU count; Waldo’s production release was still prospective. Tinker repeats Glean, not independent replication; broader adoption is nascent and full fine-tuning/inference remain beta. Proximal’s 128 serving GPUs are not gradient-training GPUs; custom routing, checkpointing, synchronization and preemption/geography issues remained. Pathos is excluded from dated support because its edited version is not verified by cutoff.
Evidence confidence: Moderate for central field-wide development directions and supported-workload simplification; lower for the exact local-versus-hundreds-of-cloud-GPUs comparison. Vendor/framework involvement, prepared infrastructure and current-page version limits remain explicit.
Earlier dependent version assessment: 2020-02-27. Five years, through approximately February 2025; the July 2021 forecast is not reset. Central three-branch trajectory: partly right; direction and magnitude partly supported; timing within the earlier window only for that bounded trajectory. The strict all-bullet conjunction, including its timing, remains unresolved. The slides organize automation, cloud scale/workflows and real-world deployment as three headings; mechanisms including lifelong learning and private edge personalization are substantive illustrations, not separate release promises or guaranteed universal adoption. Lifelong-learning/feature-bank breadth and seamless-use generality remain unverified. The dated event and March 1, 2020 PDF metadata agree, without proving unmodified publication history. AutoMM’s 2024 higher-level workflow automates data handling, selection and fine-tuning, but requires expert design; reusable components do not establish general lifelong learning. In 2023, SkyPilot reported months of use by dozens at three universities and four other organizations. Favorable firsthand feedback is not a controlled usability comparison; provisioning delays, batch scope, on-premise integration and cross-cloud troubleshooting remain limits. No controlled local-ease or hundred-GPU comparison was made. 2024 WebLLM demonstrates converted-model browser execution, not arbitrary compatibility, mass adoption or native-speed equality. Samsung’s January 2024 version reports early-2023 NNTrainer product deployment and measured on-device neural personalization on a Galaxy S21 Ultra: 364 MiB, under ten minutes despite throttling. This is parameter adaptation, not neighboring non-neural examples. Millions of software deployments are not audited active-personalization users. Vendor evidence lacks independent use verification; universal hardware and lifelong learning are unproved. These added claims are not backdated to the 2022 first version. Google’s March 2023 report describes deployed Smart Text Selection training with secure aggregation and distributed differential privacy. Memory/communication gains preserve central-DP accuracy; the privacy parameter remains weak, in the hundreds, and assumes an honest-but-curious server. Malicious servers, universal private deployment and individual personalization are not established. Existing AutoML, cloud, inference and federated learning are baselines, not inventions. The August 2025 lineage study, late-2025 Meta/Arm outcomes and 2026 H Company evidence are excluded from this earlier endpoint. No later hundred-GPU/local ease comparison is imported. One related version, not a separate forecast. The main 2021 central trajectory is now assessed as partly right, with partly supported magnitude and unresolved exact timing; its stricter equal-friction cloud/local interpretation remains unresolved and its original 2021–2031 window is not reset. Version-specific evidence confidence is not separately rated. · Earlier original · Event provenance · Outcome source 1 · Outcome source 2 · Outcome source 3 · Outcome source 4 · Outcome source 5
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Sam Altman16 Mar 2021Chart grade 75 / 100Within five years, programs read legal documents and give medical advice.
Legal and medical studies published in 2023 demonstrated both functions, with substantial limits on complex tasks and answer reliability.
OutcomePartly rightDirectionNot separately gradedMagnitudeNot quantifiedTimingWithin original window
2021-03-16
Original horizon: 2026-03-16
Further evidence: They support the central functional prediction, not replacement of qualified professionals or demonstrated clinical safety. Both functions were demonstrated, but reliability and complex-task limitations qualify the stronger reading.
Direction: Not separately graded in the historical record.
Magnitude: The forecast names two functions but specifies no numerical reliability threshold.
Timing: The supported legal and medical functions were documented by 2023, within the original window.
Scope: First occurrence was not exhaustively established. Later improvements are not assumed to have removed the observed limitations. Published October 2024, a randomized study tested 50 US physicians on six curated vignettes in November–December 2023. Model access versus conventional resources yielded median reasoning scores of 76% versus 74%; adjusted difference 2 points (95% CI −4 to 8). Exploratory standalone GPT-4 scored 92%, a 16-point advantage (CI 2 to 30), with an iteratively developed prompt and three unedited, blindly graded runs. These are rubric scores, not patient diagnostic-success rates. Small case coverage, no real patient encounters, unequal prompting support and exploratory analysis limit generalization. One coauthor was Microsoft-affiliated; philanthropic funders reportedly had no role. Strong model vignette capability did not significantly improve physician performance; no patient-benefit or autonomous-safety inference.
Evidence confidence: Not separately rated.
Current edition contribution · Sam Altman
Graded credit: 75 / 100.
- Recency weight
- 84.21917808219177%
- Credit × weight endpoint products
- 63.16438356164383
- Last documented backing
- 2021-03-16 to 2021-03-16
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 75 / 100
- Recency weight
- 73.69863014%
- Weighted credit term
- 55.2739726
- Same-claim backing date
- 2021-03-16 to 2021-03-16
Existing reviewed grade for the original scope; time intrinsic to that scope is retained.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
75,
75
]
},
"backingDateBounds": [
"2021-03-16",
"2021-03-16"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
75,
75
],
"weightBounds": [
0.736986301369863,
0.736986301369863
],
"normalizedBackingDateBounds": [
"2021-03-16",
"2021-03-16"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
75,
75
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Sam Altman16 Mar 2021Within ten years, learning/thinking programs will perform assembly-line work.
BMW confirmed its 2025 Figure02 pilot performed sheet-metal loading for welding in actual vehicle production, with over 90,000 components handled and about 1,250 operating hours.
OutcomePartly rightDirectionRightMagnitudeNot quantifiedTimingWithin original window
2021-03-16
Further evidence: BMW describes learned motion sequences transferred from laboratory training to stable shift operation. Learning-enabled robots performing a narrow assembly-line task support the core prediction; undefined thinking does not establish general intelligence.
Direction: Physical learned-control work occurred in production rather than only a staged lab demonstration.
Magnitude: No share of factory work, robot population or productivity multiplier specified.
Timing: Verified 2025 work precedes the original March 2031 upper bound. This is an early realization, not evidence for the exact first occurrence.
Evidence confidence: Moderate-high for narrow work realization; moderate for thinking/learning interpretation.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Ajeya Cotra5 Mar 2021Most practical human-feedback alignment tools, infrastructure and know-how would eventually develop anyway.
Qualified practical realization: rater workflows, platforms and local assisted reviewing.
OutcomePartly rightDirectionPartly rightMagnitudePartly supportedTimingNo fixed deadline
2021-03-05
Further evidence: Central practical trajectory supported; full most/anyway conjunction unresolved.
Direction: Practical feedback methods expanded.
Magnitude: Several branches supported; no numerical completeness fraction.
Timing: Eventual horizon; no fixed deadline or timing hit.
Scope: Most has no finite denominator; development without deliberate acceleration remains unproved. No solved alignment, reliable superhuman oversight or public off-the-shelf critic is established. Existing methods limit novelty. InstructGPT (2022) documents rater screening, onboarding, instructions, agreement checks and interfaces, partly reusing 2020 methods; selected-rater preferences, not first invention. Argilla’s June 2023 release collects demonstrations and comparative judgments; developer availability is not independent efficacy. Its November 2024 no-code import, configuration and collection improve accessibility, not oversight adequacy. The 2023 trlX work supplies reusable RLHF training, including large-model and low-resource settings; prior libraries already existed. StackLlama’s April 2023 pipeline and guide retain training-instability and evaluation limits. CriticGPT’s June 28, 2024 paper and June 27 company publication describe one experiment, not independent replications. Assisted critiques were preferred to unassisted humans 60.4% of the time (reported 69% interval 58.0–62.8). Natural bugs were selected from errors already noticed once; evaluators saw reference-bug descriptions. Reviewers could edit/remove suggestions; self-ratings were excluded. Critics did not significantly improve harder ground-truth code-solution judgments, hallucination tradeoffs remained, and final-policy improvement was not tested. This is local judgment assistance, not an independently released off-the-shelf critic.
Shared evidence: One infrastructure forecast, not per-tool votes. InstructGPT also supports Paul and Hassabis; those uses are dependent.
Evidence confidence: Moderate for qualified observed practical development; low for completeness, no-acceleration counterfactual and transfer to robust superhuman oversight.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Ajeya Cotra5 Mar 2021The AI investment boom will be sustained for several more years.
AI investment stayed elevated over multiple years and recovered in 2024, but external corporate and private investment contracted in both 2022 and 2023.
OutcomePartly rightDirectionPartly rightMagnitudeNot quantifiedTimingTiming unresolved
2021-03-05
Further evidence: Ordinary elevated-multi-year boom continuation is approximately supported; no annual monotonicity requirement was stated. Financing metrics are partial proxies for the full spending universe.
Direction: AI-specific investment activity remained greatly elevated over 2019 throughout 2021–24 despite 2022–23 contractions; this supports continuation rather than uninterrupted acceleration.
Magnitude: No quantified future level or growth rate in this bullet.
Timing: Several years establishes eligible horizon but lacks an exact endpoint; no precise timing credit.
Evidence confidence: moderate for investment-series facts; low-to-moderate for broad boom interpretation
Draft formula inputs
No draft score: out of scope. No vote, not zero.
Kai-Fu Lee28 Jan 2021Chart grade 75 / 100Lee expected virtual teachers and AI sales representatives within five years, approximately by 28 January 2026.
Actual multi-turn tutoring in August 2024–March 2025 and purely AI presales interaction in September–October 2023 support bounded emergence.
OutcomePartly rightDirectionRightMagnitudePartly supportedTimingWithin original window
2021-01-28
Further evidence: Sales spending rose 16.3% versus no live service, not versus human sellers. Qualified functional emergence; broader prominence unresolved, not first invention.
Direction: New implementations beyond announcements.
Magnitude: Local use and transaction effects, not profession-wide replacement; no numerical scale promised.
Timing: Both observations precede the five-year endpoint; no first-crossing date or precisely predicted implementation dates.
Scope: Domain-limited tools, not human touch, general intelligence or complete teacher/seller replacement. Tutoring was provider-studied, local, selected, often passive and observational; answer leakage and continued assistance limit lasting-learning inference. Sales used one unnamed platform and a short-run no-service comparator; transcripts/model details unavailable and authors company-linked. No universal replacement, consumer-welfare or whole-firm productivity inference. Preforecast tutoring literature is metadata-only; 2019 sales use is firsthand testimony, not audited vendor improvement. Salesforce operations chiefly assisted sellers, not independent proof of autonomous representatives. Terse firsthand report; broader prominence and first-arrival interpretations are unverified. No original recording independently heard.
Shared evidence: One paired continuation target, not two votes. Tutoring evidence is shared with Chollet, not independent replication. No renewed endorsement inferred.
Evidence confidence: Moderate for bounded functioning implementations and their dates; lower for original-report completeness and the stronger interpretation of emergence as new prominence. This is weak-information continuation, not demonstrated improvement over the 2013/2019 baseline.
Current edition contribution · Kai-Fu Lee
Graded credit: 75 / 100.
- Recency weight
- 83.44657534246575%
- Credit × weight endpoint products
- 62.58493150684931
- Last documented backing
- 2021-01-28 to 2021-01-28
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 75 / 100
- Recency weight
- 72.4109589%
- Weighted credit term
- 54.30821918
- Same-claim backing date
- 2021-01-28 to 2021-01-28
Existing reviewed grade for the original scope; time intrinsic to that scope is retained.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
75,
75
]
},
"backingDateBounds": [
"2021-01-28",
"2021-01-28"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
75,
75
],
"weightBounds": [
0.7241095890410958,
0.7241095890410958
],
"normalizedBackingDateBounds": [
"2021-01-28",
"2021-01-28"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
75,
75
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}François Chollet6 Jan 2021Chart grade 75 / 100Within years, applications turn scripts into photorealistic movies or descriptions into video games.
By 2026, A²RD produced scripted multi-scene films, including a five-minute photorealistic example; Game-Creation-Agents produced playable browser-game artifacts.
OutcomePartly rightDirectionRightMagnitudePartly supportedTimingNo fixed deadline
6 January 2021 public thread; current text, not immutable archive
Further evidence: Approximate application emergence, not arbitrary-input or flawless finished-product success.
Direction: Script/description-driven production implemented.
Magnitude: Selected outputs, not universal quality or coverage.
Timing: Multiyear emergence, no precise endpoint.
Scope: Original “or” retained; both examples visible, not a required conjunction. Research prototypes, not universally reliable finished products. No feature-length, all-genre, zero-editing or commercial-quality threshold. Human-written scripts are allowed; no imported Cotra four-minute, one-paragraph or budget conditions, or embedded 2020 fifteen-year frame. A²RD used human-reviewed scripts. Its May 7, 2026 paper names the five-minute film; video upload date unverified. Nine sampled frames show photographic-looking people/scenes, not full-motion review. Human ratings cover one-minute single scenes; transitions and physical continuity remain difficult, not certified for the five-minute output. Paper, project and video are the same work, not independent replication. The October 12, 2026 GCA builders selected 20 paired artifacts from 32 briefs with reviewed test coverage. Mean 0.852 measures core-mechanics satisfaction, not complete-game success. Ten raters assessed all 20 pairs; mean core-mechanics rating was 3.40/5. Requirements remain incomplete; Gold Miner stayed internally blocked despite observed functioning play. Familiar game families yield new artifacts, not necessarily new genres; repeated scores are not extra games.
Shared evidence: One forecast, no movie/game branch votes. A²RD evidence shared with BG-C032 is not independent.
Evidence confidence: Moderate: authenticated current original thread and dated primary studies; selected demos, incomplete independent replication and qualitative scope limit stronger grading.
Current edition contribution · François Chollet
Graded credit: 75 / 100.
- Recency weight
- 83.08493150684932%
- Credit × weight endpoint products
- 62.31369863013698
- Last documented backing
- 2021-01-06 to 2021-01-06
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 75 / 100
- Recency weight
- 71.80821918%
- Weighted credit term
- 53.85616438
- Same-claim backing date
- 2021-01-06 to 2021-01-06
Existing reviewed grade for the original scope; time intrinsic to that scope is retained.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
75,
75
]
},
"backingDateBounds": [
"2021-01-06",
"2021-01-06"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
75,
75
],
"weightBounds": [
0.718082191780822,
0.718082191780822
],
"normalizedBackingDateBounds": [
"2021-01-06",
"2021-01-06"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
75,
75
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Elon Musk21 Oct 2020Long-run freight-autonomy transition, including Semi.
Commercial driverless freight now operates on limited routes; reported scale is real but far short of establishing an industry-wide transition. Whole outcome unresolved.
OutcomeUnresolvedDirectionPartly rightMagnitudeUnresolvedTimingNo fixed deadline
2020-10-21
Further evidence: Universal transport transition and named Tesla Semi realization have not been established.
Direction: Postissue recurring commercial driverless freight is substantive progress, while restricted operations and preissue supervised pilots limit the credit.
Magnitude: No industry-share or full-transition evidence; future fleet plans are not delivered trucks.
Timing: Explicit long-run but undated; no deadline or timing score.
Scope: Industry direction only; universal transition, market share and Tesla Semi remain unresolved. Company-reported limited-route operations, human support and supervised preforecast pilots limit the credit.
Evidence confidence: Moderate for industry direction based on primary company operations reports; lower for unrestricted capability and industry scale.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Ajeya Cotra18 Sep 2020By 2025, well-optimized ML training would obtain roughly 4e17 useful FLOP per real dollar, about four times the 2020 estimate.
An October 2025 eight-H100 small-model run reports about 3.92e19 pretraining FLOPs and $92.40 through supervised fine-tuning: roughly 4.1–4.2e17 FLOPs per nominal dollar, or 5.1–5.3e17 per 2020 CPI dollar. Whole outcome unresolved.
OutcomeUnresolvedDirectionPartly rightMagnitudePartly supportedTimingNot separately applicable
2020-09-18
Further evidence: This supports the local numerical point, not representative lab purchasing power. At Lambda’s advertised $4.99 per B200-hour, its November 2025 benchmark implies 9.30e17 (6ND) or 1.117e18 (archived-code convention) useful FLOP per 2020 CPI dollar: 2.32–2.79 times the original point. These are conditional sensitivities, not observed whole-job cost effectiveness. Representative purchasing power remains unresolved.
Direction: Qualified public-rental improvement, not corrected-baseline growth.
Magnitude: Conditional underestimation; no full-point accuracy grade or lower-bound success.
Timing: Endpoint-level forecast; no separate timing grade.
Scope: Execution and estimated model FLOPs are author-reported, not measured arithmetic instructions. The full reported supervised-fine-tuning cost is charged against pretraining work; optional RL is excluded from work and cost. The Nanochat discussion’s edit history was not independently inspected. A separate same-day run corroborates small-node access; inconsistent evaluation metadata is not scored. Annual CPI is an analyst-selected deflator; October CPI is unavailable. Original issuance and horizon retained; the nearly-tenfold 2022 baseline correction remains material. Mutable export; V100 utilization 25% appendix, roughly one-third main text. No invoice, minimum cluster, total-project costs or observed-fourfold-growth requirement. No TAI, algorithmic-progress or training-spending outcome is credited. Provider-measured intervals and advertised starting tariff are not full paid-job averages. Report dated November 2025; current PDF exported March 2026. Archived BF16 implementation supports interpretation despite appendix inconsistency and uncertain exact report-to-run identity. Full paid time, other final-run charges and transfer to discounted large labs remain qualified; no exact tolerance inferred.
Evidence confidence: Moderate for available eight-B200 tariff, provider benchmark and archived-code interpretation; lower for exact report-to-run identity, full billed-job average and representative discounted large-lab price. No new categorical tolerance or probability.
Baseline revision: 2022-08-02 (Material baseline correction; same forecast lineage, not a new count): Author raised the 2020 baseline nearly tenfold because of newer hardware, large-lab discounts and higher utilization. Original 2020 point and 2025 horizon remain unchanged for original grading; later curve is a revision, not retrospective replacement. Not an independent forecast
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Ajeya Cotra18 Sep 2020Single-run AI training expenditure will scale up sharply through 2025, with dated minimum-cost milestones and a best guess near $1B for the largest 2025 run.
GPT-4.5’s final run is estimated at $386M with a broad $170–890M 90% interval and a 2024 completion window. Whole outcome unresolved.
OutcomeUnresolvedDirectionPartly rightMagnitudeUnresolvedTimingTiming unresolved
2020-09-18
Original schedule: By 2020-12-31: minimum $20 million; By 2021-12-31: minimum $80 million; By 2025-12-31: minimum $300 million; largest 2025 run best guess $1 billion. One retained forecast, not one additional count per date.
Further evidence: Other expensive 2025 model estimates corroborate spending scale, with accounting and reuse caveats. Early dated lower bounds are not verified. Full schedule and annual maximum remain unverified.
Direction: Research estimates support expenditure growth, not merely infrastructure budgets.
Magnitude: No verified schedule or $1B hit.
Timing: Completed thresholds lack verified dates.
Scope: Explicit completed-run subforecast only, not the entire conditional maximum-willingness curve. One trajectory retains 2020, 2021 and 2025 checkpoints; no per-year count.
Evidence confidence: Moderate direction only; low for complete threshold/maximum resolution.
Later statement: 2022-08-02 (Dated revision): Somewhat less likely to see a billion-dollar training run by 2025 after tech downturn; no numeric probability. No additional forecast or independent observation; the original contract is not reset.
Later statement: 2023-08-29 (Dated revision): Probably above $1B before/in 2025; definition and date sensitivity remain in prior criteria. No additional forecast or independent observation; the original contract is not reset.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Ben GoertzelAug 2020 · rangeExpects discrete-graph ASIC availability within about five years.
Fabricated graph-oriented silicon supports direction; development access and OpenCog gains remain unverified. Whole outcome unresolved.
OutcomeUnresolvedDirectionRightMagnitudeUnresolvedTimingTiming unresolved
2020-08-21 to 2020-08-24
Further evidence: Full availability in the original development context is unclosed. Do not add a commercial-sales condition, but private research-team hardware alone is not sufficient.
Direction: Real sparse/discrete-graph-oriented hardware and measured workloads support the forecast direction. Generic GPU throughput is not substituted.
Magnitude: No measured OpenCog application, baseline or 10–100× improvement established. Published graph benchmarks and normalized speedups cannot stand for this conditional quantity.
Timing: The approximate 2025 endpoint has elapsed. Prototype evidence preceded it, but full availability timing remains unjudgeable; no success or miss inferred from missing access evidence.
Scope: Conditional 10–100× OpenCog estimate is uncredited. Private-team hardware is not established developer availability; no commercial-sales condition is added.
Evidence confidence: Moderate for actual prototype direction; full development access, OpenCog application and conditional speedup remain unverified.
Draft formula inputs
No draft score: out of scope. No vote, not zero.
Ben Goertzel14 Jul 2020Over the next few years, neural-network exhaustion triggers a research shift and AGI revolution, rather than another narrow paradigm or winter.
The 2021/2022 foundation-model synthesis and 2022 Gato demonstrate generality-directed research continuing through neural methods, contrary to the proposed exhaustion-triggered route.
OutcomeMixedDirectionRightMagnitudePartly supportedTimingTiming unresolved
July 2020; publisher paraphrase, exact interview day unknown.
Further evidence: Mixed: research direction supported, anticipated methodological route contradicted.
Direction: Broader generality-directed neural research.
Magnitude: Partial trajectory support, not a completed AGI revolution.
Timing: Soft few-years horizon; no precise crossing date or completed revolution.
Scope: The synthesis is not a field census. Gato spans trained language, vision and control tasks using specialist-derived demonstrations; it is a research proof of concept with limited transfer, not deployed AGI. Earlier foundation models predate the forecast. Generality direction and causal route are one dependent prediction, not separate votes.
Evidence confidence: Moderate for positive generality-directed neural progress and contrary observed route; lower for full-field balance, causal exclusivity and eventual revolution.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Stuart Russell22 Jun 2020Within a few years, AI researchers would treat uncertainty about objectives as obvious and disavow fixed objectives.
A December 2025 general-assistant behavior policy recognized uncertain user goals; AssistanceZero scaled research beyond toy settings. Whole outcome unresolved.
OutcomeUnresolvedDirectionPartly rightMagnitudePartly supportedTimingTiming unresolved
22 June 2020 publication; recording day not separately established
Further evidence: These support local extension, not field-wide acceptance. Broad acceptance and disavowal of fixed objectives remain unresolved.
Direction: Institutional policy and technical progress, not implementation certification.
Magnitude: Local scope and research scale, not prevalence among researchers.
Timing: 2025 evidence is over five years later; “few years” has no exact boundary and full timing remains unresolved.
Scope: Policy is normative, not guaranteed behavior or assistance-game implementation. Fixed training rewards need not deny uncertain user goals. Russell coauthored the technical source; it describes RLHF as dominant and complex assistance games as little studied, not a quantitative census. No literal unanimity threshold or credit for pre-existing preference elicitation.
Shared evidence: Related safety and values forecasts are not independent evidence.
Evidence confidence: Moderate for limited institutional acceptance and technical scale; low for field-wide acceptance and timing.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Stuart Russell15 Jun 2020Simplified language understanding will enable useful assistants and call-center automation during the next decade, via hybrid methods.
Language models enabled deployed business-context support assistants. Whole outcome unresolved.
OutcomeUnresolvedDirectionPartly rightMagnitudePartly supportedTimingFuture window open
2020-06-15
Further evidence: The linked simplified-language, hybrid-method, substantial-automation and useful applicable-context bundle remains unverified. The joint bundle remains unresolved.
Direction: Useful language-based assistants and customer-service automation appeared, supporting the predicted application direction.
Magnitude: Substantial bounded applications; not the linked application, context and hybrid-method bundle.
Timing: The full decade window is still open; narrower application progress arrived in-window without proving the whole claim.
Scope: Personal or corporate context qualifies. Success does not require complete semantics, occupational extinction, industry-wide layoffs or unlimited personal-life knowledge. Separate support applications and formal/hybrid examples do not establish the joint claim; retrieval, model probabilities or sampling alone are not probabilistic programming.
Evidence confidence: moderate for application direction; developer/customer reports and scope limits retained
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Stuart Russell24 Feb 2020Within a five-to-ten-year outlook, self-driving cars would move from prototypes to real products and have a huge urban and transport impact.
Waymo widened restricted driverless access in October 2020; California authorized all-day commercial service in August 2023. Whole outcome unresolved.
OutcomeUnresolvedDirectionPartly rightMagnitudePartly supportedTimingTiming unresolved
2020-02-24
Further evidence: Independently analyzed filings report 13.79 million California trips through December 2025. Limited productization and scale, not huge systemic impact or proven retail ownership.
Direction: Expanded access.
Magnitude: Substantial trips and miles, not citywide penetration, net congestion effects or whole-system transformation.
Timing: Limited service preceded the 2025–2030 outlook; full compound timing remains unresolved.
Scope: Paid driverless rides predated issuance; not invention. State totals are not San Francisco counts or unique users. Independent analysis uses operator filings, not independently audited trips; redaction prevents geographic matching. SFCTA documents missing city/county mileage, not absence of all local evidence. The regulator lacked sufficient comparative safety data in 2023. Restricted ride-hailing is not universal private ownership.
Evidence confidence: Moderate for partial magnitude; high confidence in what the filings report, not an independent trip audit or full-system effect.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Jürgen Schmidhuber20 Feb 2020During the 2020s, attempts at AI-data markets include owners pricing some sensitive medical data.
Ocean implemented market pricing in 2020.
OutcomePartly rightDirectionRightMagnitudePartly supportedTimingWithin original window
2020-02-20
Further evidence: A December 2021-updated operator interview describes individuals controlling genomic-data representations and setting prices and terms; first publication is unknown. EncrypGen already operated before the forecast. These are interested accounts, not independent transaction audits. Qualified attempts and optional owner pricing; not an efficient-value or mass-commerce promise.
Direction: Implementation and continued personal-data price controls support direction, not first invention.
Magnitude: Narrow evidence; no reliable volume, profitability, legal gene ownership or per-record AI-training use.
Timing: Observed continuation is in-window; first crossing unknown, decade still open.
Scope: KRAKEN’s September 2022 health/education pilot tested provider-set prices with 35 volunteers using fake registration data and an open dataset, not personal medical records. Participation gift cards are not demonstrated data-sale proceeds; usability was marginal and future deployment remained discussed. The July 2022 implementation supports editable prices and permitted AI use, not actual patient purchases or efficient valuation. EU reporting links the prototype to privacy-preserving AI/ML; the project began in December 2019, reducing novelty. Qualified attempts and some owner-set sensitive-data pricing, not assured efficient valuation, widespread trade, profitability or legal ownership of genes. EncrypGen predates the forecast; later descriptions are interested operator accounts, not independent transaction audits. KRAKEN used fake/open data; gift cards were study compensation. No per-record AI-training use, first-crossing date or sustained full-decade success is established.
Evidence confidence: Moderate for qualified market attempts and some owner-set real-data pricing; low for scale, independently audited commerce, efficient valuation and legal ownership.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Jürgen Schmidhuber20 Feb 2020During the 2020s, active AI expands into physical industry; its economic reach exceeds the prior virtual wave.
Post-issue learned tokamak control and automotive robot deployment support the physical-expansion direction. Whole outcome unresolved.
OutcomeUnresolvedDirectionRightMagnitudeUnresolvedTimingFuture window open
2020-02-20
Further evidence: The much-larger economic-wave comparison remains unmeasured and the decade is unfinished. The full conjunction includes an unresolved economic comparison.
Direction: Learning-based control moved beyond virtual tasks to real machines, and physical robot production use expanded.
Magnitude: No matched economy-wide comparison establishes the claimed larger wave.
Timing: The 2020–2029 window is still open; examples occur within it but do not close the full claim.
Evidence confidence: moderate for direction; full content unresolved
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Jürgen Schmidhuber20 Feb 2020In the 2020s outlook, robots learn complex tasks rapidly from visual demonstration and language without direct physical guidance.
HOST reports 62% success across 50 novel physical tasks; reported 29-second new-task acquisition excludes prior training.
OutcomePartly rightDirectionRightMagnitudePartly supportedTimingTiming unresolved
2020-02-20
Further evidence: Matched prediction ablations support a predictive contribution in the same system. R+X separately supports observational/language-conditioned transfer. Qualified see-and-do functionality supported; stricter curiosity-specific/industrial reading unresolved.
Direction: Observed new-task coordinated manipulation without task-specific physical guidance.
Magnitude: Smartphone assembly, broad revolution and general reliability unproved.
Timing: Vague not-too-distant future in a 2020s outlook; 2026 observations, not precise endpoint or first-arrival credit.
Scope: Extensive prior paired training; one developer-evaluated platform with incomplete success. Video/text-language inference is reported, not audited speech/per-trial inputs or isolated language effect. Prediction is not curiosity-driven self-experimentation. Earlier missing-prediction reasoning is corrected by deeper reading, not a new independent study. Demonstration-learning predates both versions; no invention credit.
Shared evidence: 2018-01-01 coming-years interview is dependent history, not a second vote or a reset of 2020 requirements/timing.
Evidence confidence: Moderate for bounded central functionality; lower for language delivery modality, broader generalization, specific curiosity causation and original timing.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Sam AltmanFeb 2020 · rangeChart grade 75 / 100Expects useful dialogue and large-scale text-processing systems to proliferate over the next few years.
By 2023, multiple dialogue services had actual users, writing assistance had measured utility, and long-text systems worked unevenly.
OutcomePartly rightDirectionRightMagnitudePartly supportedTimingTiming unresolved
11–12 February 2020 event interval; 24 February publication
Further evidence: Customer report (26 June 2024): Morgan Stanley's corpus Assistant adopted by 98% of advisor teams. Provider report (12 March 2024): CoCounsel processed 640 billion words and over 1.1 million lawyer tasks during the preceding year. Independent plural-service uptake, controlled text-work utility and period-matched long-document tests support the central trajectory. Unrestricted reliability remains unverified.
Direction: Postissue multiple conversational systems attracted users and demonstrated broader text operations.
Magnitude: Dialogue uptake and bounded enterprise processing supported; population-wide diffusion, unrestricted interaction and subjective primacy remain unverified.
Timing: 2023 evidence fits rough chronology; no precise endpoint, full strong-scope crossing, exact first attainment or missed deadline is established.
Scope: Host transcript; audio unchecked. Strong flexible-interaction assurance and subjective primacy remain unverified. UK self-reported use includes rare use and overlapping, technically related services; no global extrapolation. Long-context tests have task/length failures and automatic-metric limitations. Short writing tasks do not establish unrestricted document understanding. Earlier language systems existed; no invention credit. Population-wide diffusion unmeasured. Customer/provider figures are unaudited; team adoption is not daily usage. Per-task length and deduplication are unspecified, not prerequisites. Task-success definitions are also unspecified. Assistant adoption is not Debrief uptake; mixed-product totals are not CoCounsel totals. Supplement dates are reporting dates, not first attainment.
Evidence confidence: Moderate for qualified central trajectory; limited for stronger universal or subjective scope.
Current edition contribution · Sam Altman
Graded credit: 75 / 100.
- Recency weight
- 77.67671232876712–77.69315068493151%
- Credit × weight endpoint products
- 58.25753424657535–58.26986301369863
- Last documented backing
- 2020-02-11 to 2020-02-12
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 75 / 100
- Recency weight
- 62.79452055–62.82191781%
- Weighted credit term
- 47.09589041–47.11643836
- Same-claim backing date
- 2020-02-11 to 2020-02-12
Existing reviewed grade for the original scope; time intrinsic to that scope is retained.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
75,
75
]
},
"backingDateBounds": [
"2020-02-11",
"2020-02-12"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
75,
75
],
"weightBounds": [
0.627945205479452,
0.6282191780821917
],
"normalizedBackingDateBounds": [
"2020-02-11",
"2020-02-12"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
75,
75
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Sam AltmanFeb 2020 · rangeChart grade 25 / 100Largest AI training resources continue roughly eightfold annual growth for about five years.
Using the retained public model dataset, fixed pre-issue Meena to late-February 2025 GPT-4.5 gives about 5× annual endpoint growth.
OutcomeMostly wrongDirectionRightMagnitudeOverestimatedTimingTiming unresolved
11–12 February 2020 event interval; 24 February publication
Further evidence: Record-event and top-N sensitivities remain below 8×, supporting a qualified rate overestimate, not scaling failure. Observed public-frontier rate overestimated under the training-FLOP interpretation; feasible capacity remains unresolved.
Direction: Rapid exponential growth continued.
Magnitude: Same original baseline and whole-February endpoint; no GPT-3 reset or undisclosed-model census.
Timing: A five-year rate, not a first-attainment event; no delayed eventual threshold crossing.
Scope: Host transcript; audio unchecked. Model size lacked a formal unit: training-resource context motivates FLOP, not parameters, hardware purchases, spending or all capabilities. Approximate February 2020–February 2025 window retained, not reset to publication. The dataset is retrospective 2026 vintage, not a 2025 snapshot; last recorded modification was 26 October 2026. Release dates are not training completion. Estimate methods/notes vary; some are inconsistent or speculative. Missing runs and known estimate alternatives are not a complete uncertainty bound. Our matched-window calculations give roughly 4.66× record-event growth and 4.58/4.41/4.76× top-1/5/10 fits; the generous known endpoint alternative is 6.38×, not a full confidence interval. These are our calculations, not new published Epoch estimates. Epoch’s May 2024 top-ten fit is about 4.2× and ends before the endpoint. A discontinuous language-model fit gives 6.68× (CI 3.47–9.26), including 8×; the 9.5× all-notable-language-model result since 2017 uses a different population. January 2025 decomposition reports 4.17× (10th–90th quantiles 3.74–4.62) from 63 post-2018 top-ten models, not an exact matched-window regression. Fine-tunes excluded; top-5/15 sensitivity similar; fields partly missing/estimated. Its 8 January report date and 21 November 2025 CSV update are distinct. The September 2025 AI 2030 retrospective was Google DeepMind-commissioned and is not an isolated 2020–2025 regression; its 2030 forecasts are not outcome evidence.
Shared evidence: Same Epoch research/data lineage, not independent replications. The held Khosla 2019 lead adds no original evidence or target credit.
Evidence confidence: Moderate for a qualified observed-frontier magnitude miss; not a full global feasible-capacity verdict.
Current edition contribution · Sam Altman
Graded credit: 25 / 100.
- Recency weight
- 77.67671232876712–77.69315068493151%
- Credit × weight endpoint products
- 19.41917808219178–19.423287671232877
- Last documented backing
- 2020-02-11 to 2020-02-12
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 25 / 100
- Recency weight
- 62.79452055–62.82191781%
- Weighted credit term
- 15.69863014–15.70547945
- Same-claim backing date
- 2020-02-11 to 2020-02-12
Existing reviewed grade for the original scope; time intrinsic to that scope is retained.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
25,
25
]
},
"backingDateBounds": [
"2020-02-11",
"2020-02-12"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
25,
25
],
"weightBounds": [
0.627945205479452,
0.6282191780821917
],
"normalizedBackingDateBounds": [
"2020-02-11",
"2020-02-12"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
25,
25
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Daniel Kokotajlo5 Jan 2020Chart grade 91 / 100Shared criterion E
Canonical scored claim: Student-submitted neural-net essays earn a B average across most first-year college courses by September22,2025.
The author personally accepted this event in his January 2026 retrospective, not merely an automated table.
Probability20%2020-01-05EventOccurredconditionalBrier loss0.64lower is better
Issuance: see dated Proper score below
Score condition: Use the author-accepted retrospective resolution; the stricter reading below remains unresolved and unscored.
Resolution basis: The outcome and scores below are conditional on this interpretation: Author-resolution convention, not an independently established population outcome.
Resolution confidence: Moderate for personal acceptance; limited for independent literal population resolution.
Resolution limitation: The alternative below remains unresolved and unscored.
Unscored interpretation: Strict independently verified most-first-year-courses population event, with ordinary citation requirements. Unresolved; no outcome or proper score assigned. The observed studies do not establish representative prevalence. Uncertainty is not a false outcome. This is the same target, not another forecast.
Proper score: 2020-01-05: p(event)=20%; outcome=1 (under the stated score condition); Brier=0.64; log loss=1.609438 nats.
Dependent revision: 2021-01-04: p(event)=50%; outcome=1 (under the stated score condition); Brier=0.25; log loss=0.6931472 nats.
Dependent revision: 2022-01-01: p(event)=70%; outcome=1 (under the stated score condition); Brier=0.09; log loss=0.3566749 nats.
Outcome dates: Original event deadline 2025-09-22; author retrospective 2026-01-01, not a shifted endpoint.
Provenance confidence: Moderate author-resolution evidence; original cell provenance moderate; literal population outcome unverified.
Interpretation: Lower Brier and log loss are better. Revisions concern the same event, not additional forecasts. One event does not establish calibration or overall reliability.
Further evidence: A 2024 first-year composition study had twenty instructors grade two GPT-3.5 essays averaging 72.5% (B), with fabricated references and weak evidence. A 2023 seven-course GPT-4 test averaged 3.57 GPA but mixed course levels and waived citations; its corrected result removes an improperly attributed C. These sampled demonstrations do not establish representative coverage of the shared population criterion. Explicit probability event; author-resolution convention and proper scores are reported separately, not a deterministic accuracy color.
Scope: The author-resolution convention applies to the event deadline printed in Outcome dates, not a new January 2026 endpoint. Student submission remains required. Ordinary citations are a researcher ordinary-course interpretation, not an explicit original-cell qualifier; the literal population reading is unresolved and unscored, not false. No formal wager settlement or citation waiver was recovered. Acceptance of these two LLM-related outcomes is not blanket endorsement of automated grading. Mutable dated tabs and author attribution corroborate probabilities but do not establish immutable cell histories. Dependent updates remain one target, not extra forecasts or calibration. Shared retrospective evidence with the IMO row is not independent validation.
Note: Artemis criteria
Evidence confidence: Moderate author-resolution evidence; original cell provenance moderate; literal population outcome unverified.
Current edition contribution · Daniel Kokotajlo
Graded credit: 90.99999999999999 / 100.
- Recency weight
- 89.0027397260274%
- Credit × weight endpoint products
- 80.99249315068492
- Last documented backing
- 2022-01-01 to 2022-01-01
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
Selected probability event only. This is not a whole-outcome grade. Archive timing: Not separately applicable.
- Credit
- 91 / 100
- Recency weight
- 81.67123288%
- Weighted credit term
- 74.32082192
- Same-claim backing date
- 2022-01-01 to 2022-01-01
- Authored probability
- 70%
- Event outcomes retained
- 1
Latest matched pre-resolution forecast: p=70%. The updated odds and date replace the previous version; one vote for this event.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
The author's latest dated tab for this same September 2025 criterion specifies 70% (January 2020 tab: 20%). Checked against all three dated tabs. The public workbook corroborates the values and tab labels, not immutable edit history.
Exact calculation inputs
{
"scoring": {
"kind": "binary_probability",
"probabilityBounds": [
0.7,
0.7
],
"outcomes": [
1
]
},
"backingDateBounds": [
"2022-01-01",
"2022-01-01"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
90.99999999999999,
90.99999999999999
],
"weightBounds": [
0.8167123287671233,
0.8167123287671233
],
"normalizedBackingDateBounds": [
"2022-01-01",
"2022-01-01"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
90.99999999999999,
90.99999999999999
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Daniel Kokotajlo5 Jan 2020Chart grade 95.16 / 100Shared criterion C
Canonical scored claim: Recognizable whole-human-brain upload by September22,2025, allowing personality differences, mental problems and memory loss.
Event resolves false with high confidence on the documented scientific record.
Probability5%2020-01-05EventNot occurredBrier loss0.0025lower is better
Issuance: see dated Proper score below
Resolution confidence: High, inferred from the documented field state just after the deadline; not an exhaustive global census.
Proper score: 2020-01-05: p(event)=5%; outcome=0 (did not occur); Brier=0.0025; log loss=0.05129329 nats.
Dependent revision: 2021-01-04: p(event)=5%; outcome=0 (did not occur); Brier=0.0025; log loss=0.05129329 nats. Source tab 1631745164.
Dependent revision: 2022-01-01: p(event)=22%; outcome=0 (did not occur); Brier=0.0484; log loss=0.2484614 nats. Source tab 965036972.
Outcome dates: 2025-09-22
Provenance confidence: High outcome inference; moderate historical cell provenance.
Revision provenance: Dependent revisions concern the same event; they are not independent forecasts.
Interpretation: Lower Brier and log loss are better. Revisions concern the same event, not additional forecasts. One event does not establish calibration or overall reliability.
Further evidence: The inference uses a dated field-status review and distinguishes actual individual emulation from existing human-scale simulations; it is not a claim to have inspected every private laboratory. Numerical probability forecast: event resolution and proper scores are reported separately, without a categorical right/wrong axis.
Scope: Original exceptions are in the linked criteria. Generic human-scale simulation, chatbot personas and brain–computer interfaces do not establish this individual-emulation target; perfect molecular fidelity and proof of consciousness are not additional requirements.
Note: Artemis criteria
Evidence confidence: High outcome inference; moderate historical cell provenance.
Current edition contribution · Daniel Kokotajlo
Graded credit: 95.16 / 100.
- Recency weight
- 89.0027397260274%
- Credit × weight endpoint products
- 84.69500712328767
- Last documented backing
- 2022-01-01 to 2022-01-01
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
Selected probability event only. This is not a whole-outcome grade. Archive timing: Not separately applicable.
- Credit
- 95.16 / 100
- Recency weight
- 81.67123288%
- Weighted credit term
- 77.71834521
- Same-claim backing date
- 2022-01-01 to 2022-01-01
- Authored probability
- 22%
- Event outcomes retained
- 0
Latest matched pre-resolution forecast: p=22%. The updated odds and date replace the previous version; one vote for this event.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
The author's latest dated tab for this same September 2025 criterion specifies 22% (January 2020 tab: 5%). Checked against all three dated tabs. The public workbook corroborates the values and tab labels, not immutable edit history.
Exact calculation inputs
{
"scoring": {
"kind": "binary_probability",
"probabilityBounds": [
0.22,
0.22
],
"outcomes": [
0
]
},
"backingDateBounds": [
"2022-01-01",
"2022-01-01"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
95.16,
95.16
],
"weightBounds": [
0.8167123287671233,
0.8167123287671233
],
"normalizedBackingDateBounds": [
"2022-01-01",
"2022-01-01"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
95.16,
95.16
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Daniel Kokotajlo5 Jan 2020Chart grade 43.75–93.75 / 100Shared criterion D
Canonical scored claim: AI can win the IMO by September22,2025.
Qualified event resolution: true under gold-equivalent capability.
Probability15%2020-01-05EventOccurredconditionalBrier loss0.7225lower is better
Issuance: see dated Proper score below
Resolution basis: The primary scores and dependent revisions use the interpretation stated in Scope.
Resolution confidence: Moderate: original win wording and mutable workbook provenance are material; proof score is externally certified, system operation is not independently audited.
Resolution limitation: Mutable original tab; IMO verified proofs, not the model’s operating process. Literal-victory reading reverses the score.
Proper score: 2020-01-05: p(event)=15%; outcome=1 (occurred); Brier=0.7225; log loss=1.89712 nats.
Dependent revision: 2021-01-04: p(event)=15%; outcome=1 (occurred); Brier=0.7225; log loss=1.89712 nats. Source tab 1631745164.
Dependent revision: 2022-01-01: p(event)=25%; outcome=1 (occurred); Brier=0.5625; log loss=1.386294 nats. Source tab 965036972.
Interpretation sensitivity: Under Literal first place or official participant victory: 2020-01-05: p(event)=15%; outcome=0 (did not occur); Brier=0.0225; log loss=0.1625189 nats. Do not silently replace the original ambiguity with gold. This strict interpretation reverses the result; retain visibly. This uses the original probability; dependent revisions above use the primary interpretation. No additional forecast or independent observation.
Outcome dates: 2025-07-21
Provenance confidence: Moderate overall; strong dated score evidence, moderate author interpretation and original-version provenance.
Interpretation: Lower Brier and log loss are better. Revisions concern the same event, not additional forecasts. One event does not establish calibration or overall reliability.
Further evidence: Gemini Deep Think produced solutions graded at 35/42, the 2025 gold threshold, before the deadline. This was neither first place nor a formal student medal. Explicit probability forecast: report conditional event resolution and proper scores, not a deterministic right/wrong axis.
Scope: Main resolution uses gold-medal-equivalent performance, supported by the author’s retrospective acceptance. Literal first place or official AI contestant status is not established. Researcher absence observation, not an original-cell stipulation: no hardware-cost ceiling was found.
Note: Artemis criteria
Evidence confidence: Moderate overall; strong dated score evidence, moderate author interpretation and original-version provenance.
Current edition contribution · Daniel Kokotajlo
Graded credit: 43.75–93.75 / 100.
- Recency weight
- 89.0027397260274%
- Credit × weight endpoint products
- 38.93869863013699–83.44006849315069
- Last documented backing
- 2022-01-01 to 2022-01-01
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
Selected probability event only. This is not a whole-outcome grade. Archive timing: Not separately applicable.
- Credit
- 43.75–93.75 / 100
- Recency weight
- 81.67123288%
- Weighted credit term
- 35.73116438–76.56678082
- Same-claim backing date
- 2022-01-01 to 2022-01-01
- Authored probability
- 25%
- Event outcomes retained
- 0, 1
Latest matched pre-resolution forecast: p=25%. The updated odds and date replace the previous version; one vote for this event.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
The author's latest dated tab for this same September 2025 criterion specifies 25% (January 2020 tab: 15%). Checked against all three dated tabs. The public workbook corroborates the values and tab labels, not immutable edit history.
Exact calculation inputs
{
"scoring": {
"kind": "binary_probability",
"probabilityBounds": [
0.25,
0.25
],
"outcomes": [
0,
1
]
},
"backingDateBounds": [
"2022-01-01",
"2022-01-01"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
43.75,
93.75
],
"weightBounds": [
0.8167123287671233,
0.8167123287671233
],
"normalizedBackingDateBounds": [
"2022-01-01",
"2022-01-01"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
43.75,
93.75
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Daniel Kokotajlo5 Jan 2020Shared criterion A
Under the annual-unit-sales interpretation, the event did not occur.
Probability5%2020-01-05EventNot occurredconditionalBrier loss0.0025lower is better
Issuance: see dated Proper score below
Resolution basis: The outcome and scores below are conditional on this interpretation: Annual unit sales/shipments interpretation; the original wording says sales without explicitly specifying units or revenue. Revenue interpretation not independently adjudicated.
Proper score: 2020-01-05: p(event)=5%; outcome=0 (did not occur); Brier=0.0025; log loss=0.05129329 nats.
Dependent revision: 2021-01-04: p(event)=30%; outcome=0 (did not occur); Brier=0.09; log loss=0.3566749 nats. Source tab 1631745164.
Dependent revision: 2022-01-01: p(event)=10%; outcome=0 (did not occur); Brier=0.01; log loss=0.1053605 nats. Source tab 965036972.
Outcome dates: 2025-09-22 event deadline; full-year 2025 bounds documented 2026-09-24
Provenance confidence: High for threshold nonoccurrence; moderate for attribution/date because original cell revision is not immutable-verified.
Revision provenance: Later tabs are dependent updates, not new independent forecasts or additional quota counts. Dated tab provenance is qualified.
Interpretation: Lower Brier and log loss are better. Revisions concern the same event, not additional forecasts. One event does not establish calibration or overall reliability.
Further evidence: IFR reports roughly 0.6 million new industrial robots in 2025 versus 0.384 million in 2020, about 1.6 times the baseline, below the tenfold threshold. This favors the original low-probability forecast; it is not a deterministic prediction of impossibility. Event resolved false; assess stated probability with proper scores, not categorical right/wrong.
Direction: No modal-outcome conversion into a directional grade.
Magnitude: Observed annual unit flow roughly 1.6 times baseline, below the shared original threshold; not a separate probabilistic magnitude grade.
Timing: No categorical timing grade for this probability forecast; the original event deadline is retained.
Scope: Scores use annual unit sales, not revenue. Original cells remain mutable; exact original-version provenance is moderate. One event cannot establish calibration.
Note: Artemis criteria
Evidence confidence: High for threshold nonoccurrence; moderate for attribution/date because original cell revision is not immutable-verified.
Draft formula inputs
No draft score: out of scope. No vote, not zero.
Daniel Kokotajlo5 Jan 2020Chart grade 99.96 / 100Shared criterion B
Canonical scored claim: Most US on-road cars are physically and legally capable of driving unoccupied by September22,2025.
Event resolves false with high confidence: advanced driverless operation remained confined to limited service fleets, not the shared original population target.
Probability5%2020-01-05EventNot occurredBrier loss0.0025lower is better
Issuance: see dated Proper score below
Resolution confidence: high; inferred from dated nationwide technology-deployment descriptions rather than a deadline-day count
Proper score: 2020-01-05: p(event)=5%; outcome=0 (did not occur); Brier=0.0025; log loss=0.05129329 nats.
Dependent revision: 2021-01-04: p(event)=15%; outcome=0 (did not occur); Brier=0.0225; log loss=0.1625189 nats. Source tab 1631745164.
Dependent revision: 2022-01-01: p(event)=2%; outcome=0 (did not occur); Brier=0.0004; log loss=0.02020271 nats. Source tab 965036972.
Outcome dates: 2025-09-22
Provenance confidence: High outcome; moderate original-cell issuance provenance.
Revision provenance: Dependent revisions of one unchanged criterion; one new event row only.
Interpretation: Lower Brier and log loss are better. Revisions concern the same event, not additional forecasts. One event does not establish calibration or overall reliability.
Further evidence: This is a threshold inference from national government descriptions before and after the deadline, not an exact September 22 fleet census. Numeric probability forecast: event outcome and proper scores are separate; no categorical right/wrong axis is assigned.
Scope: Researcher interpretation, not an original-cell qualifier: Not new sales, miles, robotaxi fleets or an individual model. Driver assistance requiring a human does not qualify. Limited-area genuinely unoccupied vehicles may qualify; Level 5 universality is not imposed.
Note: Artemis criteria
Evidence confidence: High outcome; moderate original-cell issuance provenance.
Current edition contribution · Daniel Kokotajlo
Graded credit: 99.96000000000001 / 100.
- Recency weight
- 89.0027397260274%
- Credit × weight endpoint products
- 88.967138630137
- Last documented backing
- 2022-01-01 to 2022-01-01
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
Selected probability event only. This is not a whole-outcome grade. Archive timing: Not separately applicable.
- Credit
- 99.96 / 100
- Recency weight
- 81.67123288%
- Weighted credit term
- 81.63856438
- Same-claim backing date
- 2022-01-01 to 2022-01-01
- Authored probability
- 2%
- Event outcomes retained
- 0
Latest matched pre-resolution forecast: p=2%. The updated odds and date replace the previous version; one vote for this event.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
The author's latest dated tab for this same September 2025 criterion specifies 2% (January 2020 tab: 5%). Checked against all three dated tabs. The public workbook corroborates the values and tab labels, not immutable edit history.
Exact calculation inputs
{
"scoring": {
"kind": "binary_probability",
"probabilityBounds": [
0.02,
0.02
],
"outcomes": [
0
]
},
"backingDateBounds": [
"2022-01-01",
"2022-01-01"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
99.96000000000001,
99.96000000000001
],
"weightBounds": [
0.8167123287671233,
0.8167123287671233
],
"normalizedBackingDateBounds": [
"2022-01-01",
"2022-01-01"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
99.96000000000001,
99.96000000000001
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Daniel Kokotajlo5 Jan 2020Chart grade 75 / 100Shared criterion G
Canonical scored claim: Unoccupied taxis are available to Artemis or a parent in twenty cities by September22,2025.
The conditional reading in Scope is supported by dated public operations.
Probability50%2020-01-05EventOccurredconditionalBrier loss0.25lower is better
Issuance: see dated Proper score below
Score condition: The score condition is stated in Scope.
Resolution basis: The outcome and scores below are conditional on this interpretation: Researcher municipal interpretation and primary service evidence, not author-accepted settlement or automated retrospective.
Resolution confidence: Moderate conditional municipal resolution; primary operator and local-government evidence, geographic interpretation and endpoint-continuity inference. Mutable original-cell provenance remains moderate.
Resolution limitation: Municipal interpretation conditional; metro-market reading unresolved and unscored.
Unscored interpretation: The alternative in Scope remains unresolved and unscored. No outcome or proper score assigned. This is the same target, not another forecast.
Proper score: 2020-01-05: p(event)=50%; outcome=1 (under the stated score condition); Brier=0.25; log loss=0.6931472 nats.
Dependent revision: 2021-01-04: p(event)=50%; outcome=1 (under the stated score condition); Brier=0.25; log loss=0.6931472 nats.
Dependent revision: 2022-01-01: p(event)=50%; outcome=1 (under the stated score condition); Brier=0.25; log loss=0.6931472 nats.
Outcome dates: Service evidence dated May 2023 through June 2025; original deadline: see linked Artemis criteria.
Provenance confidence: Moderate conditional municipal interpretation and endpoint continuation; original-cell provenance moderate. Metro-market reading unresolved; author doubt retained.
Interpretation: Lower Brier and log loss are better. Revisions concern the same event, not additional forecasts. One event does not establish calibration or overall reliability.
Further evidence: Endpoint continuity remains inferred. Explicit probability event: conditional event resolution and proper scores, not deterministic right/wrong or separate axis grades.
Direction: Explicit probability event: conditional event resolution and proper scores, not deterministic right/wrong or separate axis grades.
Magnitude: Explicit probability event: conditional event resolution and proper scores, not deterministic right/wrong or separate axis grades.
Timing: Explicit probability event: conditional event resolution and proper scores, not deterministic right/wrong or separate axis grades.
Scope: Criterion G is interpreted municipally: public service in partial municipal areas counts; no family trip required. Endpoint continuity is inferred, not directly observed. The metro-market alternative remains unresolved and unscored; the workbook does not define city boundaries. Author doubts the automated retrospective; this is researcher resolution, not author acceptance. Revisions count once. Either outcome has identical loss; no directional win.
Note: Artemis criteria
Evidence confidence: Moderate conditional municipal interpretation and endpoint continuation; original-cell provenance moderate. Metro-market reading unresolved; author doubt retained.
Current edition contribution · Daniel Kokotajlo
Graded credit: 75 / 100.
- Recency weight
- 89.0027397260274%
- Credit × weight endpoint products
- 66.75205479452055
- Last documented backing
- 2022-01-01 to 2022-01-01
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
Selected probability event only. This is not a whole-outcome grade. Archive timing: Not separately applicable.
- Credit
- 75 / 100
- Recency weight
- 81.67123288%
- Weighted credit term
- 61.25342466
- Same-claim backing date
- 2022-01-01 to 2022-01-01
- Authored probability
- 50%
- Event outcomes retained
- 1
Latest matched pre-resolution forecast: p=50%. The updated odds and date replace the previous version; one vote for this event.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
The author's latest dated tab for this same September 2025 criterion specifies 50% (January 2020 tab: 50%). Checked against all three dated tabs. The public workbook corroborates the values and tab labels, not immutable edit history.
Exact calculation inputs
{
"scoring": {
"kind": "binary_probability",
"probabilityBounds": [
0.5,
0.5
],
"outcomes": [
1
]
},
"backingDateBounds": [
"2022-01-01",
"2022-01-01"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
75,
75
],
"weightBounds": [
0.8167123287671233,
0.8167123287671233
],
"normalizedBackingDateBounds": [
"2022-01-01",
"2022-01-01"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
75,
75
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Daniel Kokotajlo5 Jan 2020Chart grade 75 / 100Shared criterion F
Canonical scored claim: Household voice-command vacuum can answer Alexa-style internet questions by September22,2025.
Dated owner reports conditionally support narrow weather/news capability.
Probability50%2020-01-05EventOccurredconditionalBrier loss0.25lower is better
Issuance: see dated Proper score below
Score condition: Conditional reading: integrated spoken weather/news queries. September 22 continuity inferred from 2025 owner/catalog evidence, not exact-day observation. Broad factual QA remains unresolved and unscored.
Resolution basis: Researcher interpretation, not author acceptance or automated retrospective grading.
Resolution confidence: Evidence confidence applies to this conditional reading.
Resolution limitation: Interpretation is conditional; the broader reading below remains unresolved and unscored.
Unscored interpretation: Broad Alexa-like factual QA beyond weather/news/lifestyle information. Unresolved; no outcome or proper score assigned. No matched demonstration establishes broad coverage. This does not require Alexa feature parity or imply a false event. Same target, not another forecast.
Proper score: 2020-01-05: p(event)=50%; outcome=1 (under the stated score condition); Brier=0.25; log loss=0.6931472 nats.
Dependent revision: 2021-01-04: p(event)=50%; outcome=1 (under the stated score condition); Brier=0.25; log loss=0.6931472 nats.
Dependent revision: 2022-01-01: p(event)=50%; outcome=1 (under the stated score condition); Brier=0.25; log loss=0.6931472 nats.
Outcome dates: December 7, 2021 exact older-model ownership; April 11/28, 2025 owner reports; May/June 2025 catalog. September 22, 2025 continued state inferred, not directly observed.
Interpretation: Lower Brier and log loss are better. Revisions concern the same event, not additional forecasts. One event does not establish calibration or overall reliability.
Further evidence: Explicit 50% event assessed using proper scores, not a deterministic right/wrong color. No favored direction at p=.50.
Scope: Narrow capability predates issuance: no innovation credit. Model and regional restrictions remain. Weather report names a family, not an exact model; manufacturer catalog identifies qualifying models. Another owner reports failed cleaning commands while other assistant commands worked. Researcher interpretation, not author settlement. Either binary outcome yields identical losses, not a directional win.
Note: Artemis criteria
Evidence confidence: Moderate conditional narrow resolution and deadline continuity; original-cell provenance moderate. General-QA reading unresolved.
Current edition contribution · Daniel Kokotajlo
Graded credit: 75 / 100.
- Recency weight
- 89.0027397260274%
- Credit × weight endpoint products
- 66.75205479452055
- Last documented backing
- 2022-01-01 to 2022-01-01
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
Selected probability event only. This is not a whole-outcome grade. Archive timing: Not separately applicable.
- Credit
- 75 / 100
- Recency weight
- 81.67123288%
- Weighted credit term
- 61.25342466
- Same-claim backing date
- 2022-01-01 to 2022-01-01
- Authored probability
- 50%
- Event outcomes retained
- 1
Latest matched pre-resolution forecast: p=50%. The updated odds and date replace the previous version; one vote for this event.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
The author's latest dated tab for this same September 2025 criterion specifies 50% (January 2020 tab: 50%). Checked against all three dated tabs. The public workbook corroborates the values and tab labels, not immutable edit history.
Exact calculation inputs
{
"scoring": {
"kind": "binary_probability",
"probabilityBounds": [
0.5,
0.5
],
"outcomes": [
1
]
},
"backingDateBounds": [
"2022-01-01",
"2022-01-01"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
75,
75
],
"weightBounds": [
0.8167123287671233,
0.8167123287671233
],
"normalizedBackingDateBounds": [
"2022-01-01",
"2022-01-01"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
75,
75
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Gary Marcus1 Jan 2020Chart grade 75 / 100Bengio’s continuing research should produce much stronger System II capabilities by 2025.
A Bengio-coauthored 2024 study reported substantial gains in constrained multi-step tool planning, with significant residual failures.
OutcomePartly rightDirectionRightMagnitudePartly matched scopeTimingWithin original window
2020-01-01
Further evidence: Approximately right in a bounded deliberative-task domain; the exact 2018 comparison and broad capability extent are not fully measured.
Direction: Positive progress is directly demonstrated within the named research collaboration.
Magnitude: Large measured task gains support more than token progress, but do not establish general System II mastery.
Timing: The matched research result predates the 2025 horizon.
Scope: Bengio-coauthored research on constrained tasks with calculator access and training examples. Not general reasoning mastery; no identical 2018 baseline, and longer-expression failures remain.
Evidence confidence: Moderate: attributable peer-reviewed primary experiments, narrow tasks and non-identical historical baseline.
Current edition contribution · Gary Marcus
Graded credit: 75 / 100.
- Recency weight
- 77.0027397260274%
- Credit × weight endpoint products
- 57.752054794520554
- Last documented backing
- 2020-01-01 to 2020-01-01
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 75 / 100
- Recency weight
- 61.67123288%
- Weighted credit term
- 46.25342466
- Same-claim backing date
- 2020-01-01 to 2020-01-01
Existing reviewed grade for the original scope; time intrinsic to that scope is retained.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
75,
75
]
},
"backingDateBounds": [
"2020-01-01",
"2020-01-01"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
75,
75
],
"weightBounds": [
0.6167123287671232,
0.6167123287671232
],
"normalizedBackingDateBounds": [
"2020-01-01",
"2020-01-01"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
75,
75
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Kai-Fu Lee1 Jan 2020Over one or two decades, AI spreads through personal and business life with efficiency gains and electricity-scale importance.
Post-issue surveys document growth in organizational use and personal learning/entertainment use. Whole outcome unresolved.
OutcomeUnresolvedDirectionRightMagnitudeUnresolvedTimingFuture window open
2020-01-01
Further evidence: Historical importance and broad efficiency promises remain unresolved. Full benefits and electricity comparison are unclosed.
Direction: Matched post-issue surveys document rising business and personal use.
Magnitude: No evidence establishes electricity-equivalent historical significance or universal reach.
Timing: Original 2030–2040 window remains open; early direction is not a full timing hit.
Evidence confidence: moderate for direction only
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Stuart Russell16 Dec 2019During the 2020s, AI research would swing back toward symbolic methods, logic and probability.
Defined publication samples, community events and implemented neural-symbolic methods show renewed activity by 2024–2025. Whole outcome unresolved.
OutcomeUnresolvedDirectionPartly rightMagnitudePartly supportedTimingTiming unresolved
16 December 2019 author AMA
Further evidence: Relative field-wide swing remains unresolved. Absolute growth does not establish a relative-field pendulum shift: no matched all-AI denominator.
Direction: Substantive logic/probability mechanisms support revival components, not neural chain-of-thought relabeling or field dominance.
Magnitude: A Google Scholar keyword sample rises from 53 publications in 2020 to 236 in 2023; organizer-reported registrations show community scale, not unique researchers or field share.
Timing: Component observations fit the original 2020s window; the complete relative-field target remains unresolved and its endpoint open.
Scope: The 2024 review screened 1,428 entries to 392 candidates, 167 with code and 158 final papers; its abstract’s 167 is not the final count. English, peer-review and code filters restrict coverage; categories overlap and authors favor the approach. A separate 2025 review finds 319 keyword records, retains 188 and examines 18 architectures; industry/government reports are excluded and some full texts unavailable. No chart-only values are used. The community dates to 2005. Russell already cited 2010–2018 probabilistic-programming growth. Free-event registrations—over 1,500 winter 2022, over 5,000 winter 2023 and over 3,500 summer 2023—are self-reported, not attendance, distinct people or monotonic like-for-like growth. DeepStochLog integrates trained neural grammar with stochastic logic; its predecessor predates the forecast. AlphaGeometry combines learned proposals with symbolic deduction in geometry, not general intelligence. Large neural models remain prominent; hybrids retain neural dependencies. Keyword drift and database selection can affect growth. No AGI, solved NLP or symbolic superiority is credited. The author thread is accessible, but exact-comment/proof-image retrieval failed; immutable version history is not claimed.
Shared evidence: Later 2022 wording is dependent context, not a reset or second vote. AlphaGeometry evidence is shared with other forecasts, not independent replication.
Evidence confidence: Moderate for local revival; low for the complete relative-field outcome.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Noam Shazeer23 Oct 2019The T5 authors predict that there will always be useful applications for smaller or cheaper language models despite larger-model gains.
Apple’s 2025 report pairs smaller on-device and larger server models; independent Pixel Recorder use confirms a useful function but recording-length failures.
OutcomePartly rightDirectionRightMagnitudeNot quantifiedTimingTiming unresolved
2019-10-23
Further evidence: Local/offline execution remains manufacturer-reported, not independently network-tested; summary factuality was not audited. Observed complementary usefulness, not universal validity.
Direction: Constrained-model roles persisted alongside larger models.
Magnitude: No numerical target; no general superiority claim.
Timing: No finite deadline or all-future timing hit.
Scope: Qualified practical persistence only; the explicit all-future proposition remains unresolved. Coauthored T5 outlook; Raffel credited with writing, not a sole-Noam forecast. Very low-information continuation of an established tradeoff; not superiority, market share or measured cost advantage.
Shared evidence: Distinct from NS-C002 scaling; related evidence is dependent.
Evidence confidence: Moderate for selected bounded practical persistence; literal universal validity unresolved. Very low predictive information. Joint authorship and Raffel writing role retained; developer architecture evidence is supplemented by a small independent use check, not comprehensive deployment auditing.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Gary Marcus10 Sep 2019At least a decade before cars drive fully independently in cities or adverse weather.
Sustained rider-only urban service existed by 2023, countering the decade lower bound under the narrower city-operation reading.
OutcomePartly rightDirectionNot separately gradedMagnitudeUnresolvedTimingIncorrect lower bound
2019-09-10 ebook/audiobook publication, primary publisher L165–172; book writing date unknown. Selected packet describes October 2019; no exact writing-day assumption.
Original horizon: Approximately 2019→2029 lower bound; earliest comparator must precede boundary robustly to writing/publication uncertainty.
Further evidence: Geographic and weather limits, plus human recovery support, leave broader readiness unresolved rather than proving every part of the forecast wrong. Actual urban service supports eventual capability, while broader geographic and adverse-weather readiness remains unresolved.
Direction: Not separately graded in the historical record.
Magnitude: No separately documented rationale is available.
Timing: Operation by 2023 contradicts the narrow decade lower bound; broader readiness remains pending.
Scope: The 2029 boundary remains future at the review cutoff. This is an early counterexample under one interpretation, not a matured-cohort result. Ernest Davis co-authored the original.
Evidence confidence: Not separately rated.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Ben Goertzel15 Aug 2019A couple of years from 2019, AI may pass a Turing test through convincing dialogue imitation.
In the 2025 replication, persona-prompted GPT-4o was judged human 48/63 times (76.19%); humans 158/221 (71.49%); minimal prompting 18/72 (25%).
OutcomePartly rightDirectionRightMagnitudePartly supportedTimingTiming unresolved
2019-08-15
Further evidence: Qualified eventual, protocol-specific dialogue imitation.
Direction: Behavior supports the imitation trajectory.
Magnitude: Not universal indistinguishability or statistical equivalence.
Timing: 2024–2025 evidence is later than the rough 2021 expectation; first attainment unknown, so no exact deadline or invented delay.
Scope: Five-minute two-party tests: 111 undergraduates, 629 games, repeated participation; prioritized persona configuration. Original preregistered GPT-4 result was 54% versus humans 67%, significantly lower; replication changes model/population. No equivalence/noninferiority demonstration. Subjective understanding untested; not embodied Sophia. Disputed pre-2019 passing claims limit novelty. The 2024–2025 demonstrated evidence is well after the approximate 2021 expectation. First attainment is unknown, so no exact delay or categorical timing verdict is assigned.
Shared evidence: Shared outcomes and related Jones–Bergen experiments share researchers; not independent laboratory replications.
Evidence confidence: Moderate for protocol-specific eventual content; low for earliest attainment and generality.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
François Chollet13 Jul 2019Chart grade 0 / 100No commercial robotaxis without safety drivers for the general public before 2023.
Dated 2021 customer reporting and a contemporaneous KPRC ride test establish paid, rider-only service for ordinary Metro Phoenix users before 2023.
OutcomeWrongDirectionNot applicableMagnitudeNot applicableTimingIncorrect lower bound
13 July 2019 public statement; reported 2018 private bet unverified
Further evidence: The combined conditions contradict the geographically unrestricted public lower bound.
Direction: Not applicable: no separate eventual-arrival or adoption-direction forecast.
Magnitude: Not applicable: no fleet-size, market-share or universal-road threshold.
Timing: Combined conditions existed by 2021, before 2023; no exact worldwide first-deployment date.
Scope: Current author text is not an immutable 2019 archive. Grade applies only to that unrestricted public wording, not the uninspected 2018 contract. A held 2021 reproduction specifies Bay Area and a mid-2022/late-2023 window; it may clarify or revise the bet and remains ungraded. Staged 2020 opening; undated edit not backdated. The October 2021 operator-hosted customer account is selected testimony, not a population survey. February 2021 KPRC reporters rode with and without a chaperone and described ordinary app access; they also saw manual rain operation. Geofencing/capacity limits are not universal-road deployment. Operator reports distinguish remote information from driving; maintenance and human recovery remain. No independent safety audit, zero-human-operations, zero-crash or human-level-safety claim. Separate L5 skepticism is context, not an imported condition. No current endorsement inferred.
Shared evidence: One target across reported 2018, public 2019 and held 2021 versions; no extra version votes or numeric probability from a bet.
Evidence confidence: Moderate overall: authenticated current public author wording predates endpoint and matched actual outcomes are strong; original 2018 contract and later geographical sensitivity remain uncertain.
Current edition contribution · François Chollet
Graded credit: 0 / 100.
- Recency weight
- 74.17534246575343%
- Credit × weight endpoint products
- 0
- Last documented backing
- 2019-07-13 to 2019-07-13
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 0 / 100
- Recency weight
- 56.95890411%
- Weighted credit term
- 0
- Same-claim backing date
- 2019-07-13 to 2019-07-13
Existing reviewed grade for the original scope; time intrinsic to that scope is retained.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
0,
0
]
},
"backingDateBounds": [
"2019-07-13",
"2019-07-13"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
0,
0
],
"weightBounds": [
0.5695890410958904,
0.5695890410958904
],
"normalizedBackingDateBounds": [
"2019-07-13",
"2019-07-13"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
0,
0
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Rodney Brooks20 May 2019Chart grade 75 / 100Worldwide driverless road-car deployment would not reach tens of thousands of vehicles without safety drivers during 2020-2021.
Dated regulatory and international deployment evidence supports a substantial shortfall from the proposed tens-of-thousands scale by 2021.
OutcomePartly rightDirectionPartly rightMagnitudePartly supportedTimingWithin original window
2019-05-20
Further evidence: This is a retrospective order-of-magnitude inference, not a complete December 2021 global fleet census. Commercial-only later counts do not logically bound all earlier test vehicles; see explicit alternative below. Supported under ordinary road-car deployment reading by early pilot status and later global small-fleet surveys; not established as a mathematically exhaustive count of every experimental driverless car.
Direction: Scale expanded incrementally, rather than reaching the disputed mass-deployment level in 2020-2021. This does not endorse a zero-driverless baseline.
Magnitude: No exact fleet total is assigned. The conclusion is below the order of tens of thousands; evidence includes later commercial subset and international coverage.
Timing: Inferred shortfall at the stated 2020-2021 window; neither first eventual attainment nor a permanent ceiling is claimed.
Scope: Moderate-confidence retrospective scale inference, not an exhaustive worldwide test-fleet census. Later commercial counts are not an upper bound on earlier test fleets. The original zero-vehicle baseline conflicts with Waymo’s 2017 no-driver-at-wheel evidence. Passenger road cars in the surrounding Urmson/taxi discussion; restricted Level 4 deployments count. Not Level 5-only, not a ban on any deployment, and not every industrial machine called a vehicle. Under an exhaustive all-experimental-car interpretation, the claim remains unresolved.
Evidence confidence: Moderate; global population coverage remains the principal limitation.
Current edition contribution · Rodney Brooks
Graded credit: 75 / 100.
- Recency weight
- 73.28767123287672%
- Credit × weight endpoint products
- 54.965753424657535
- Last documented backing
- 2019-05-20 to 2019-05-20
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 75 / 100
- Recency weight
- 55.47945205%
- Weighted credit term
- 41.60958904
- Same-claim backing date
- 2019-05-20 to 2019-05-20
Existing reviewed grade for the original scope; time intrinsic to that scope is retained.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
75,
75
]
},
"backingDateBounds": [
"2019-05-20",
"2019-05-20"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
75,
75
],
"weightBounds": [
0.5547945205479452,
0.5547945205479452
],
"normalizedBackingDateBounds": [
"2019-05-20",
"2019-05-20"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
75,
75
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Rodney Brooks17 May 2019Chart grade 100 / 100No publicly available, fare-paying, genuinely driverless Tesla taxis on ordinary mixed-traffic streets on December 31, 2020.
Tesla’s end-2020 disclosures still described qualifying network operation as future, supporting non-delivery at the specified deadline.
OutcomeNot applicableDirectionNot separately gradedMagnitudeNot quantifiedTimingCorrect lower bound
2019-05-17
Original horizon: 2020-12-31
Further evidence: Later driverless services would not overturn this finite timing prediction, which did not assert that autonomy was permanently impossible. This is a finite non-delivery forecast, not a separate claim about ultimate capability.
Direction: Not separately graded in the historical record.
Magnitude: No independent magnitude target was specified beyond non-delivery at the deadline.
Timing: End-2020 disclosures still treated the qualifying paid driverless network as a future operation.
Scope: The target requires public paid rides without an onboard safety driver, not any company’s demonstration. No later-service claim is inferred. The target concerns ordinary passengers choosing their destination, not merely restricted pre-approved trials.
Evidence confidence: Not separately rated.
Current edition contribution · Rodney Brooks
Graded credit: 100 / 100.
- Recency weight
- 73.23835616438356%
- Credit × weight endpoint products
- 73.23835616438356
- Last documented backing
- 2019-05-17 to 2019-05-17
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
Selected deadline or scoped criterion only. This is not a whole-outcome grade. Archive timing: Correct lower bound.
- Credit
- 100 / 100
- Recency weight
- 55.39726027%
- Weighted credit term
- 55.39726027
- Same-claim backing date
- 2019-05-17 to 2019-05-17
Existing reviewed grade for the original scope; time intrinsic to that scope is retained.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
100,
100
]
},
"backingDateBounds": [
"2019-05-17",
"2019-05-17"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
100,
100
],
"weightBounds": [
0.553972602739726,
0.553972602739726
],
"normalizedBackingDateBounds": [
"2019-05-17",
"2019-05-17"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
100,
100
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Elon Musk22 Apr 2019Chart grade 0 / 100Million-scale Tesla robotaxi capability by 2020.
2020 supervision contradicted the capability deadline; later restricted service does not establish a million-capable fleet. Whole outcome unresolved.
OutcomeUnresolvedDirectionPartly rightMagnitudeUnresolvedTimingOriginal deadline missed
2019-04-22
Further evidence: Full fleet-scale capability is unverified.
Direction: Later Tesla driverless operation is meaningful partial progress.
Magnitude: No valid eventual capable-vehicle count is available.
Timing: 2020 deadline failed; no qualifying full-target arrival date is documented.
Evidence confidence: moderate for deadline; limited for eventual fleet count
Current edition contribution · Elon Musk
Graded credit: 0 / 100.
- Recency weight
- 72.82739726027398%
- Credit × weight endpoint products
- 0
- Last documented backing
- 2019-04-22 to 2019-04-22
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
Selected deadline or scoped criterion only. This is not a whole-outcome grade. Archive timing: Original deadline missed.
- Credit
- 0 / 100
- Recency weight
- 54.71232877%
- Weighted credit term
- 0
- Same-claim backing date
- 2019-04-22 to 2019-04-22
This state-at-time, annual trajectory or original-period market/adoption predicate already includes time in its meaning. There is no separate event-arrival penalty to add back; preserve the reviewed original credit and temporal scope.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
0,
0
]
},
"backingDateBounds": [
"2019-04-22",
"2019-04-22"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
0,
0
],
"weightBounds": [
0.5471232876712329,
0.5471232876712329
],
"normalizedBackingDateBounds": [
"2019-04-22",
"2019-04-22"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
0,
0
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Elon Musk22 Apr 2019Chart grade 0 / 100Tesla operates genuinely driverless ride-hailing somewhere, with geographic restrictions allowed and permission expected in at least one location.
Tesla reports customer rides without an onboard safety monitor in Austin during January 2026; later NHTSA documentation corroborates commercial driverless deployment.
OutcomeRightDirectionNot separately gradedMagnitudeNot separately gradedTimingLate realization
2019-04-22T14:38:00-07:00
Original horizon: Calendar 2020
Further evidence: This realizes the geographically limited service target about five years late, without establishing general safety superiority. Actual Tesla driverless customer service fulfills the original geographically limited deployment target.
Direction: Not separately graded in the historical record.
Magnitude: Not separately graded in the historical record.
Timing: The company-reported January 1–28, 2026 onset window is about five years late; the exact first day is unknown.
Scope: The June 2025 launch had a safety rider; December testing was not yet customer service. January is the earliest qualifying window found, not a proven global first. Bay Area safety-driver service is separate. Remote assistance is not automatically remote driving. NHTSA’s investigation neither finds noncompliance by itself nor endorses safety. No nationwide, million-vehicle, consumer-car or universal-autonomy result is implied. Remote assistance does not by itself disqualify this narrow service result; routine remote driving would matter, and absence of remote intervention is not established.
Evidence confidence: Not separately rated.
Current edition contribution · Elon Musk
Graded credit: 0 / 100.
- Recency weight
- 72.82739726027398%
- Credit × weight endpoint products
- 0
- Last documented backing
- 2019-04-22 to 2019-04-22
- Timing deduction recorded
- 100 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 0 / 100
- Recency weight
- 54.71232877%
- Weighted credit term
- 0
- Same-claim backing date
- 2019-04-22 to 2019-04-22
Actual geographically limited driverless customer service realizes the selected content by cutoff. Waiving the separate original2020 lateness yields full content credit. January2026 is earliest-found qualifying onset, not proven global first; no broader safety or million-car success implied.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
0,
0
]
},
"backingDateBounds": [
"2019-04-22",
"2019-04-22"
],
"timingCostBounds": [
100,
100
],
"calculated": {
"creditBounds": [
0,
0
],
"weightBounds": [
0.5471232876712329,
0.5471232876712329
],
"normalizedBackingDateBounds": [
"2019-04-22",
"2019-04-22"
],
"timingCostBounds": [
100,
100
],
"deadlineWaiverCreditBounds": [
100,
100
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Elon Musk12 Apr 2019Human intervention becomes safety-reducing by 2020.
Human fallback remained technically necessary in 2020; later restricted driverless operation does not establish a harmful net intervention effect. Whole outcome unresolved.
OutcomeUnresolvedDirectionUnresolvedMagnitudeNot quantifiedTimingOriginal deadline missed
2019-04-12 publication
Further evidence: Full net-safety target remains unverified; operational dispensability by the deadline was contradicted.
Direction: Autonomy progress does not determine the intervention effect’s sign.
Magnitude: No net-risk effect size specified for this predicate.
Timing: Operational deadline missed; first fulfillment of the precise comparative target is unknown.
Evidence confidence: Moderate operational interpretation; exact causal comparison unresolved.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Elon MuskFeb 2019 · rangeChart grade 0 / 100Safe passenger sleep during Tesla point-to-point travel by the end of 2020, subject to regulatory approval.
Tesla–DMV correspondence required monitoring and driver fallback, contradicting on-time readiness. Whole outcome unresolved.
OutcomeUnresolvedDirectionNot separately gradedMagnitudeNot separately gradedTimingOriginal deadline missed
2019-02; recording Feb 13, public issue Feb 19–27
Original horizon: Around late 2020.
Further evidence: Later unattended passenger rides in a restricted fleet are meaningful progress, but do not establish broad consumer-system readiness or validated safety for sleeping passengers. Restricted unattended rides do not establish the consumer-system readiness and safety needed for passengers to sleep.
Direction: Not separately graded in the historical record.
Magnitude: Not separately graded in the historical record.
Timing: The original approximate deadline was missed; no exact later realization date or universal delay multiplier is established.
Scope: The consumer driving system and geographically constrained fleet service are different operating settings. Regulatory uncertainty does not erase documented technical supervision requirements.
Evidence confidence: Not separately rated.
Earlier statement: April 2017; full host publication 2017-04-30 (Earlier material deadline version of same sleeping-trip target): Expected a customer-owned safe sleeping trip around 2019, excluding regulation. Disclosed systems remained supervised; later restricted fleet service is narrower progress. Illustrative lifetime comparisons are not calibrated crash probabilities. Deadline: Approximately two years; no exact day-level tolerance invented. Outcome: Unresolved. Direction: approximately right. Magnitude: Unresolved. Timing: Deadline missed; eventual status unverified. One earlier dated formulation; no extra independent trajectory, target or main vote.
Current edition contribution · Elon Musk
Graded credit: 0 / 100.
- Recency weight
- 71.8082191780822–71.93972602739726%
- Credit × weight endpoint products
- 0
- Last documented backing
- 2019-02-19 to 2019-02-27
- Timing deduction recorded
- 0–100 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
Selected deadline or scoped criterion only. This is not a whole-outcome grade. Archive timing: Original deadline missed.
- Credit
- 0 / 100
- Recency weight
- 53.01369863–53.23287671%
- Weighted credit term
- 0
- Same-claim backing date
- 2019-02-19 to 2019-02-27
Known selected technical safe-sleep readiness miss. Later unattended restricted rides do not establish consumer readiness/safe sleeping. Preserve regulatory distinction; full same-scope content is unknown.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
The recording occurred Feb 13, but the recovered archive explicitly bounds public issue to Feb 19–27. Use public availability rather than recording date; the 2017 item is an earlier materially different deadline version, not a later backing. Recording date 2019-02-13 retained only as prior provenance; public issue interval Feb 19–27, 2019.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
0,
0
]
},
"backingDateBounds": [
"2019-02-19",
"2019-02-27"
],
"timingCostBounds": [
0,
100
],
"calculated": {
"creditBounds": [
0,
0
],
"weightBounds": [
0.5301369863013699,
0.5323287671232877
],
"normalizedBackingDateBounds": [
"2019-02-19",
"2019-02-27"
],
"timingCostBounds": [
0,
100
],
"deadlineWaiverCreditBounds": [
0,
100
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Sam Altman5 Jan 2019Chart grade 75 / 100By 2025, AGI would feel within reach to many people in the industry.
October 2024 high-tech executives expressed substantial near-term AGI expectations; survey findings were announced November 2024 and published January 2025.
OutcomePartly rightDirectionRightMagnitudeNot quantifiedTimingWithin original window
5 January 2019
Further evidence: A 2023 Microsoft Research team described GPT-4 as incomplete early AGI. Broader researcher surveys retained much longer timelines. Qualified support for qualitative “many,” not representative prevalence.
Direction: Expressed belief, not capability-score inference or a required measured increase.
Magnitude: No numeric fraction forecast.
Timing: Expressions and fieldwork precede 2025 under start- or end-year readings; publication does not redate observations.
Scope: Belief, not AGI achievement or accuracy of those expectations. “Within reach” means perceived feasibility within several years, not a precise distance. High-tech executives imperfectly represent AI workers; no subgroup denominator, response rate or weighting established. Report/announcement wording and methods differ. Fourteen Microsoft coauthors constitute one team; the OpenAI partnership, commercial interests and public advocacy limit independence. No majority, consensus, current-belief or exceptional-foresight inference. Separate fusion/gene-editing items and importance ranking remain ungraded.
Evidence confidence: Moderate. Belief/adoption-adjacent, not a technical capability success; commercial interests, subgroup uncertainty and differing AGI definitions remain.
Current edition contribution · Sam Altman
Graded credit: 75 / 100.
- Recency weight
- 71.06849315068493%
- Credit × weight endpoint products
- 53.3013698630137
- Last documented backing
- 2019-01-05 to 2019-01-05
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 75 / 100
- Recency weight
- 51.78082192%
- Weighted credit term
- 38.83561644
- Same-claim backing date
- 2019-01-05 to 2019-01-05
Existing reviewed grade for the original scope; time intrinsic to that scope is retained.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
75,
75
]
},
"backingDateBounds": [
"2019-01-05",
"2019-01-05"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
75,
75
],
"weightBounds": [
0.5178082191780822,
0.5178082191780822
],
"normalizedBackingDateBounds": [
"2019-01-05",
"2019-01-05"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
75,
75
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Andrew Ng2 Jan 2019Chart grade 75 / 1002019: substantial AI application activity beyond software; broader value-wave claim undated.
A 2019 survey reported broader non-tech adoption; BMW documented production use in July and December.
OutcomePartly rightDirectionRightMagnitudeUnresolvedTimingWithin original window
2019-01-02 publication; interview undated.
Further evidence: Earlier deployments and self-reporting limit novelty and confidence. Scoped qualitative support; broader scope remains unproved.
Direction: Reported cross-industry use increased.
Magnitude: No representative breadth, volume or economic-value measurement.
Timing: July and December 2019 are the deployment-report dates. Survey comparisons partly precede publication; BMW reports continuation of 2018 deployments.
Scope: No quantified value-wave fulfillment, dozens-per-company result or audited reliability. Existing 2018 examples make continuation a low-information forecast. Ng led Landing AI and AI Fund.
Evidence confidence: Moderate for qualitative 2019 activity: primary survey and manufacturer deployment evidence, with sampling, prior-year overlap, corporate-reporting and low-novelty limits. No population-wide productivity claim.
Current edition contribution · Andrew Ng
Graded credit: 75 / 100.
- Recency weight
- 71.01917808219179%
- Credit × weight endpoint products
- 53.26438356164383
- Last documented backing
- 2019-01-02 to 2019-01-02
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 75 / 100
- Recency weight
- 51.69863014%
- Weighted credit term
- 38.7739726
- Same-claim backing date
- 2019-01-02 to 2019-01-02
Existing reviewed grade for the original scope; time intrinsic to that scope is retained.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
75,
75
]
},
"backingDateBounds": [
"2019-01-02",
"2019-01-02"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
75,
75
],
"weightBounds": [
0.516986301369863,
0.516986301369863
],
"normalizedBackingDateBounds": [
"2019-01-02",
"2019-01-02"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
75,
75
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Yann LeCun5 Dec 2018FAIR outlook: outline all scene objects and describe events textually.
Facebook’s 2021 alt text jointly added richer object, activity and spatial descriptions to its 2016 application. Whole outcome unresolved.
OutcomeUnresolvedDirectionPartly rightMagnitudePartly supportedTimingTiming unresolved
2018-12-05
Further evidence: That report did not demonstrate pixel-outline output. Local progress; full target unresolved.
Direction: Substantive within-company application improvement, not unrelated papers combined.
Magnitude: Company reports over tenfold concept-vocabulary expansion; deliberate omissions limit breadth.
Timing: 2021 application progress. Five-year frame is editorial, not an elicited deadline. Full timing unresolved.
Scope: Facebook’s confidence filtering omits uncertain concepts; output is brief phrases, not exhaustive narration. November 2021 removal of people’s names does not erase January progress. Developer report, not independent quality validation. Pre-issuance region captions and instance masks are not new attainment.
Evidence confidence: Moderate for local company direction; full content and timing unresolved.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Stuart Russell4 Dec 2018Several hundred billion dollars of global AI research investment over a decade accompanies rapid advances.
NSF/Census estimates total $166.694 billion in US domestic business AI R&D for 2019–2023, with annual estimates rising from $15.351 billion to $64.810 billion. Whole outcome unresolved.
OutcomeUnresolvedDirectionPartly rightMagnitudePartly supportedTimingFuture window open
4 December 2018 publisher release; 2019 page update, report revision history unknown
Further evidence: Later developer benchmarks support capability progress, not a global decade total or causal return. The coupled global expenditure/progress target remains unresolved.
Direction: Large domestic research estimates and later capability gains support bounded continuation.
Magnitude: Substantial restricted estimate, not a global count or statistical lower confidence bound.
Timing: The approximate late-2028 endpoint remains open; in-window observations establish no complete timing success or failure.
Scope: R&D includes basic/applied research and experimental development; a strict research-only reading remains unresolved. Other countries, nonbusiness research and firms below survey thresholds are outside coverage. All five AI-total cells are more than 50% imputed/reweighted for nonresponse. The 2023 reporting change removed some non-R&D spending; earlier estimates were not revised, preventing a clean exact growth rate. Weighted survey estimates are not an audited cash ledger or guaranteed global lower bound. Five disjoint years only: no pre-issue 2018 total, projections, financing, acquisitions, all-R&D total or general capital expenditure is added. Developer benchmarks retain contamination and reliability limits; no AGI, universal reliability or identified causal return is established. A bounded official search found no actual AI-specific 2024/2025 release; general R&D preliminary totals and projections are not substituted. Anthropic’s October 2026 filing reports functional R&D of $2.275B in 2024, $6.338B in 2025 and $9.741B in H1 2026: $18.354B across disjoint periods, without adding trailing-twelve-month totals. Zitron’s June 2026 firsthand account of audited statements reports OpenAI R&D of $7.81B in 2024 and $19.18B in 2025. Underlying accounts and FT corroboration were not inspected here. The $10.59B Microsoft R&D service charge is already included. Alphabet reports $10.541B in 2024 and $16.760B in 2025 for activities described as primarily shared AI R&D, not exclusively AI research. Its July 2026 release adds unaudited Q2 2026 $5.789B; unverified Q1 is not added. This mixed line is not all Alphabet R&D or capex. Functional R&D includes personnel, software and overhead, not only training compute. Corporate figures are not added into a global total without reconciled scope and overlap.
Shared evidence: Reuses SR-C033 capability evidence; related investment discussions and the same GPT-4 report are not independent observations.
Evidence confidence: Moderate for bounded direction and measured local magnitude; lower for a global point estimate.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Demis HassabisNov 2018 · rangeHealthcare will be among the largest AI-beneficiary areas over five years.
A Swedish randomized 2021–2022 screening trial documented more detected cancers and fewer screen readings. Whole outcome unresolved.
OutcomeUnresolvedDirectionRightMagnitudeUnresolvedTimingTiming unresolved
2018-11 publication; interview date unspecified
Further evidence: Its 2025 report supports a realized healthcare-workflow benefit. The comparative ranking remains unresolved: no common cross-sector benefit measure.
Direction: The trial supports actual clinical-workflow gains, rather than retrospective accuracy alone: detection increased and reading workload decreased in an assisted screening setting.
Magnitude: No commensurable cross-sector metric or coverage establishes the forecast comparative rank. One Swedish trial cannot settle global health benefit.
Timing: The measured screening activities occurred in 2021–2022, inside this window. The full comparative endpoint remains unjudgeable, not a late result or a confirmed 2023 success.
Evidence confidence: High on original five-year scope and trial dates; moderate on narrow direction; full comparative target unresolved.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Demis HassabisNov 2018 · rangeWithin a decade, most such AI systems become substantially understandable, improving control and knowledge of their mathematical limits.
Circuit tracing in 2025 demonstrated local mechanistic insight and interventions in Claude 3.5 Haiku. Whole outcome unresolved.
OutcomeUnresolvedDirectionPartly rightMagnitudeUnresolvedTimingFuture window open
2018-11 publication; interview day unreported
Further evidence: The methods paper reports substantial unexplained computation, difficult global interpretation, and imperfect causal faithfulness. Separate 2022 chess/Hex probes and behavioral tests provide game-specific diagnostic insight, not complete causal explanation. Full outcome unresolved.
Direction: Evidence supports progress in reverse engineering, but only on restricted mechanisms and examples.
Magnitude: Representative coverage remains unestablished; success is qualitative.
Timing: Approximate 2028 endpoint remains open. No deadline miss or full timing success is inferred.
Scope: Human-defined probes, incomplete causal faithfulness and narrow game settings do not establish most-system understanding or reliable control. Supporting formulation: 2019 publication describes few-year analytical and visualization advances in game agents. Supporting dependent formulation only; interview order unknown, no later belief or replacement deadline inferred. Dependent formulation assessment: 2018-12-11 publication; interview day unknown. Five-year AlphaZero decision-understanding tools forecast; roughly 2023-12. Bounded diagnostic understanding: approximately right; direction right; magnitude partially supported; bounded progress within window. Full decision-causation unresolved; full-target timing unjudgeable. Existing 2022 chess probes and Hex behavioral tests support narrow insight, not full causal explanation. Chess coauthorship, narrow non-counterfactual Hex evidence and limited scope remain. No 2025 outcome credited; no interview-order or belief-revision inference. Parent assessment and timing unchanged. Not counted as a separate forecast. Hassabis is a coauthor; research follow-through, not independent forecast validation.
Evidence confidence: High on original wording and methods limitations; moderate on narrow direction; endpoint unresolved.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Rodney BrooksNov 2018 · rangeChart grade 100 / 100Flying autonomous Ubers absent in 2020.
No qualifying Uber autonomous aerial service in 2020, supported by future-launch and pre-revenue disclosures.
OutcomeRightDirectionRightMagnitudeNot quantifiedTimingWithin original window
2018-11
Further evidence: Company announcements and subsequent filing place the specified service in development, not operation.
Direction: The predicted non-realization held for the specified event, not a general absence of technical progress.
Magnitude: No separate magnitude judgment; zero qualifying service is the event itself.
Timing: The window is expired; pre/acquisition disclosures bridge its end.
Scope: Uber-specific operational aerial passenger service, not every autonomous aircraft trial or piloted helicopter ride.
Evidence confidence: high for Uber-specific service; demonstrations are outside service interpretation
Current edition contribution · Rodney Brooks
Graded credit: 100 / 100.
- Recency weight
- 70–70.47671232876712%
- Credit × weight endpoint products
- 70–70.47671232876712
- Last documented backing
- 2018-11-01 to 2018-11-30
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 100 / 100
- Recency weight
- 50–50.79452055%
- Weighted credit term
- 50–50.79452055
- Same-claim backing date
- 2018-11-01 to 2018-11-30
Existing reviewed grade for the original scope; time intrinsic to that scope is retained.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
100,
100
]
},
"backingDateBounds": [
"2018-11-01",
"2018-11-30"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
100,
100
],
"weightBounds": [
0.5,
0.507945205479452
],
"normalizedBackingDateBounds": [
"2018-11-01",
"2018-11-30"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
100,
100
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Ben Goertzel25 Sep 2018AI would assist combined-effect biological research in the 2018–2022 outlook, amid hoped-for mainstreaming.
March 2025 BioDiscoveryAgent v3 selected pairs using historical measured outcomes: five-round mean hits 40.0/45.1 versus random 16.4 across ten runs.
OutcomePartly rightDirectionRightMagnitudePartly supportedTimingTiming unresolved
25 September 2018 publication; recording day unknown
Further evidence: Retrospective inverse selection, not newly executed AI-directed experiments. Bounded research assistance supported; prospective execution was not an original prerequisite.
Direction: Inverse selection extends prior forward-prediction evidence.
Magnitude: Historical benchmark only; general robustness unproven.
Timing: Inspected March 2025 v3 follows 2018–2022; no 2022 attainment/absence or first-attainment date established.
Scope: One paired dataset; weak random comparator; unquantified prior exposure. Stronger baselines and unpublished-data safeguards concern separate single-intervention tests. GEARS’ predicted phenotype lacked validation; CPA’s new validation involved drugs. Indexed-only 2025/2026 benchmarks respectively challenged performance and reported calibrated gains without unseen-context validation. Practical, clinical and mainstream success remain unresolved. Prior prediction papers do not independently replicate this result.
Evidence confidence: Moderate for bounded retrospective research assistance; low for original timing, out-of-distribution robustness and prospective practical utility.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Yoshua BengioSep 2018 · rangeExisting AI science can yield benefits for at least another decade.
A later randomized screening workflow showed substantial gains; frozen-science and economy-wide claims remain unverified. Whole outcome unresolved.
OutcomeUnresolvedDirectionRightMagnitudeUnresolvedTimingFuture window open
By September 2018 publication; interview date unspecified
Further evidence: Full frozen-science causal premise and decade-wide benefit scope unresolved.
Direction: Post-claim deployment of established deep-learning methods produced measurable clinical-workflow benefits in a randomized trial.
Magnitude: A single application does not measure aggregate wealth growth or all-industry benefits.
Timing: Original at-least-ten-year window remains unfinished; component evidence occurred within it.
Evidence confidence: Moderate for application-benefit direction; weakly informative broad forecast
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
François Chollet2 Jul 2018Radiologists would still have jobs five years after July 2018.
May 2023 US estimate: 31,960 employed radiologists, 5.2% relative standard error, excluding self-employment.
OutcomeRightDirectionNot applicableMagnitudeNot applicableTimingCorrect lower bound
2 July 2018 publication; recording day not independently established
Further evidence: October 2023 UK census: 4,624 whole-time-equivalent consultant/SAS radiologists, all 159 acute trusts/boards responding. Substantial occupational employment persisted; not every individual retained a job.
Direction: No separate long-run displacement or capability judgment.
Magnitude: No staffing level, growth rate or retention fraction predicted.
Timing: May/October observations bracket approximate July 2023; continuity is inferred, not an exact-date census.
Scope: Different populations/units are not additive. US survey estimates exclude self-employed workers; UK equivalents are not unique people or all private practitioners. Task automation, departures and diagnostic-model superiority are compatible; no AI causal employment effect or indefinite security established. No probability is inferred from emphatic wording.
Evidence confidence: High for continued substantial occupational employment; ordinary dated-interview provenance. Low information content: a weak five-year persistence lower bound for an already large profession.
Draft formula inputs
No draft score: AI link unclear. No vote, not zero.
Yann LeCun1 Jun 2018AI will amplify human creativity, rather than merely make human artistic work pointless.
Published July 12, 2024: randomized human microfiction ratings support bounded assistance.
OutcomePartly rightDirectionPartly rightMagnitudePartly supportedTimingTiming unresolved
2018-06-01 (event; web-publication day unverified)
Further evidence: Bounded benefit; stronger general artistic/collective-novelty interpretation unresolved.
Direction: Assistance, not universal collaboration superiority.
Magnitude: No numerical target, whole-cultural gain or employment protection.
Timing: Host-framed near-decade from June 2018; endpoint future; no exact personal deadline, first-attainment date or timing hit.
Scope: 293 UK writers’ eight-sentence stories, 600 initially blinded lay raters: optional access to up to five GPT-4 ideas raised novelty 8.1%/usefulness 9.0% versus unassisted writing (both p<.001), mainly for lower-baseline writers; highly creative writers did not improve. Cross-writer story diversity decreased; self-ratings did not improve significantly. Fixed prompts/nonprofessionals; no expert frontier. Main paper only; supplements/data unread. December 10, 2024 counterweight (abstract only): 202 Germans; human dyads led divergent thinking versus internet/AI groups; problem-solving differences nonsignificant, scoring methods diverged. Not a replication. MIT’s 2017 Shelley enabled co-writing; developer baseline, not controlled quality evidence or invention. Official transcript, not audio-checked; audience-emotion distinction and tentative decades/centuries attitude speculation remain unresolved context.
Shared evidence: Dependent target; no per-result votes.
Evidence confidence: Moderate for the bounded central outcome; strong causal local design but limited generalization and low novelty against existing co-creation tools.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Rodney Brooks18 Apr 2018Collaborative industrial robots sharing human workspaces likely grow over five years.
IFR’s initial series rose from under 14,000 installations in 2018 to nearly 55,000 in 2022.
OutcomeRightDirectionRightMagnitudeNot quantifiedTimingWithin original window
18 April 2018 publication; speaking day unknown
Further evidence: Growth supported, not Rethink business success or universal safe contact.
Direction: Growth survives statistical revisions.
Magnitude: No forecast rate, share or stock target; no numerical accuracy invented.
Timing: 2022 activity precedes the approximate April 2023 endpoint; later publication does not reset it.
Scope: Publisher paraphrase; audio and immutable original unverified. Rethink affiliation; existing category, not first invention. The 2019 initial count and 2023 statistical vintage concern annual installations, not stock or revenue. Federation data are not a complete audit. Intended collaborative design under ISO 10218-1 does not count continuous shared operation; safeguards remain application-specific. September 2024 revisions put 2018/2022 near 19,000/58,000, then 2023 near 57,000. Do not mix vintages into a precise multiple or infer perpetual growth. Indexed chart text only; image not inspected and later download blocked. Revisions are sensitivity support, not the sole basis. Historical assessment; no authenticated current endorsement or horizon reset. Likelihood unquantified.
Shared evidence: Same interview, separate targets; correlated evidence. No per-year votes or exceptional-skill inference; separate from road deployment, press discourse and later broad workforce discussion.
Evidence confidence: Moderate-high for qualitative category growth; moderate for exact interview wording and comparable numerical magnitude.
Draft formula inputs
No draft score: AI link unclear. No vote, not zero.
Rodney Brooks18 Apr 2018Chart grade 75 / 100Factory SLAM adoption likely grows over five years.
BMW reported over 130 SLAM-based STRs operating at multiple production sites in November 2020; IDEC described its first MiR100 factory deployment in April 2021.
OutcomePartly rightDirectionPartly rightMagnitudeNot quantifiedTimingWithin original window
18 April 2018 publication; speaking day unknown
Further evidence: Qualified factory-adoption trend, not an industry census.
Direction: Pilot-to-multisite rollout and new customer use support expansion.
Magnitude: No numerical target; unlike fleets cannot establish a growth ratio or universal adoption.
Timing: 2020–2021 adoption fits the approximate April 2023 endpoint; no later substitution.
Scope: Publisher paraphrase; audio and immutable original unverified. Existing deployment, not first invention or own-product scheduling. Fraunhofer’s October 2018 account described six second-generation STRs in Regensburg pilot testing through year-end; planned 100 in 2019 is not observed. BMW’s November 2018 account identifies that generation’s SLAM navigation, not an authenticated exact April 2018 fleet baseline. The 2016 predecessor is not an April 2018 SLAM baseline. BMW’s German November 2020 wording establishes series operation, not merely robot manufacture; later-generation rollout plans are not actual deployment. IDEC’s May 2020 release establishes MiR100 SLAM without magnetic guides, not deployment. Its August 2021 interview describes April’s first unit, daily component transport and lift integration; experimental first unit, not its planned expansion. A supplier-hosted Kimball account recalls two MiR250s at Nanjing in 2021 after other plants; publication date and exact historical SLAM implementation are unverified, and productivity was not independently audited. November 2023 market research reports 2022 mobile-robot growth, but mixed manufacturing/logistics and navigation categories do not establish factory-SLAM growth rates; later forecasts excluded. Operator/supplier reports are not independent industry sampling or proof of fully autonomous factories. Historical assessment; no authenticated same-scope current endorsement. Likelihood unquantified.
Shared evidence: Same interview, separate targets; correlated evidence. BMW/Fraunhofer statements are not independent implementations; no extra votes for suppliers, components or years.
Evidence confidence: Moderate for qualified qualitative realization and chronology; operator/supplier reports, not an independent global SLAM deployment census.
Current edition contribution · Rodney Brooks
Graded credit: 75 / 100.
- Recency weight
- 66.76164383561644%
- Credit × weight endpoint products
- 50.07123287671233
- Last documented backing
- 2018-04-18 to 2018-04-18
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 75 / 100
- Recency weight
- 44.60273973%
- Weighted credit term
- 33.45205479
- Same-claim backing date
- 2018-04-18 to 2018-04-18
Existing reviewed grade for the original scope; time intrinsic to that scope is retained.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
75,
75
]
},
"backingDateBounds": [
"2018-04-18",
"2018-04-18"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
75,
75
],
"weightBounds": [
0.44602739726027407,
0.44602739726027407
],
"normalizedBackingDateBounds": [
"2018-04-18",
"2018-04-18"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
75,
75
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Rodney Brooks18 Apr 2018Chart grade 75 / 100Improved vision tracking could safeguard larger robots around people within five years.
FreeMove offered dynamic 3D speed-and-separation safeguarding, with reported certification and availability by 2021.
OutcomePartly rightDirectionRightMagnitudePartly supportedTimingWithin original window
18 April 2018 publication; speaking day unknown
Further evidence: Approximate central capability; exact combined route and field reliability remain unverified.
Direction: Vision monitoring expanded safeguarding beyond small force-limited cobots.
Magnitude: No numerical payload or injury threshold forecast; none independently measured here.
Timing: 2021 evidence precedes the approximate April 2023 endpoint; later plans do not satisfy it.
Scope: Publisher paraphrase; audio and immutable original unverified. 2D/3D human tracking; proposed SLAM/deep-learning/location-tag route; standards may lag. March 2020 cofounder interview describes heavy-payload industrial use with deterministic, not machine-learning, vision; customers were mostly unnamed. Developer statements, not independent field testing. April 2021 syndicated Veo announcement reports TÜV Rheinland ISO 13849 PLd Category 3 certification and immediate availability; certificate itself uninspected. Certification does not prove every integrated workcell safe. October 2021 trade caption attests a PACK EXPO demonstration; video not viewed, no added measurements. No universal injury-free, all-environment or autonomous-factory result. Improvement, not first invention. Future partnership plans are not completed installations. No numerical probability. Historical assessment; no authenticated current endorsement or horizon reset.
Shared evidence: Same interview, separate targets; correlated evidence. No separate votes for cameras, certification, partners or years.
Evidence confidence: Moderate for central qualitative capability and timing; lower for full proposed mechanism, field reliability and exact payload generality.
Current edition contribution · Rodney Brooks
Graded credit: 75 / 100.
- Recency weight
- 66.76164383561644%
- Credit × weight endpoint products
- 50.07123287671233
- Last documented backing
- 2018-04-18 to 2018-04-18
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 75 / 100
- Recency weight
- 44.60273973%
- Weighted credit term
- 33.45205479
- Same-claim backing date
- 2018-04-18 to 2018-04-18
Existing reviewed grade for the original scope; time intrinsic to that scope is retained.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
75,
75
]
},
"backingDateBounds": [
"2018-04-18",
"2018-04-18"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
75,
75
],
"weightBounds": [
0.44602739726027407,
0.44602739726027407
],
"normalizedBackingDateBounds": [
"2018-04-18",
"2018-04-18"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
75,
75
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Jensen Huang27 Mar 2018All future supercomputers and hyperscale data centers would use accelerated computing.
Fugaku completed shared-use deployment in 2021 without accelerators, contradicting the supercomputer universal under the post-issue completed-system reading.
OutcomeWrongDirectionRightMagnitudeOverestimatedTimingNo fixed deadline
2018-03-27
Further evidence: Accelerator adoption elsewhere continued. ARCHER2 adds CPU-only hardware selected in 2019, entering full service in December 2021. A small integrated GPU testbed appeared in 2024: a historical counterexample, not permanent accelerator absence. On the natural post-issue-system reading, one completed nonaccelerated supercomputer falsifies the intact conjunction. This does not assert the hyperscale branch is independently false. ARCHER2 strengthens the post-issue selection/completion reading, while the first conception date of every design element remains unknown.
Direction: Bounded continuation of accelerator adoption is supported by new HPC5 and Selene systems in the 2020 benchmark report. No claim that every new system or every data center follows that direction.
Magnitude: The universal scope is overstated. No population share, revenue or performance-growth magnitude is inferred.
Timing: No finite deadline to label late. The continuing universal rule has a documented post-issue counterexample by 2021. If the intended scope were only systems first designed after 2018 rather than future completed systems, this example alone would not resolve that alternative.
Scope: One paired, AI-adjacent infrastructure assertion, including generic HPC; not an NVIDIA-only or market-share claim. The hyperscale branch is not separately resolved. Fugaku development began in 2014, before issuance; completion and shared use were in March 2021. A design-after-2018 interpretation remains unresolved. Accelerator absence is operator-documented, not inferred from branding or silence. A64FX vector instructions and efficient CPUs do not automatically imply a separate accelerator under the source/operator distinction. New GPU-equipped HPC5 and Selene support adoption, not universality. The original is professionally attributed through Quartr/Stock Analysis, not independently audio-verified. No five-year deadline is borrowed from a different answer. Related H-C001 evidence is not independent validation; no current belief or later revision is inferred. ARCHER2’s post-issue procurement/completion does not establish when every design element was first conceived. Its operator deployment paper was inspected at abstract level; an earlier projected service date is not treated as actual completion. The 2024 GPU resource is a small testbed, not proof that the earlier CPU-only system was accelerated.
Evidence confidence: Moderate overall: operator hardware and completion evidence strong; original professionally attributed rather than audio-verified, and post-issue design-versus-deployment interpretation needs explicit qualification.
Draft formula inputs
No draft score: out of scope. No vote, not zero.
Paul Christiano24 Feb 2018Chart grade 75 / 100Actors would anticipate AGI and deliberately invest heavily in generality when useful, rather than encounter it only incidentally.
Microsoft announced $1 billion for OpenAI in July 2019.
OutcomePartly rightDirectionRightMagnitudePartly supportedTimingTiming unresolved
2018-02-24
Further evidence: The CMA verified over $13 billion invested by March 2025, including $10 billion in January 2023. Explicit AGI/generalization objectives distinguish this from generic AI advertising. Pre-2018 ambition and funding promises limit novelty; promised funding is not verified expenditure. Qualified deliberate-investment support, not the stronger causal reading.
Direction: Actual funding and stated AGI objectives match.
Magnitude: Heavy qualitative scale; no numeric threshold or global allocation claim.
Timing: Undated before/approaching-AGI horizon; no calendar timing hit.
Scope: Qualified institutional premise only. Adequate anticipation and the eventual development route remain unresolved; not AGI arrival, slow takeoff or GDP ordering. Affiliated OpenAI researcher; commercial motives coexist. Very low-information continuation of pre 2018 ambition/commitments; issuer affiliation and commercial motives retained. No calendar timing hit; stronger causal reading remains unresolved.
Shared evidence: One institutional forecast; investment examples are not independent successes.
Evidence confidence: High for verified actual investment and contemporaneously stated AGI/generalization objectives; moderate for the qualified institutional interpretation. Very low predictive information because substantial ambition and commitments predated issuance; no confidence claim about successful AGI or takeoff.
Current edition contribution · Paul Christiano
Graded credit: 75 / 100.
- Recency weight
- 65.89041095890411%
- Credit × weight endpoint products
- 49.417808219178085
- Last documented backing
- 2018-02-24 to 2018-02-24
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 75 / 100
- Recency weight
- 43.15068493%
- Weighted credit term
- 32.3630137
- Same-claim backing date
- 2018-02-24 to 2018-02-24
Existing reviewed grade for the original scope; time intrinsic to that scope is retained.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
75,
75
]
},
"backingDateBounds": [
"2018-02-24",
"2018-02-24"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
75,
75
],
"weightBounds": [
0.43150684931506844,
0.43150684931506844
],
"normalizedBackingDateBounds": [
"2018-02-24",
"2018-02-24"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
75,
75
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}François Chollet21 Feb 2018In the medium/long term, personalized assistants, including educational assistants, will become a major AI application.
Provider-reported mass conversational use, alongside separate tutoring and goal-setting studies, supports the qualified central practical-assistance trajectory.
OutcomePartly rightDirectionPartly rightMagnitudePartly supportedTimingNo fixed deadline
2018-02-21
Further evidence: Full life navigation remains unverified. Qualified central trajectory: useful conversational assistance became a major application; separately, actual tutoring and career-goal systems demonstrate meaningful personalization. The stronger general life-navigation reading is unresolved.
Direction: Practical assistance expanded beyond the earlier narrow assistant baseline.
Magnitude: Substantial overall usage and bounded goal-aware functionality are supported, but their joint population prevalence and durable benefit are not measured.
Timing: No exact deadline was supplied; no invented punctuality or latest-year date.
Scope: OpenAI’s September 2025 announcement reports 700 million weekly active users and automated analysis of 1.5 million consumer conversations. Three quarters concerned practical guidance, information seeking and writing. These mixed categories are not counts of personalized coaches or distinct people receiving life advice. Provider report only: the underlying paper and full sampling methods were not inspected; advice quality and durable goal attainment were not established. A March 2026 preregistered preprint randomized 517 employed US/UK adults; 323 were analyzed after 37.5% attrition/exclusions. Individual-background Claude coaching improved two-week self-reported goal progress versus no support (d=.33), but not significantly versus written reflection (d=.08). The written arm required minimum duration; no human-coach comparison was tested. Goal classifications used post hoc model coding. Not peer-reviewed; promised data/code were not inspected. Authors declared no competing interests. This is bounded goal assistance, not demonstrated career success. Provider studies document 9,129 actual tutoring users in six districts and responses adapted to prior skill mastery. Samples are local and selected, not population estimates; much interaction was passive. Near-transfer measures do not establish durable independent learning. A learning-history improvement interval crossed zero; cumulative improvements were not an AI-versus-no-AI comparison. A separate randomized Turkish high-school study found guarded tutoring improved assisted practice but showed no positive unassisted-exam benefit; unguarded access harmed later performance. Teacher guidance was built into that tutor. It is not a negative estimate for Khanmigo. Mass usage and small experiments do not jointly measure population-scale personalization. Full life navigation and precise original timing remain unverified.
Evidence confidence: Moderate for the central practical-assistance trajectory; low for full life-map breadth and population-level goal attainment.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Dario Amodei20 Feb 2018Chart grade 75 / 100Anticipates increasing attempts to use AI maliciously alongside its wider adoption.
Microsoft reports accelerating observed AI use by state actors in 2024–2025, including increased influence activity.
OutcomePartly rightDirectionRightMagnitudeNot quantifiedTimingNo fixed deadline
2018-02-20
Further evidence: OpenAI documents over 40 disrupted networks since February 2024 across multiple abuse categories; that cumulative number is not a growth-rate estimate. Actual use and expanding observed adoption support the broad forecast, but selected-provider surveillance is not a census of worldwide malicious AI use.
Direction: Microsoft explicitly reports accelerating adoption and a first-half-2025 increase in observed influence activity; OpenAI confirms multiple realized abuse categories.
Magnitude: No numerical growth rate or relative share was forecast. No operation counts are converted into total population estimates.
Timing: Strategic analysis is explicitly medium-term (5+ years), without a terminal adoption deadline. The report’s separate five-year technology plausibility window is not converted into a fixed deadline for every abuse.
Evidence confidence: Moderate: direct threat-investigator observations, incomplete visibility and detection-change confounding.
Current edition contribution · Dario Amodei
Graded credit: 75 / 100.
- Recency weight
- 65.82465753424657%
- Credit × weight endpoint products
- 49.36849315068493
- Last documented backing
- 2018-02-20 to 2018-02-20
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 75 / 100
- Recency weight
- 43.04109589%
- Weighted credit term
- 32.28082192
- Same-claim backing date
- 2018-02-20 to 2018-02-20
Existing reviewed grade for the original scope; time intrinsic to that scope is retained.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
75,
75
]
},
"backingDateBounds": [
"2018-02-20",
"2018-02-20"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
75,
75
],
"weightBounds": [
0.4304109589041095,
0.4304109589041095
],
"normalizedBackingDateBounds": [
"2018-02-20",
"2018-02-20"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
75,
75
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Dario Amodei20 Feb 2018Chart grade 100 / 100Jointly expects increasing restrictions on access to or malicious use of powerful AI.
China imposed deep-synthesis service restrictions effective January 2023; EU prohibited AI practices began applying in February 2025.
OutcomeRightDirectionRightMagnitudeNot quantifiedTimingNo fixed deadline
2018-02-20 arXiv v1; report dated February 2018
Further evidence: These are concrete post-forecast restrictions, with important jurisdictional and enforcement limits. The modest expectation that AI access or misuse would face increasing formal restrictions was realized in multiple major jurisdictions.
Direction: AI-specific use constraints increased after the 2018 report.
Magnitude: No number of jurisdictions, uniform coverage, or effectiveness target was specified.
Timing: The forecast sits in a medium-term five-plus-year analysis. It gives no terminal deadline; the separate five-year conditional threat statement is not imported.
Evidence confidence: High for the existence of these restrictions; moderate for attribution of the broad joint expectation.
Current edition contribution · Dario Amodei
Graded credit: 100 / 100.
- Recency weight
- 65.82465753424657%
- Credit × weight endpoint products
- 65.82465753424657
- Last documented backing
- 2018-02-20 to 2018-02-20
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 100 / 100
- Recency weight
- 43.04109589%
- Weighted credit term
- 43.04109589
- Same-claim backing date
- 2018-02-20 to 2018-02-20
Existing reviewed grade for the original scope; time intrinsic to that scope is retained.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
100,
100
]
},
"backingDateBounds": [
"2018-02-20",
"2018-02-20"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
100,
100
],
"weightBounds": [
0.4304109589041095,
0.4304109589041095
],
"normalizedBackingDateBounds": [
"2018-02-20",
"2018-02-20"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
100,
100
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Demis HassabisFeb–Nov 2018 · rangeRL approaches deep learning’s prominence over the following few years.
OpenAI’s 2019 robot hand used an external move solver and specialized sensing; success was limited and training costly. Whole outcome unresolved.
OutcomeUnresolvedDirectionPartly rightMagnitudeUnresolvedTimingTiming unresolved
2018
Further evidence: Paper and blog report the same experiment. A 2020 report described operational balloon control; Loon closed in 2021, without commercial viability. InstructGPT in 2022 combined RLHF, pretraining and supervised demonstrations for customer use; factual/safety failures persisted. Full comparative target unresolved.
Direction: Non-game applications, not mere existence, support bounded expansion.
Magnitude: No parity metric or representative denominator; no quantified equivalence inferred.
Timing: Few-years horizon; no exact endpoint or full timing success inferred.
Scope: RL and deep learning overlap. February–August interview; November publication; exact day unknown. OpenAI supplies the robot and language examples; these are not independent organizations. Google Brain/Loon shares Alphabet ownership with DeepMind. The balloon account is abstract-level plus affiliated review, not recovered full methods. Corporate reports and shared studies are not independent replication or a field census. This is not evidence of general robotics or independent puzzle reasoning. RLHF does not alone establish AGI sufficiency. No market-share, investment, compute or scientific-importance parity is inferred.
Evidence confidence: Moderate on bounded direction; full relative prominence unresolved.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Yann LeCunFeb 2018 · rangeWithin ten years, deploy autonomous cars and new driving assistance that improves road safety.
Driverless and AI-assisted driving deployed by 2020–2023.
OutcomePartly rightDirectionRightMagnitudePartly matched scopeTimingWithin original window
2018-02; URL dates article February 15, heading February 2018
Further evidence: Separate Waymo safety comparisons are bounded; the same consumer-assistance safety gain is unverified. Postissue deployment supported; broader safety remains unproven.
Direction: Deployment beyond research.
Magnitude: No numerical adoption target was stated. Bounded by vehicle, geography and function. Comparative safety is supported for Waymo liability claims, but no matched net crash-reduction estimate was recovered for the newly deployed Zeekr system; older partial-automation evidence is cautionary.
Timing: Central deployments fit the decade. Whole-scope safety timing remains unresolved; 2028 endpoint still open.
Evidence confidence: Moderate for central deployment; safety evidence is bounded and does not establish an incremental crash benefit for the same new consumer-assistance system.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Yoshua Bengio2018 · uncertainVirtual-world agents make a major long-run contribution to grounded language.
BabyAI 1.1 (2020), coauthored by Bengio, learned language-conditioned policies in a mostly symbolic gridworld.
OutcomePartly rightDirectionRightMagnitudePartly supportedTimingNo fixed deadline
2018
Further evidence: A separate 2026 team learned language representations from behavior, without pretrained language weights; all 108 synthetic instructions appeared in training, and vision partly used pretrained features. GLAM (2023) adapted pretrained language through rewards and reversed action meanings; text-only tests showed weak synonym/compositional generalization. ALFWorld (2020–2021) aligned text/visual environments; pretrained embeddings, supervised perception and a prebuilt map contributed. Unseen embodied success remained low. ReAct (2022) reused that benchmark; Reflexion (2023) added feedback-derived memories with fixed language weights. This is method uptake, not perceptual language acquisition. SIMA showed meaningful grounded instruction-following and transfer, still below expert humans. Mechanism evidence and concrete subsequent use support qualified approximate credit, not a fieldwide verdict.
Direction: Acquisition, benchmark uptake and visual transfer are distinct evidence, not pooled trials.
Magnitude: Several substantive contributions; no field dominance, quantified progress share or general human-like acquisition established. Universal generalization is not required.
Timing: No deadline hit, miss, lateness or first-attainment credit.
Scope: Qualified research contribution; stronger substantial fieldwide impact remains unresolved. Bengio coauthored BabyAI’s platform; the later team is external, not a separate forecast. ReAct–Reflexion authors overlap; Reflexion’s 130/134 is cumulative over 12 attempts, not first-pass. SIMA uses human demonstrations; its language ablation is not a historical baseline and its expert comparison is task-specific. No pooled success rates, causal credit for unrelated gains, deployment or universal understanding. Original verbatim unavailable; retained context review reused.
Evidence confidence: Moderate for qualified research contribution; impact magnitude is qualitative and broader language understanding remains unresolved.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Yann LeCun2018 · uncertainChart grade 75 / 100Specialized chips spread consumer AI within two or three years.
On-device-AI engines reached approximately half of global smartphone-processor shipments by 2019, up from roughly a third in 2018.
OutcomePartly rightDirectionRightMagnitudePartly matched scopeTimingWithin original window
2018
Further evidence: The previously verified 2020 vacuum supplies a functional non-phone consumer example. The new primary market estimate establishes mass diffusion in smartphone processors, while the already adopted 2020 retail vacuum test demonstrates functional on-device vision outside phones.
Direction: Observed neural consumer applications align with this mechanism, with stronger diffusion evidence.
Magnitude: Approximately 31% of global smartphone AP shipments in 2018 versus nearly 51% in 2019 had on-device AI engines, according to the market-research provider. This is substantial flow, not installed ownership or use, and does not cover all consumer categories. Keep partial scope rather than an invented global adoption fraction.
Timing: 2019 market observations and the August 2020 retail vacuum test precede every possible 2018 interview plus three-year endpoint. This supports approximate timing for central availability, not a full timestamped realization of all examples. Early realization is permitted because the phrase is not a temporal lower bound.
Scope: Annual smartphone-processor shipments, not installed users or all device categories. Mower, exact price/power and uniform neural-ASIC classification remain unverified. Approximate central availability, not universal ownership or every device example.
Evidence confidence: Moderate for central broad availability; market-provider estimate plus actual retail behavior. Whole example set and exact hardware classification remain incomplete.
Current edition contribution · Yann LeCun
Graded credit: 75 / 100.
- Recency weight
- 65.5123287671233–68.98082191780821%
- Credit × weight endpoint products
- 49.13424657534247–51.73561643835616
- Last documented backing
- 2018-02-01 to 2018-08-31
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 75 / 100
- Recency weight
- 42.52054795–48.30136986%
- Weighted credit term
- 31.89041096–36.2260274
- Same-claim backing date
- 2018-02-01 to 2018-08-31
Existing reviewed grade for the original scope; time intrinsic to that scope is retained.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
75,
75
]
},
"backingDateBounds": [
"2018-02-01",
"2018-08-31"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
75,
75
],
"weightBounds": [
0.4252054794520548,
0.4830136986301369
],
"normalizedBackingDateBounds": [
"2018-02-01",
"2018-08-31"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
75,
75
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Rodney Brooks1 Jan 2018Chart grade 75 / 100Popular-press stories will frame the deep-learning era as over by 2020.
Futurism published an era-ending frame in January 2019, but described an approaching rather than completed end.
OutcomePartly rightDirectionPartly rightMagnitudeNot quantifiedTimingWithin original window
2018-01-01
Further evidence: Approximate public-discourse match only; wording deficit prevents a clean hit.
Direction: The anticipated era-ending press framing appeared.
Magnitude: No numerical prevalence threshold was specified; one occurrence does not show consensus.
Timing: The supporting occurrence is within the original end-2020 window.
Evidence confidence: moderate; public-science outlet and impending-versus-completed ending limits
Current edition contribution · Rodney Brooks
Graded credit: 75 / 100.
- Recency weight
- 65.0027397260274%
- Credit × weight endpoint products
- 48.752054794520554
- Last documented backing
- 2018-01-01 to 2018-01-01
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 75 / 100
- Recency weight
- 41.67123288%
- Weighted credit term
- 31.25342466
- Same-claim backing date
- 2018-01-01 to 2018-01-01
Existing reviewed grade for the original scope; time intrinsic to that scope is retained.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
75,
75
]
},
"backingDateBounds": [
"2018-01-01",
"2018-01-01"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
75,
75
],
"weightBounds": [
0.4167123287671233,
0.4167123287671233
],
"normalizedBackingDateBounds": [
"2018-01-01",
"2018-01-01"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
75,
75
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Rodney Brooks1 Jan 2018Chart grade 75 / 100The first dedicated public-freeway lane restricted to truly driverless cars would not occur before 2021.
Contemporaneous US and Chinese projects remained in planning/construction; the most concrete pre 2021 European lane example was a human-driven research demonstration.
OutcomePartly rightDirectionNot applicableMagnitudeNot applicableTimingCorrect lower bound
2018-01-01
Further evidence: Combined evidence supports the pre 2021 negative lower bound, not the eventual first-event date. Qualified support for absence of qualifying operational deployment through 2020 from contemporaneous international project reports and official first-deployment assessments. This is an evidence-based historical inference, not exhaustive proof.
Direction: The assessable claim is a timing lower bound; no separate ultimate-capability direction credited.
Magnitude: No adoption magnitude was specified in this row.
Timing: The NET 2021 boundary is supported at moderate confidence. Subsequent nonarrival does not count as a miss or establish eventual onset.
Scope: Only the not-before 2021 lower bound is assessed. Moderate-confidence international status inference, not an exhaustive global census; planning, construction and human-driven demonstrations are not qualifying operations.
Evidence confidence: Moderate: positive historical status evidence in several leading regions, including explicit contemporary global absence assertion, but no comprehensive lane census.
Current edition contribution · Rodney Brooks
Graded credit: 75 / 100.
- Recency weight
- 65.0027397260274%
- Credit × weight endpoint products
- 48.752054794520554
- Last documented backing
- 2018-01-01 to 2018-01-01
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 75 / 100
- Recency weight
- 41.67123288%
- Weighted credit term
- 31.25342466
- Same-claim backing date
- 2018-01-01 to 2018-01-01
Existing reviewed grade for the original scope; time intrinsic to that scope is retained.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
75,
75
]
},
"backingDateBounds": [
"2018-01-01",
"2018-01-01"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
75,
75
],
"weightBounds": [
0.4167123287671233,
0.4167123287671233
],
"normalizedBackingDateBounds": [
"2018-01-01",
"2018-01-01"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
75,
75
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Rodney Brooks1 Jan 2018Chart grade 75 / 100Cooperative, reduced-spacing driverless-only freeway lanes permitting higher speeds than human drivers would not arrive before 2024.
Actual pre 2024 cooperative lane/platooning projects were substantial demonstrations or driver-assist deployments, not the entire business-use milestone.
OutcomePartly rightDirectionNot applicableMagnitudeNot applicableTimingCorrect lower bound
2018-01-01
Further evidence: Michigan’s relevant pilot began only in 2024. Qualified historical evidence supports absence of the full conjunction through 2023. Closest concrete projects remained trials, retained drivers, or had not opened. Evidence is regional/project-based, not exhaustive global proof.
Direction: No separate ultimate-arrival direction credited.
Magnitude: Higher speed and reduced spacing are qualitative event predicates, not a separately graded numerical magnitude.
Timing: The pre 2024 exclusion is moderately supported, not an onset forecast for 2024 or a guarantee of later arrival.
Scope: Only the mature temporal lower bound is assessed. Real cooperative-lane and platooning trials are acknowledged; they do not establish the complete business-use, driverless-only, higher-than-human-permitted-speed conjunction. Strongly dependent on RB-C007, not independent statistical evidence.
Evidence confidence: Moderate historical inference; global negative and first-person conference-text fidelity limitations remain visible.
Current edition contribution · Rodney Brooks
Graded credit: 75 / 100.
- Recency weight
- 65.0027397260274%
- Credit × weight endpoint products
- 48.752054794520554
- Last documented backing
- 2018-01-01 to 2018-01-01
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 75 / 100
- Recency weight
- 41.67123288%
- Weighted credit term
- 31.25342466
- Same-claim backing date
- 2018-01-01 to 2018-01-01
Existing reviewed grade for the original scope; time intrinsic to that scope is retained.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
75,
75
]
},
"backingDateBounds": [
"2018-01-01",
"2018-01-01"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
75,
75
],
"weightBounds": [
0.4167123287671233,
0.4167123287671233
],
"normalizedBackingDateBounds": [
"2018-01-01",
"2018-01-01"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
75,
75
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Rodney Brooks1 Jan 2018Chart grade 75 / 100Specified mixed driver/driverless taxi service in ten major US cities: not before 2025.
Leading operators remained concentrated in a few public markets before 2025.
OutcomePartly rightDirectionNot applicableMagnitudePartly supportedTimingCorrect lower bound
2018-01-01
Further evidence: This supports the lower bound under a market reading, not a profitability finding. Contemporaneous leading-operator records and an independent government overview support fewer than ten major city markets before 2025 even for broader driverless passenger services. This is a qualified historical coverage inference, not an exhaustive nationwide census or a proof from company losses.
Direction: No independent capability or ultimate-arrival direction credited.
Magnitude: The ten-city necessary threshold appears unachieved under the major-market reading. No exact national municipality total is asserted; incorporation boundaries and the undefined word major remain sensitivity limits.
Timing: NET 2025 excludes qualifying attainment through 2024. It is not a promise of delivery during or by 2025; subsequent expansion neither resets nor falsifies this lower bound.
Scope: Major-city market interpretation; municipality counts remain unresolved. Dedicated stops, weather/time restrictions, mixed driving and viable-business context remain; the broader ten-market test does not establish the narrower service or profitability.
Evidence confidence: Moderate, conditional on ordinary major-city market interpretation. Exact municipal coverage and exhaustive minor-provider census are not established.
Current edition contribution · Rodney Brooks
Graded credit: 75 / 100.
- Recency weight
- 65.0027397260274%
- Credit × weight endpoint products
- 48.752054794520554
- Last documented backing
- 2018-01-01 to 2018-01-01
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 75 / 100
- Recency weight
- 41.67123288%
- Weighted credit term
- 31.25342466
- Same-claim backing date
- 2018-01-01 to 2018-01-01
Existing reviewed grade for the original scope; time intrinsic to that scope is retained.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
75,
75
]
},
"backingDateBounds": [
"2018-01-01",
"2018-01-01"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
75,
75
],
"weightBounds": [
0.4167123287671233,
0.4167123287671233
],
"normalizedBackingDateBounds": [
"2018-01-01",
"2018-01-01"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
75,
75
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Jensen Huang16 Nov 2017Chart grade 75 / 100Over several years, networks increasingly design networks.
MnasNet used a recurrent neural controller to design mobile vision networks in 2018.
OutcomePartly rightDirectionRightMagnitudeUnresolvedTimingWithin original window
2017-11-16 publication; interview day unspecified
Further evidence: EfficientNet reused that search framework for its 2019 baseline; ENAS separately reported controller-designed networks in 2018. Technical mechanism demonstrated, with human engineering still required.
Direction: Multiple subsequent architecture-search implementations support progress.
Magnitude: Prevalence unmeasured.
Timing: Component demonstrated within the stated horizon.
Scope: Human search spaces, objectives and validation remain essential. Related research lines are not independent successes.
Evidence confidence: Moderate; specific research evidence is stronger than prevalence evidence.
Current edition contribution · Jensen Huang
Graded credit: 75 / 100.
- Recency weight
- 64.24657534246576%
- Credit × weight endpoint products
- 48.184931506849324
- Last documented backing
- 2017-11-16 to 2017-11-16
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 75 / 100
- Recency weight
- 40.4109589%
- Weighted credit term
- 30.30821918
- Same-claim backing date
- 2017-11-16 to 2017-11-16
Existing reviewed grade for the original scope; time intrinsic to that scope is retained.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
75,
75
]
},
"backingDateBounds": [
"2017-11-16",
"2017-11-16"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
75,
75
],
"weightBounds": [
0.40410958904109595,
0.40410958904109595
],
"normalizedBackingDateBounds": [
"2017-11-16",
"2017-11-16"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
75,
75
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Jensen Huang26 Oct 2017Road autonomy within four years, while leaving majority-fleet adoption timing open.
Waymo documented limited fully driverless rider trips by December 2018 and broader access, unlike supervised service.
OutcomeRightDirectionNot separately gradedMagnitudeNot quantifiedTimingWithin original window
2017-10-26
Original horizon: 2021-10-26
Further evidence: October 2015 demonstration, reported retrospectively. Actual restricted road operation matches the target; universal personal-car availability and majority adoption were not promised.
Direction: Not separately graded in the historical record.
Magnitude: No separately documented rationale is available.
Timing: Service fits; pre-issue demonstration.
Scope: Operator-reported, geographically/weather-limited, not independently safety-validated. Remote architecture unaudited; assistance need not mean driving. Exact first attainment and exceptional foresight unestablished. Demonstration day and preforecast public disclosure unverified; no global-first or private-knowledge inference. The original is a contemporaneous Reuters report, not a complete audiovisual record.
Evidence confidence: Not separately rated.
Later statement: 2018-01-08 (Related broader scope; inferred interview date): All-condition driving: five to ten years. Published 2018-01-09. The narrower 2017 target is unchanged; this formulation is not adjudicated. No ten-year lower bound, new timing verdict/count, or current-belief inference.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Eliezer Yudkowsky13 Oct 2017AGI timelines remain murky despite further breakthroughs.
The 2023 AI-researcher survey retained wide timing distributions despite a large earlier shift in its aggregate estimate. Whole outcome unresolved.
OutcomeUnresolvedDirectionRightMagnitudeUnresolvedTimingNo fixed deadline
2017-10-13
Further evidence: The 2026 report still treats capability-emergence timing as unreliable. This supports observed uncertainty, not fulfillment through the original endpoint; the whole duration remains unresolved.
Direction: Breakthroughs did not settle an agreed arrival date.
Magnitude: No fixed uncertainty threshold; estimates changed substantially.
Timing: No calendar arrival date is forecast. Observed persistence supplies diagnostic support only, not resolved whole-content or independent timing credit; the original endpoint remains open.
Evidence confidence: Moderate for observed persistence; full endpoint and exact uncertainty magnitude unresolved.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Eliezer Yudkowsky13 Oct 2017Previously achieved ML feats tend to become easier within a few years as tools improve.
For the same ImageNet accuracy target, DAWNBench lists training cost falling from $1,112.64 in October 2017 to $7.43 in March 2020, with different hardware, models and frameworks.
OutcomePartly rightDirectionRightMagnitudePartly supportedTimingWithin original window
2017-10-13
Further evidence: Matched benchmark progress supports lower resource barriers, but does not directly measure all reproduction labor.
Direction: Established tasks became cheaper and faster.
Magnitude: Large cost reduction supports easier access; the full labor-ease framing remains unmeasured.
Timing: The matched examples fall within the qualitative few-year horizon; no exact deadline invented.
Evidence confidence: moderate; matched benchmark evidence, not a representative census of every ML task
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Yoshua Bengio13 Sep 2017Chart grade 75 / 100A large deep-learning application/improvement wave within five years.
By 2022, deployed/evaluated applications covered translation, accessibility, security, graphics, support, speech, imaging and advertising.
OutcomePartly rightDirectionRightMagnitudePartly supportedTimingWithin original window
13 September 2017 publication; 28 September update; interview day and wording changes unknown
Further evidence: Cross-vendor/domain deployment approximately supports a substantial wave, not uniform transformation.
Direction: Applications and improvements expanded.
Magnitude: Survey averages rose from 1.9 to 3.8 AI capabilities, not a deep-learning application count or objective wave threshold.
Timing: Core deployments and May/August 2022 observations precede either September endpoint; December survey publication is later. No post-window ChatGPT credit.
Scope: Selected developer evidence, not a population census. Element AI affiliation, not its roadmap. Prior deployment limits novelty. No broad translation parity; captions/voices language/device-limited. Security covers selected files alongside other defenses. DLSS implementations share one technology; experimental/future releases excluded. Uber’s randomized company trial concerns human assistance with retraining, not promised savings/autonomy. Selected Alibaba ads include worse cases, not industry-wide returns. GE’s patient total is unaudited; pending expansions and radiologist replacement excluded. Survey self-reports broader AI including RPA, with changing definitions, not a same-company panel or clean 20-to-50% comparison. Adoption plateaued; the high-performing share did not expand. Industrial adoption remained uneven.
Evidence confidence: Moderate, selected cross-vendor production evidence and qualitative breadth, not representative population census.
Current edition contribution · Yoshua Bengio
Graded credit: 75 / 100.
- Recency weight
- 63.194520547945196%
- Credit × weight endpoint products
- 47.3958904109589
- Last documented backing
- 2017-09-13 to 2017-09-13
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 75 / 100
- Recency weight
- 38.65753425%
- Weighted credit term
- 28.99315068
- Same-claim backing date
- 2017-09-13 to 2017-09-13
Existing reviewed grade for the original scope; time intrinsic to that scope is retained.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
75,
75
]
},
"backingDateBounds": [
"2017-09-13",
"2017-09-13"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
75,
75
],
"weightBounds": [
0.3865753424657533,
0.3865753424657533
],
"normalizedBackingDateBounds": [
"2017-09-13",
"2017-09-13"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
75,
75
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Stuart Russell28 Jul 2017Likely college-level language understanding within a decade of 2017.
Before 2027, studies support functional comprehension, not universal equivalence.
OutcomePartly rightDirectionPartly rightMagnitudePartly supportedTimingWithin original window
28 July 2017 publication; exact speaking day unknown
Further evidence: Qualified functional reading; college-level/multilingual breadth unproved.
Direction: Substantial comprehension; no per-study/model forecast multiplication.
Magnitude: Task support, not education-matched equivalence.
Timing: Before approximate July 2027; universal completion undated, endpoint open.
Scope: The currently served licensed AP report attributes the threshold and decade to Russell; immutable original wording and speaking day are unverified. No numerical probability, test battery or language list was specified. Functional comprehension, not consciousness, AGI or identical internal representations. Reading all human writings across languages is a stronger consequence, not another dated prediction. February 2025 report, March–May 2024 tests: 82/88 (hedges wrong) versus 40 historical adults’ 93.05%. Grade 5–6 texts and 14 harder public LSAT questions, small samples, contamination and unmatched summaries/inferences limit college-equivalence; vendor scores remain dependent. A June 2025 dialogue study tested models in August/December 2023 and human cohorts in 2023/2025. It used 20 new English conversations and open responses: GPT-4 averaged 4.80/5, versus 2.80 and 2.34 in cohorts totaling 147 people. Only 47% of the first cohort were students; the second was an age-diverse native-English group. Nonrandom sampling, researcher ratings, retained context and different testing conditions prevent a population-superiority claim. A preregistered May 2025 puzzle replication found 73.0% human accuracy without rereading and 85.2% with it among 120 adults; GPT-4 scored 81% and an inconsistently named o1-family model 100%. Narrow English stimuli, prompts and coding/presentation choices matter; no reliability estimate is inferred. November 2025 WavelengthEval assessed 100 problems from 50 concept pairs, with 40 human judgments per problem and 708 people overall. Leading models, including GPT-4.1, approached mean human comprehension and correlated above 0.9 with judgments. English commonsense game tasks, 32 API samples, differing judgment distributions and weaker production limit transfer; this is not an entire curriculum. A February 2026 test used 480 native speakers, 40 coordinated-sentence scenarios and 12 languages. GPT-4o, Grok3 and DeepSeekV3 generally trailed humans; exceptions were GPT-4o in Spanish and DeepSeekV3 in Italian. GPT-4o scored 0.82 versus 0.94 in English and 0.59 versus 0.98 in Japanese. Default settings, one-word answers and uncertainty counted wrong bound this material counterevidence: neither every system nor all language competence was tested.
Shared evidence: Related language-assistant forecasts remain separate; this capability threshold and decade window form one forecast, not one per study or language.
Evidence confidence: Moderate for a qualified functional central outcome; lower for population-level college equivalence and multilingual breadth.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
François Chollet18 Jul 2017Chart grade 75 / 100Neural program synthesis will gain interest and develop learned algorithmic/geometric hybrids.
HOUDINI (2018) learned neural/algorithmic architectures; DreamCoder (2020) learned symbolic libraries with neural guidance.
OutcomePartly rightDirectionPartly rightMagnitudePartly supportedTimingTiming unresolved
2017-07-18
Further evidence: EPB (2026) adds co-evolved heuristic banks, capacity and neural routing. Qualified central learned-hybrid realization; interest alone is insufficient.
Direction: Concrete learned construction supports the crossover trajectory.
Magnitude: Bounded mechanisms and uneven research activity, not field dominance.
Timing: Early evidence fits near-years research; full-profile completion unresolved. EPB is later corroboration, not an on-time result or reset.
Scope: The near-years crossover expectation and separately labeled long-term vision stay in one record. If the entire global-library, human-like extreme-generalization and comparative-tractability/usefulness profile versus direct source-code synthesis is required jointly, full content remains unresolved, not wrong. Human-designed learning frameworks do not disqualify learned model structure. HOUDINI uses supplied combinators and designed tasks; frozen modules, branching and task-sequence coverage limit inference. Developer experiments are not independent replication; reviews concern submissions, not final-paper numbers. The survey samples selected 2016–2020 conferences, excluding repair, completion and compilation; overlapping guidance categories include non-neural methods. It provides no all-AI denominator. Antecedents limit novelty; related hybrid/library statements are not separate successes. EPB is an under-review developer preprint using supplied teachers/interfaces and selected routing tasks; cross-size transfer is mixed, broader task-family transfer untested, code prospective and independent replication uninspected. Earlier direction-only and whole-vision holds remain historical; this explicitly corrects the preferred scope interpretation.
Evidence confidence: Moderate for the qualified central learned-hybrid mechanism; lower for the size of the research wave and full architecture/generalization vision. Developer evaluations, selected tasks, antecedents and contrary results remain material.
Current edition contribution · François Chollet
Graded credit: 75 / 100.
- Recency weight
- 62.25753424657534%
- Credit × weight endpoint products
- 46.6931506849315
- Last documented backing
- 2017-07-18 to 2017-07-18
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 75 / 100
- Recency weight
- 37.09589041%
- Weighted credit term
- 27.82191781
- Same-claim backing date
- 2017-07-18 to 2017-07-18
Existing reviewed grade for the original scope; time intrinsic to that scope is retained.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
75,
75
]
},
"backingDateBounds": [
"2017-07-18",
"2017-07-18"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
75,
75
],
"weightBounds": [
0.370958904109589,
0.370958904109589
],
"normalizedBackingDateBounds": [
"2017-07-18",
"2017-07-18"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
75,
75
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Ilya Sutskever12 Jul 2017AI should within three years completely solve robotics, prove a longstanding unproven theorem, win programming competitions consistently, and produce convincing chatbots—but not pass a Turing test.
Qualified whole-basket miss: the conventional contest-win conjunct is assessed as unmet.
OutcomeMostly wrongDirectionUnresolvedMagnitudeUnresolvedTimingOriginal window missed
12 July 2017 email, reproduced 13 December 2024
Origin: Private email at issuance; later published by a party to the dispute. Independent authentication is incomplete.
Original horizon: 12 July 2020; three years from the email, not publication.
Further evidence: Progress and later first-competitive-system reporting support a limited historical inference, not universal absence.
Direction: Whole-basket direction unjudgeable.
Magnitude: Whole-basket magnitude unjudgeable.
Timing: Qualified original-window miss; eventual full-basket realization unverified.
Limits: Ordinary human-contest reading; specialized or assisted contests remain alternatives. One basket, no component votes; other components unadjudicated.
History: 2019–2020 scaffolded progress and later 2021–2022 corroboration are not an exhaustive 2020 census.
Evidence confidence: Moderate; interested-party reproduction, selective context, redactions and independent-authentication limits.
Draft formula inputs
Not in this 424-record calculation edition. No score assigned here.
Andrew NgJun 2017 · rangeIf AI keeps evolving rapidly, as Ng expects over the next several years, business AI talent will remain scarce.
The 2019 talent report still described shortages despite specialist growth.
OutcomeRightDirectionRightMagnitudeNot quantifiedTimingWithin original window
5 June 2017 publication; 6 June update; interview date unknown.
Original horizon: The next several years; no exact endpoint stated.
Further evidence: In 2022, respondents generally found AI hiring difficult and no easier. Together these support persistent scarcity, not a worldwide vacancy census.
Direction: Scarcity persisted rather than disappearing.
Magnitude: No numerical shortage, headcount or vacancy ratio was predicted.
Timing: The 2019 and May/August 2022 observations cover following years. No exact endpoint, first-attainment date or numerical timing error is inferred.
Scope: Conditional on continuing rapid AI evolution. A continuation forecast with low novelty, not an isolated causal test. Employer self-report and industry assessment have limited coverage. The 2019 source is shared with Lee’s different talent forecast, not independent replication.
Evidence confidence: Moderate: employer self-report and an industry researcher assessment, with scope matching but no universal census.
Draft formula inputs
Not in this 424-record calculation edition. No score assigned here.
Kai-Fu Lee16 May 2017For the next ten years, AI cannot participate in sophisticated cross-domain writing about societal meaning and implications.
Goldstein’s August 2026 political-philosophy article connects institutions, economics and inequality.
OutcomeMostly wrongDirectionMostly wrongMagnitudeUnderestimated capabilityTimingIncorrect lower bound
16 May 2017 publication; interview date unknown. Attributed reporting, not authenticated audio.
Further evidence: Its acknowledgment credits AI model-extension choices and nearly all prose. Goldstein supplied the thesis, theoretical framework and extensive direction: substantive collaboration, not merely stylistic rewriting. Bounded substantive participation contradicts the exclusion; stronger autonomy remains unresolved.
Direction: Collaborative contribution was underestimated.
Magnitude: Human conception, selection and correction constrain the contribution.
Timing: August 2026 precedes the approximate 2017–2027 ceiling; first attainment unknown.
Scope: Guerrero criticized significance, assumptions, formalism and prose; Goldstein admitted misclassification and weak prose. Publication establishes neither correctness nor consensus. Autonomous reliable deep authorship remains unresolved. The undated, version-unpinned methods report is model-drafted and author-approved; dated article/account anchor chronology. Critical comments’ exact dates are unknown.
Shared evidence: Article, author accounts and methods report are dependent evidence.
Evidence confidence: Moderate for a bounded counterexample to no participation; lower for independent contribution auditing and reliable autonomous depth.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Jensen Huang5 May 2017Chart grade 75 / 100Expects substantial cybernetics, robotics and AI-augmentation advances over the next few years.
2021 experiments improved learned text entry and feedback-assisted robotic manipulation.
OutcomePartly rightDirectionRightMagnitudePartly matched scopeTimingTiming unresolved
2017-05-05 publication; exact interview date unknown
Further evidence: One-participant results followed earlier BCI work; imperfect sensation and home-use limitations remain. One narrow capability area is evidenced; no field-wide census.
Direction: Observed communication-speed and manipulation gains.
Magnitude: Within-task changes, not a population or field-wide measure.
Timing: Public reports appeared in 2021; study dates and punctuality are unresolved.
Scope: AI-adjacent; narrow experiments, not general cognitive enhancement or routine clinical deployment. Low-information continuation, not unique foresight.
Evidence confidence: Moderate for bounded qualitative outcome; lower for field breadth and exact timing.
Current edition contribution · Jensen Huang
Graded credit: 75 / 100.
- Recency weight
- 61.04109589041096%
- Credit × weight endpoint products
- 45.78082191780822
- Last documented backing
- 2017-05-05 to 2017-05-05
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 75 / 100
- Recency weight
- 35.06849315%
- Weighted credit term
- 26.30136986
- Same-claim backing date
- 2017-05-05 to 2017-05-05
Existing reviewed grade for the original scope; time intrinsic to that scope is retained.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
75,
75
]
},
"backingDateBounds": [
"2017-05-05",
"2017-05-05"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
75,
75
],
"weightBounds": [
0.3506849315068492,
0.3506849315068492
],
"normalizedBackingDateBounds": [
"2017-05-05",
"2017-05-05"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
75,
75
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Yoshua Bengio3 May 2017Chart grade 75 / 100Over the next few years, deep-learning tools inform doctors rather than replace them, at least in countries like Canada.
2018–2021 clinical deployment retained physicians’ diagnosis/treatment roles.
OutcomePartly rightDirectionRightMagnitudePartly supportedTimingWithin original window
2017-05-03
Further evidence: Autonomous retinal screening did replace specialist interpretation for one task, retaining referral and wider care. Qualified augmentation supported; literal zero substitution challenged.
Direction: Clinical information/triage assistance developed.
Magnitude: No all-field or Canada-specific predominance measured.
Timing: Dated continuation within an ordinary few-year reading; no exact endpoint or first-invention credit.
Scope: Principally US evidence; comparable-system transfer is interpretive. Regulatory availability is not adoption or market share; not all inventoried devices use deep learning. Viz reports share one platform and commercial ties: small nonrandomized/bundled studies do not establish causal clinical benefit. Retinal evidence has institutional/commercial ties. No universal safety, preserved employment or permanent nonreplacement inferred. The original already mentioned an affiliated imaging company, limiting novelty. Literal full-field/Canada-only readings remain unresolved alternatives.
Shared evidence: Related application forecasts and same-platform reports are not independent evidence.
Evidence confidence: Moderate for bounded physician-retaining deployment; lower for broad predominance and geography.
Current edition contribution · Yoshua Bengio
Graded credit: 75 / 100.
- Recency weight
- 61.00821917808219%
- Credit × weight endpoint products
- 45.75616438356164
- Last documented backing
- 2017-05-03 to 2017-05-03
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 75 / 100
- Recency weight
- 35.01369863%
- Weighted credit term
- 26.26027397
- Same-claim backing date
- 2017-05-03 to 2017-05-03
Existing reviewed grade for the original scope; time intrinsic to that scope is retained.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
75,
75
]
},
"backingDateBounds": [
"2017-05-03",
"2017-05-03"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
75,
75
],
"weightBounds": [
0.3501369863013698,
0.3501369863013698
],
"normalizedBackingDateBounds": [
"2017-05-03",
"2017-05-03"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
75,
75
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Kai-Fu Lee12 Apr 2017Chart grade 75 / 100Within five years from April 2017, many world-class AI enterprises emerge in China.
Horizon: 2021 real-time 3D-detection leadership plus same-firm production.
OutcomePartly rightDirectionRightMagnitudePartly supportedTimingWithin original window
2017-04-12
Further evidence: Momenta/Oxford: joint classification result dated only 2017; Momenta’s pilot: 2021. WeRide: supervised 2021 foreign trial, not comparative parity. Qualified enterprise maturation; Horizon strongest. Multiple wholly new technical crossings unresolved.
Direction: Technical/commercial development beyond promising startups.
Magnitude: Selected examples, not census; many-company scale, strict new formation and uniform quality unresolved.
Timing: Approximately through 12 April 2022; May publication is not a reset. Momenta’s 2021 pilot, reported January 2022, does not establish post-April 2017 technical attainment.
Scope: No global-dominance, valuation-only, permit-only, first-invention or road-safety inference; winning research need not match shipped products. Prior firms/results limit novelty. Later ranks, foreign activity and mixed-period research metrics are not backdated. Momenta pilot supervision/intervention denominators unspecified.
Shared evidence: Coauthored with Wang Yonggang; Lee’s investment affiliation and issuer/operator evidence limit independence. Joint research/same-event organizer slides are not independent replications. Initial hold retained; historical-only, no verified same-target reaffirmation.
Evidence confidence: Moderate for qualified emergence; lower for many-company magnitude, equal breadth of world-class quality and strict new-formation interpretation.
Current edition contribution · Kai-Fu Lee
Graded credit: 75 / 100.
- Recency weight
- 60.66301369863014%
- Credit × weight endpoint products
- 45.49726027397261
- Last documented backing
- 2017-04-12 to 2017-04-12
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 75 / 100
- Recency weight
- 34.43835616%
- Weighted credit term
- 25.82876712
- Same-claim backing date
- 2017-04-12 to 2017-04-12
Existing reviewed grade for the original scope; time intrinsic to that scope is retained.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
75,
75
]
},
"backingDateBounds": [
"2017-04-12",
"2017-04-12"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
75,
75
],
"weightBounds": [
0.34438356164383555,
0.34438356164383555
],
"normalizedBackingDateBounds": [
"2017-04-12",
"2017-04-12"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
75,
75
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Andrew Ng11 Jan 2017Chart grade 75 / 1002017 is conversational computing’s breakout year.
Approximate support: smart-speaker ownership and cross-device voice use surged in 2017; unrestricted dialogue remained weak.
OutcomePartly rightDirectionRightMagnitudeNot quantifiedTimingWithin original window
2017-01-11
Further evidence: Approximately right under the ordinary major-commercial-progress reading of the rhetorical annual forecast. Concrete uptake and cross-form-factor use support it, while imperfect social dialogue rules out stronger readings.
Direction: Adoption and real voice interaction grew materially during the named year.
Magnitude: No numeric threshold defines year of; this is low-specificity qualitative credit, not a precise market-share success.
Timing: Survey asks about 2017 and commercial usage is documented before year-end. Publication in January 2018 does not move the outcome into 2018.
Evidence confidence: Moderate: substantial annual progress is evidenced; the slogan has interpretation uncertainty.
Current edition contribution · Andrew Ng
Graded credit: 75 / 100.
- Recency weight
- 59.167123287671245%
- Credit × weight endpoint products
- 44.375342465753434
- Last documented backing
- 2017-01-11 to 2017-01-11
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 75 / 100
- Recency weight
- 31.94520548%
- Weighted credit term
- 23.95890411
- Same-claim backing date
- 2017-01-11 to 2017-01-11
Existing reviewed grade for the original scope; time intrinsic to that scope is retained.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
75,
75
]
},
"backingDateBounds": [
"2017-01-11",
"2017-01-11"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
75,
75
],
"weightBounds": [
0.31945205479452055,
0.31945205479452055
],
"normalizedBackingDateBounds": [
"2017-01-11",
"2017-01-11"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
75,
75
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Stuart Russell2017 · uncertainChart grade 75 / 100Personal digital assistants seemed likely to become a significant market before 2020.
Millions of Alexa devices already sold in 2016.
OutcomePartly rightDirectionRightMagnitudePartly supportedTimingWithin original window
2017; year only
Further evidence: Amazon's 2018 review reports tens of millions sold and doubled daily-interacting customers; millions purchased during Prime Day 2019. Pew: 25% of US adults reported home smart speakers (June 2019; n=4,272). Selected-parent survey (February 2019; n=1,127): 44% reported family interaction; 60% of speaker respondents reported purchasing. Qualified market development, not proven first emergence.
Direction: Sales and daily use grew beyond an existing baseline.
Magnitude: Substantial adoption; no specified threshold or measured assistant-specific revenue/profit.
Timing: 2018–2019 evidence is before 2020; first crossing unknown, possibly pre-2017.
Scope: Stricter first-postissuance emergence reading: content and timing unresolved. No perfected preference adaptation or autonomous-secretary reliability; 'likely' has no numerical probability. Pre-2017 adoption limits novelty; no later chatbot boom or 2020 user counts backdated. Historical statement, no verified same-scope reaffirmation. Amazon self-reports; multi-purpose device purchases are not assistant revenue. Shipments, home presence and active use are distinct measures. Pew: weighted US-adult panel, not active or global users; cumulative response 5.1%, reported 95% margin ±1.9 points. Privacy/personalization concerns remain. Common Sense/SurveyMonkey: selected parents of children 2–8, not all adults; 499 speaker respondents, overlapping purchase/gift/free answers. Reported ±3 points is modeled; routine uses do not establish general assistance.
Shared evidence: Strong dependence on SR-2016-PERSONAL-ASSISTANTS; not independent forecasting evidence.
Evidence confidence: Moderate for substantial paid adoption/use by the deadline; lower for a new postissuance market crossing. Company growth claims are first-party; independent surveys corroborate presence/use, not all assistant functionality.
Current edition contribution · Stuart Russell
Graded credit: 75 / 100.
- Recency weight
- 59.0027397260274–64.98630136986301%
- Credit × weight endpoint products
- 44.25205479452055–48.73972602739725
- Last documented backing
- 2017-01-01 to 2017-12-31
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 75 / 100
- Recency weight
- 31.67123288–41.64383562%
- Weighted credit term
- 23.75342466–31.23287671
- Same-claim backing date
- 2017-01-01 to 2017-12-31
Existing reviewed grade for the original scope; time intrinsic to that scope is retained.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
75,
75
]
},
"backingDateBounds": [
"2017-01-01",
"2017-12-31"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
75,
75
],
"weightBounds": [
0.3167123287671232,
0.4164383561643836
],
"normalizedBackingDateBounds": [
"2017-01-01",
"2017-12-31"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
75,
75
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Yann LeCunJan–Nov 2017 · rangeMedical imaging transforms care in coming years through triage, shorter delays and lower costs.
A 2021–2022 single-site study found shorter imaging and biopsy delays. Whole outcome unresolved.
OutcomeUnresolvedDirectionPartly rightMagnitudePartly supportedTimingTiming unresolved
2017; exact interview day not established; issue published 2017-11-13
Further evidence: Simulated savings are not realized expenditure reductions. Costs and broad transformation remain open.
Direction: Measured local triage and delay gains.
Magnitude: Local improvements, not healthcare-wide costs or staffing.
Timing: Study operated in 2021–2022; no exact timing hit.
Scope: Direction only. Human reading remained; prioritization plus immediate workup was composite. Google-funded, single-site study, not independent replication. No autonomous simple-case removal established.
Shared evidence: Shared 2017 interview; these forecasts are not independent evidence.
Evidence confidence: Moderate for scoped direction; high for the stated trial results and explicit model class; low for broad generalization.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Yann LeCunJan–Nov 2017 · rangeWithin five years, conversational systems answer questions whose answers exist on the web.
2021–2022 systems demonstrated grounded QA, with material factual and coverage limits.
OutcomePartly rightDirectionPartly rightMagnitudePartly matched scopeTimingTiming unresolved
2017 interview; published 2017-11-13
Further evidence: Broad grounded QA approximately realized, not complete coverage.
Direction: Retrieval-backed generated answers improved in evaluated research systems.
Magnitude: Preference, citation support and factual correctness are different metrics.
Timing: Central progress by December 2021; full-bundle completion and interview day unknown.
Shared evidence: Shared 2017 interview; these forecasts are not independent evidence.
Evidence confidence: Moderate, interpretation-sensitive; primary lab evaluations plus internal research interpretation, not external validation or an exhaustive field census.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Geoffrey Hinton5 Dec 2016Chart grade 100 / 100Train neural networks with at least one trillion weights within five years.
The first Switch Transformer paper, submitted January 11, 2021, reported 1.571 trillion total parameters.
OutcomeRightDirectionNot separately gradedMagnitudeWithin stated rangeTimingWithin original window
2016-12-05
Original horizon: approximately 2021-12-05; interview recording day unverified
Further evidence: That satisfies the trained-size target before the horizon, with sparse activation allowed; it does not establish human intelligence or biological-synapse equivalence. A trained network exceeded one trillion total parameters, satisfying the narrow size target.
Direction: Not separately graded in the historical record.
Magnitude: No separately documented rationale is available.
Timing: The January 2021 report documents fulfillment before the original five-year horizon.
Scope: Total trained weights are not the number active on every inference. No intelligence-parity or biological-equivalence claim is credited.
Evidence confidence: Not separately rated.
Current edition contribution · Geoffrey Hinton
Graded credit: 100 / 100.
- Recency weight
- 58.55890410958904%
- Credit × weight endpoint products
- 58.55890410958904
- Last documented backing
- 2016-12-05 to 2016-12-05
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 100 / 100
- Recency weight
- 30.93150685%
- Weighted credit term
- 30.93150685
- Same-claim backing date
- 2016-12-05 to 2016-12-05
Existing reviewed grade for the original scope; time intrinsic to that scope is retained.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
100,
100
]
},
"backingDateBounds": [
"2016-12-05",
"2016-12-05"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
100,
100
],
"weightBounds": [
0.3093150684931506,
0.3093150684931506
],
"normalizedBackingDateBounds": [
"2016-12-05",
"2016-12-05"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
100,
100
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Ben Goertzel28 Sep 2016Chart grade 25 / 100AI becomes socially central and replaces most professions within ten years.
Qualified realized-replacement miss: substantial automation and selective displacement, but evidence falls short of replacement of most professions.
OutcomeMostly wrongDirectionRightMagnitudeOverestimated at deadlineTimingOriginal deadline missed
2016-09-28
Further evidence: Convergent employer, labor and role-content evidence supports this qualified inference, not a worldwide census.
Direction: Useful automation, task reorganization and junior-worker displacement are real.
Magnitude: Firm/worker shares and job counts are not fractions of professions or technical-capability tests.
Timing: Approximate ten-year September/October 2026 window missed; eventual attainment unverified, not impossible.
Scope: Organizer’s English attribution; translation/spoken-language provenance unverified. Event 28 September 2016; publication 6 October. The 41-country panel ends March 2026, roughly six months early: limited occupational recomposition alongside junior displacement; professional-heavy, surviving-firm sample and relative headcounts, not task content. October 21 Stanford reporting adds early-career software/customer-service declines; last observation month unknown, same Canaries research line. The May 2026 skills synthesis mainly reviews 2024–2025: finance, journalism and management retain judgment/verification/oversight alongside automation, not proven human impossibility. OECD abstract-only exposure mapping is not realized replacement; full work remains closed. August 2026 New York/Northern New Jersey employer surveys cover six months: current-job retraining and human oversight predominate, with selective layoffs/hiring reductions; regional self-reports, not global profession counts. Professional/knowledge and broader occupational readings remain considered. Latent whole-role capability, strict worldwide replacement and social centrality beyond positive direction remain unresolved. Regional and dated samples do not measure a worldwide fraction of professions. Latent technical capability and stricter global readings remain unresolved; real displacement and positive direction are preserved.
Shared evidence: One composite, strongly dependent on Goertzel’s broader economic forecasts; no independent component votes.
Evidence confidence: Moderate for qualified realized-replacement miss; lower for worldwide profession-type generalization. No quantitative global replacement estimate.
Current edition contribution · Ben Goertzel
Graded credit: 25 / 100.
- Recency weight
- 57.44109589041096%
- Credit × weight endpoint products
- 14.36027397260274
- Last documented backing
- 2016-09-28 to 2016-09-28
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 25 / 100
- Recency weight
- 29.06849315%
- Weighted credit term
- 7.26712329
- Same-claim backing date
- 2016-09-28 to 2016-09-28
This state-at-time, annual trajectory or original-period market/adoption predicate already includes time in its meaning. There is no separate event-arrival penalty to add back; preserve the reviewed original credit and temporal scope.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
25,
25
]
},
"backingDateBounds": [
"2016-09-28",
"2016-09-28"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
25,
25
],
"weightBounds": [
0.29068493150684926,
0.29068493150684926
],
"normalizedBackingDateBounds": [
"2016-09-28",
"2016-09-28"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
25,
25
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Stuart Russell23 Sep 2016Chart grade 75 / 100Numerous digital personal assistant products would appear within five years, helping with everyday tasks such as calendar and travel.
New Bixby and Alice offerings, Google Assistant hotel reservations and Microsoft Scheduler appeared by September 2021.
OutcomePartly rightDirectionRightMagnitudePartly supportedTimingWithin original window
2016-09-23
Further evidence: Their capabilities remained bounded, and Microsoft explicitly used human fallback. Multiple genuinely postissuance assistants/products and calendar/travel features support the commercial-product expectation. Broad all-purpose autonomous life management is not established, hence approximate not full-right.
Direction: Additional assistant offerings and actual task functionality arrived rather than the evidence being only preexisting Siri/Cortana.
Magnitude: Multiple suppliers and large reported usage support substantial commercial presence, but lots has no original numeric threshold and exact count is not invented.
Timing: The documented new launches and features fall within the five-year window; no later 2022+ LLM evidence used.
Scope: Approximate product-proliferation result, not autonomous preference-aware life management. Human fallback and constrained task scope remain. Publisher-transcript attribution is qualified; no original audio verification claimed.
Evidence confidence: Moderate; clear deadline and publisher transcript, qualified product scope and no universal-autonomy certification.
Current edition contribution · Stuart Russell
Graded credit: 75 / 100.
- Recency weight
- 57.35890410958905%
- Credit × weight endpoint products
- 43.019178082191786
- Last documented backing
- 2016-09-23 to 2016-09-23
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 75 / 100
- Recency weight
- 28.93150685%
- Weighted credit term
- 21.69863014
- Same-claim backing date
- 2016-09-23 to 2016-09-23
Existing reviewed grade for the original scope; time intrinsic to that scope is retained.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
75,
75
]
},
"backingDateBounds": [
"2016-09-23",
"2016-09-23"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
75,
75
],
"weightBounds": [
0.2893150684931507,
0.2893150684931507
],
"normalizedBackingDateBounds": [
"2016-09-23",
"2016-09-23"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
75,
75
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Ilya SutskeverSep 2016 · rangeChart grade 75 / 100Over the next few years, machine learning will keep using GPUs extensively while methods improve and applications expand, with faster GPUs underpinning that progress.
Qualified support for GPU-system-enabled method/application expansion, with directly linked speech-component feasibility gains.
OutcomePartly rightDirectionRightMagnitudePartly supportedTimingTiming unresolved
September 2016 publication; exact day unknown
Further evidence: Matched application linkage supports the composite, not pure-chip necessity or full production quality.
Direction: Continued GPU use and useful application gains, not first invention or GPU exclusivity.
Magnitude: Selected systems support qualitative breadth, not universal adoption, sector-wide benefit or a forecast speedup threshold.
Timing: 2017–2019 observations fit a few-year outlook; no defined endpoint or first-attainment date: timing unjudgeable.
Scope: Contemporary third-party indexed attribution only; full CACM article was not authenticated and remains 403-closed. MLPerf spans learning tasks and alternative hardware; experiments separate software/precision/parallelism contributions. Robotic grasping and retinal-referral research broaden applications; not general robotic reliability, clinical benefit or broad deployment. Nv-Wavenet and Deep Voice match the medium architecture across GPU systems; the larger model instead has a matched CPU baseline, not an earlier matching GPU row. Kernels, precision, hardware and possibly checkpoints differ: no clean chip-only ratio or measured fp16 quality equivalence. External conditioning and ground-truth-prosody quality ratings cannot establish whole-pipeline TTS quality. Deep Voice already anticipated real-time GPU inference from better persistent kernels. Parallel WaveNet accelerates synthesis on an existing GPU through methods; actual Assistant deployment used TPUs. Broad diffusion and a stronger future-physical-chip/necessary-cause reading remain unresolved.
Shared evidence: Mature pre-2016 trends limit novelty. One strongly dependent Ilya progress composite; earlier versions and applications are not counted separately.
Evidence confidence: Moderate for bounded GPU-system/application enablement; lower for original-context completeness, broader diffusion, physical-chip/necessity interpretation and independent forecasting information.
Current edition contribution · Ilya Sutskever
Graded credit: 75 / 100.
- Recency weight
- 56.99726027397261–57.47397260273973%
- Credit × weight endpoint products
- 42.74794520547945–43.1054794520548
- Last documented backing
- 2016-09-01 to 2016-09-30
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 75 / 100
- Recency weight
- 28.32876712–29.12328767%
- Weighted credit term
- 21.24657534–21.84246575
- Same-claim backing date
- 2016-09-01 to 2016-09-30
Existing reviewed grade for the original scope; time intrinsic to that scope is retained.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
75,
75
]
},
"backingDateBounds": [
"2016-09-01",
"2016-09-30"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
75,
75
],
"weightBounds": [
0.2832876712328767,
0.2912328767123288
],
"normalizedBackingDateBounds": [
"2016-09-01",
"2016-09-30"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
75,
75
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Sam Altman28 Jul 2016Jointly predicts AI-assisted computer intrusions as an early use of AI.
Anthropic reports successful September 2025 AI-assisted intrusions; humans remained involved.
OutcomePartly rightDirectionRightMagnitudeNot quantifiedTimingNo fixed deadline
2016-07-28
Further evidence: Reported intrusions support event; early ordering unmeasured.
Direction: Offensive application observed.
Magnitude: No attack count, success rate or autonomy level was promised.
Timing: Early supplies neither a calendar deadline nor an operational ordering criterion.
Evidence confidence: Moderate: primary incident investigation, not an independently reproduced attribution or autonomy audit.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Dario Amodei28 Jul 2016Jointly predicts AI-assisted computer intrusions as an early use of AI.
Anthropic reports successful September 2025 AI-assisted intrusions; humans remained involved.
OutcomePartly rightDirectionRightMagnitudeNot quantifiedTimingNo fixed deadline
2016-07-28
Further evidence: Reported intrusions support event; early ordering unmeasured.
Direction: Offensive application observed.
Magnitude: No attack count, success rate or autonomy level was promised.
Timing: Early supplies neither a calendar deadline nor an operational ordering criterion.
Evidence confidence: Moderate: primary incident investigation, not an independently reproduced attribution or autonomy audit.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Ilya Sutskever28 Jul 2016Jointly predicts AI-assisted computer intrusions as an early use of AI.
Anthropic reports successful September 2025 AI-assisted intrusions; humans remained involved.
OutcomePartly rightDirectionRightMagnitudeNot quantifiedTimingNo fixed deadline
2016-07-28
Further evidence: Reported intrusions support event; early ordering unmeasured.
Direction: Offensive application observed.
Magnitude: No attack count, success rate or autonomy level was promised.
Timing: Early supplies neither a calendar deadline nor an operational ordering criterion.
Evidence confidence: Moderate: primary incident investigation, not an independently reproduced attribution or autonomy audit.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Eliezer Yudkowsky27 Jul 2016Chart grade 100 / 100More capable AI will receive greater delegated decisions and autonomy.
Deployed coding agents perform delegated issue-to-pull-request work with human review; observed public-project use supports the direction.
OutcomeRightDirectionRightMagnitudeNot quantifiedTimingNo fixed deadline
2016-07-27
Further evidence: Scoped delegation occurred in real software workflows.
Direction: More multistep work is delegated than local suggestion-only assistance.
Magnitude: No numerical adoption share or autonomy threshold specified.
Timing: Undated; no timing credit.
Evidence confidence: moderate; deployment and selected observational evidence, not causal proof across all sectors
Current edition contribution · Eliezer Yudkowsky
Graded credit: 100 / 100.
- Recency weight
- 56.4054794520548%
- Credit × weight endpoint products
- 56.4054794520548
- Last documented backing
- 2016-07-27 to 2016-07-27
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 100 / 100
- Recency weight
- 27.34246575%
- Weighted credit term
- 27.34246575
- Same-claim backing date
- 2016-07-27 to 2016-07-27
Existing reviewed grade for the original scope; time intrinsic to that scope is retained.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
100,
100
]
},
"backingDateBounds": [
"2016-07-27",
"2016-07-27"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
100,
100
],
"weightBounds": [
0.2734246575342465,
0.2734246575342465
],
"normalizedBackingDateBounds": [
"2016-07-27",
"2016-07-27"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
100,
100
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Eliezer Yudkowsky27 Jul 2016More capable AI will make intended-goal alignment and oversight harder.
Later frontier-training observations report more sophisticated objective exploitation, while a separate multi-model study shows task dependence and successful mitigations.
OutcomePartly rightDirectionPartly rightMagnitudeNot quantifiedTimingNo fixed deadline
2016-07-27
Further evidence: Later training evidence supports part of the forecast, not a monotonic law across all models.
Direction: Greater capability can reveal harder oversight problems; it can also aid monitoring.
Magnitude: No quantitative worsening rate specified.
Timing: Explicit long-run framing with no date; no timing credit.
Evidence confidence: moderate; developer observations plus a separate benchmark, not general causal proof
Later statement: 2022-06-10 verified institutional copy; June 5 original date appears in primary search metadata (specific conditional mechanism refinement; diagnostic horizon hold, no additional claim or trajectory count): Training against thought detectors can improve behavior while selecting harder-to-detect misconduct.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Kai-Fu Lee18 Jul 2016Extreme deep-learning-specialist scarcity lasts two or three more years; many entrants follow, especially in China.
2019 report: LinkedIn specialists 36,524 versus 22,064; 21-conference authors 22,400 in 2018, up 19%. Whole outcome unresolved.
OutcomeUnresolvedDirectionRightMagnitudePartly supportedTimingTiming unresolved
18 July 2016 publication; 16 July speech
Further evidence: Severe shortages persisted. A separate bibliometric study found 8,834 deep-learning-associated authors across 1993–2019, not 2019 entrants. Expansion supported; central scarcity transition unresolved, no completed credit.
Direction: Specialist and research participation rose, beyond generic enrollment.
Magnitude: Cross-pool ratios are invalid; China growth and reward causality unmeasured.
Timing: 2018–early 2019 observations overlap the rough window, but do not establish scarcity change or first attainment.
Scope: LinkedIn PhD/job/ML searches are self-reported, with rebranding and geographic bias. Conference authorship is not audited engineering ability; missing NAACL/ICCV years limit comparability. China’s approximately 11% location share is not a growth series. Bibliometric selection required more than five AI preprints; first-arXiv appearance is not qualification. Its 46,097 first-observed 2019 AI authors are not new deep-learning engineers. The 2020 preprint retrospectively covers 2019; 2021 journal publication is not arrival. No elimination of every talent shortage was promised.
Shared evidence: Same 2016 speech as Lee’s NLU forecast; not independent forecasting evidence.
Evidence confidence: Moderate for expansion; low for scarcity-transition and China correspondence.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Kai-Fu Lee18 Jul 2016Meaningful language understanding would require at least five, perhaps ten years.
2023–2026 evidence: Discourse and dialogue inference improved; pragmatic comprehension advanced; multilingual errors persisted. Whole outcome unresolved.
OutcomeUnresolvedDirectionRightMagnitudePartly supportedTimingTiming unresolved
18 July 2016 publication; 16 July speech
Further evidence: Minimum-wait target unresolved; no completed-outcome credit.
Direction: Meaning-sensitive progress beyond transcription.
Magnitude: Small selected tasks, varied controls, contamination and multilingual limits.
Timing: First attainment and absence before five years are unknown; perhaps ten years is not a firm 2026 deadline.
Scope: Partial evidence only: later progress does not validate the no-before-July-2021 prediction. General human-like understanding remains unresolved.
Shared evidence: Reuses Russell’s language studies, not independent confirmation of forecasting skill.
Evidence confidence: Moderate for scoped meaning-comprehension progress; low for first breakthrough timing and validity of the forecast’s minimum waiting time.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Kai-Fu Lee15 Jun 2016Chart grade 75 / 100Within roughly three to five years, AI platforms make machine learning more accessible to non-specialists.
By 2020, Google reported ML Kit use in over 25,000 apps.
OutcomePartly rightDirectionRightMagnitudePartly supportedTimingWithin original window
15 June 2016 publication; recording date unknown
Further evidence: Teachable Machine documented supported student/creative projects; ZSL described assisted animal-classification work. October 2019–March 2020 interviews documented lower-barrier AutoML prototype/production work, alongside persistent human labor. Qualified practical accessibility supported; full ecosystem transformation unresolved.
Direction: Reusable interfaces lowered barriers; no widespread novice-independence inference.
Magnitude: Meaningful uptake; expertise prevalence and ecosystem-wide consequences incompletely measured.
Timing: 2019–2020 use fits the rough 2019–2021 frame; not first invention/crossing. Later publication is not the observation date.
Scope: Usable ML interfaces, not relabeled specialist libraries; ordinary programming and assistance were not excluded. Industry-wide app proliferation and vanished specialist advantage remain unresolved. ML Kit’s vendor count has no expertise/success denominator; named cases are mainly vision, sometimes expert-led. Multiple Google reports are not independent replications. Whither’s 16 selected users included two without formal training but with 8/1.5 years’ ML experience: P9 built a cloud prototype; P16 used proprietary tools in production. They do not identify ML Kit novice outcomes. Teachable Machine examples were selected and instructor-supported; ZSL used partners and left some integrations as plans. Neither supplies representative novice success. Two distinct qualitative interview studies retain substantial preparation, integration, evaluation/governance work and uneven usability; no unaided, universal or majority-user requirement is imposed. Preforecast Wekinator/Azure limit novelty: qualified expansion, not first-ever accessible ML.
Shared evidence: Related to Lee’s broader AI-diffusion forecasts, not independent confirmation of general forecasting skill.
Evidence confidence: Moderate for qualified central platform-accessibility outcome; lower for expertise prevalence and full ecosystem-scale consequences.
Current edition contribution · Kai-Fu Lee
Graded credit: 75 / 100.
- Recency weight
- 55.715068493150675%
- Credit × weight endpoint products
- 41.786301369863004
- Last documented backing
- 2016-06-15 to 2016-06-15
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 75 / 100
- Recency weight
- 26.19178082%
- Weighted credit term
- 19.64383562
- Same-claim backing date
- 2016-06-15 to 2016-06-15
Existing reviewed grade for the original scope; time intrinsic to that scope is retained.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
75,
75
]
},
"backingDateBounds": [
"2016-06-15",
"2016-06-15"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
75,
75
],
"weightBounds": [
0.261917808219178,
0.261917808219178
],
"normalizedBackingDateBounds": [
"2016-06-15",
"2016-06-15"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
75,
75
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Elon Musk4 May 2016Chart grade 25 / 100Tentatively, half of newly produced cars would be fully autonomous within seven or eight years.
2024 market estimates strongly contradict a 50% driverless new-car share; real robotaxis support narrower diffusion.
OutcomeMostly wrongDirectionPartly rightMagnitudeOverestimated at deadlineTimingOriginal window missed
4 May 2016 publication; original speaking day not independently verified
Further evidence: Qualified diffusion miss, not an audited worldwide production census.
Direction: Driverless services emerged, not mass-market fulfillment.
Magnitude: Large coverage overestimate; no exact production percentage assigned.
Timing: Qualified miss of the approximately 2023–24 window; exact day and eventual crossing unknown.
Scope: Original attribution is an event witness quoted by Inverse; the speech was not independently verified. Edie/Guardian corroborates the tentative seven-to-eight-year wording. Industry new production, not fleet stock, Tesla-only output, EV share or hardware readiness; geofenced Level 4 can count, without an unrestricted Level 5 requirement. Berg’s June 2025 public summary estimates 2024 global new-car sales at 40.5% Level 1 and 28.1% Level 2, with tiny Level 3 and existing robotaxis. Its methods cite 30 executive interviews and 24 OEM profiles; full microdata are not public. Rounded sales estimates are not production counts or an audited census; the residual is not assigned to autonomy. Yano’s March 2025 report gives 2023 Level 1/2/2+ installations of 23.277/28.460/1.810 million, and estimates 2024 Level 1/2 at 22.760/30.255 million. April–September 2024 fieldwork used interviews, surveys and literature. Its main forecast excludes commercial Level 4; the separate observation is very low commercial Level 4 production. Installation, sales and production denominators differ. Later-year projections are not treated as outcomes. Whole-year 2024 estimates straddle the approximate May deadline.
Shared evidence: One industry diffusion target; no separate votes for vehicle categories, years or corroborating sources.
Evidence confidence: Moderate: original is contemporaneous reported quotation; outcome is primary commercial market research with sales/production and estimation limits.
Current edition contribution · Elon Musk
Graded credit: 25 / 100.
- Recency weight
- 55.02465753424658%
- Credit × weight endpoint products
- 13.756164383561645
- Last documented backing
- 2016-05-04 to 2016-05-04
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 25 / 100
- Recency weight
- 25.04109589%
- Weighted credit term
- 6.26027397
- Same-claim backing date
- 2016-05-04 to 2016-05-04
This state-at-time, annual trajectory or original-period market/adoption predicate already includes time in its meaning. There is no separate event-arrival penalty to add back; preserve the reviewed original credit and temporal scope.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
25,
25
]
},
"backingDateBounds": [
"2016-05-04",
"2016-05-04"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
25,
25
],
"weightBounds": [
0.2504109589041096,
0.2504109589041096
],
"normalizedBackingDateBounds": [
"2016-05-04",
"2016-05-04"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
25,
25
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Jensen Huang5 Apr 2016Deep learning would very likely become NVIDIA’s largest business across existing markets.
In its FY 2024 filing, NVIDIA estimates inference at 40% of Data Center revenue.
OutcomePartly rightDirectionRightMagnitudePartly supportedTimingTiming unresolved
2016-04-05
Further evidence: That AI-specific estimate exceeds gaming and the other non-data-center platforms combined; neural-model training adds unallocated activity. This supports approximate commercial ascendancy, not an audited AI-only total. Same-company business shift is substantively supported by an AI-specific lower-bound estimate, with accounting-taxonomy and residual-data-center uncertainty.
Direction: AI-related operations became commercially much larger than the formerly dominant gaming business.
Magnitude: Ranking approximately supported, not an exact AI revenue share or all-industry penetration measurement.
Timing: Observed by FY 2024; original long-run frame is not an exact first-crossing date or deadline.
Scope: The original adjacent 10–20-year extrapolation is long-run context, not an exact deadline. “Very likely” remains verbal, with no numerical probability. Quartr-attributed transcription, not independently audio-verified; the CFO described gaming as then largest. Revenue operationalizes an unspecified business-size metric; deep learning cuts across reporting categories. Data Center includes non-AI HPC, analytics, graphics and networking, so its entire total is not AI revenue. Management’s inference estimate is not a separately audited segment; the residual is unallocated. Inference alone does not establish a whole-company AI majority or exclude a larger hypothetical non-AI residual. No exact share, first-crossing date or every-business penetration is established. The fiscal year ended January 28, 2024; filing February 21. This is not a stock-price, profit or product-release forecast. Related H-C001 and annual Tesla-growth evidence is dependent, not extra validation.
Evidence confidence: Moderate for qualitative commercial ranking; low for exact AI-only revenue and first crossover date.
Draft formula inputs
No draft score: out of scope. No vote, not zero.
Paul Christiano5 Apr 2016Chart grade 0 / 100By July 2023: reliable public self-delivery in ten North American cities, eight outside the Bay Area, on at least half of days.
Counterparty Riedel records winning the wager.
OutcomeWrongDirectionRightMagnitudeOverestimated at deadlineTimingOriginal window missed
2016-04-05 wager, counterparty record; public terms April 22, updated May 19, 2016
Further evidence: Contemporary Waymo and GM reports corroborate real, geographically narrower deployment, not an exhaustive North American census. Reported loss of this fixed event, not permanent self-delivery impossibility. No bilateral settlement/payment receipt or independent adjudicator ruling was found.
Direction: Public autonomous rides existed by 2023.
Magnitude: The matched counterparty result, not a count of two companies, supports the geographic miss.
Timing: Original July 2023 month retained; no invented July 1 or 31. Later attainment cannot rescue the bet.
Scope: The user could drive onward: self-delivery, not full passenger autonomy everywhere. Municipalities are not metros; the contract does not require perfect safety or all-weather operation. Carl Shulman was the designated edge-case adjudicator, not a recovered adjudication here. Even stakes supply no explicit Paul probability or proper score; Riedel’s own probabilities are not Paul’s. The result page’s July 20, 2023 server-modification date is not an authenticated settlement date. Waymo’s metro Phoenix spans several municipalities; Los Angeles testing is not public availability. GM’s July 25 filing describes the June 30 quarter. The separate 2021 Tesla/Waymo conditions are not this event.
Evidence confidence: Moderate: contemporaneous first-party counterparty contract plus matched result, independently corroborated direction/limited scope; no bilateral settlement or complete city census.
Current edition contribution · Paul Christiano
Graded credit: 0 / 100.
- Recency weight
- 54.54794520547945%
- Credit × weight endpoint products
- 0
- Last documented backing
- 2016-04-05 to 2016-04-05
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 0 / 100
- Recency weight
- 24.24657534%
- Weighted credit term
- 0
- Same-claim backing date
- 2016-04-05 to 2016-04-05
Fixed original July2023 wager event: ten cities and stated operational conditions within the bet window define the target. Later attainment cannot rescue this contract. No separately removable lateness component; keep strict loss and waiver credit0.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
0,
0
]
},
"backingDateBounds": [
"2016-04-05",
"2016-04-05"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
0,
0
],
"weightBounds": [
0.24246575342465748,
0.24246575342465748
],
"normalizedBackingDateBounds": [
"2016-04-05",
"2016-04-05"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
0,
0
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Jürgen Schmidhuber23 Mar 2016Chart grade 75 / 100Within years, robots perform laborious tasks such as strawberry picking.
Field trials harvested 449 of 626 target berries (71.7%), allowing up to three attempts; this is bounded task capability, not labor-market mastery.
OutcomePartly rightDirectionRightMagnitudePartly matched scopeTimingTiming unresolved
23 March 2016 interviewer reproduction; earlier print/recording dates unverified.
Further evidence: Qualified named example; strict many-job conjunction remains unresolved.
Direction: Integrated field perception, movement and manipulation performed the named task.
Magnitude: Occlusion/grouping, retries, damage and support constrain performance; no original numerical reliability or economic-replacement threshold.
Timing: 2022 trials occurred years later; no bounded deadline, timing hit, miss or lateness inferred.
Scope: Interviewer-hosted FOCUS Q&A, not an authenticated recording date or immutable first text. Bookkeeping and airplane examples are the interviewer’s, not extra forecaster targets. The developer-authored paper appeared August 2024; five main trials occurred March–April 2022 on a commercial Florida farm. Table 3 and Table 4 confirm 449/626 target fruits, correcting prose that calls 626 harvested; this is not all farm fruit. Scene success ranged 37.5–94%. Reported 7.5 seconds is a single-fruit cycle, not full-shift productivity. A separate 21 March 2023 test damaged two of 34 picked berries, not the main-trial damage rate. Shade covering and operational support remain; no quantified intervention-free duty cycle or all-season reliability. Field research is not independent replication, a commercial operating audit or profitable deployment. Pre-2016 prototypes limit novelty. DEFRA’s July 2022 review combined a preliminary survey, six roundtables and over 75 stakeholders: selective harvesting was mostly field testing, with costly supervision and scale barriers. Its 2030 outlook is not an observed 2026 result; economic limits do not refute demonstrated physical capability. No all-jobs, human-cost parity, universal dexterity or unattended whole-farm result; no current endorsement inferred.
Shared evidence: One task-transition forecast; examples and trials are not independent votes.
Evidence confidence: Moderate for central field capability; limited for broader labor scope and exact chronology.
Current edition contribution · Jürgen Schmidhuber
Graded credit: 75 / 100.
- Recency weight
- 54.33424657534246%
- Credit × weight endpoint products
- 40.75068493150685
- Last documented backing
- 2016-03-23 to 2016-03-23
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 75 / 100
- Recency weight
- 23.89041096%
- Weighted credit term
- 17.91780822
- Same-claim backing date
- 2016-03-23 to 2016-03-23
Existing reviewed grade for the original scope; time intrinsic to that scope is retained.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
75,
75
]
},
"backingDateBounds": [
"2016-03-23",
"2016-03-23"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
75,
75
],
"weightBounds": [
0.23890410958904107,
0.23890410958904107
],
"normalizedBackingDateBounds": [
"2016-03-23",
"2016-03-23"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
75,
75
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Andrew Ng15 Mar 2016Baidu plans commercial autonomous vehicles by 2018, initially in limited, adapted regions.
Public shuttle use with safety operators in 2018 provides an on-time partial realization.
OutcomeRightDirectionNot separately gradedMagnitudeNot quantifiedTimingTiming unresolved
2016-03-15
Original horizon: By 2018; end-2018 inclusive reading with early-2018 sensitivity.
Further evidence: Later Baidu driverless operations strengthen the bounded deployment result, but do not establish the first unattended paid-service date or full commercial maturity under every reading. Actual shuttle use and later driverless operations support bounded deployment, not universal commercial maturity.
Direction: Not separately graded in the historical record.
Magnitude: The original forecast sets no numerical deployment, fare or coverage threshold.
Timing: The 2018 shuttle component was timely; the first qualifying unattended paid-service date remains unknown.
Scope: Shuttle-first regions are allowed. Strict paid-service content and timing remain unresolved; ride counts are not production counts. The 2018 and approximately-2019 commercialization versions remain separate dated records as related formulations. Coauthored with Yuanqing Lin.
Evidence confidence: Not separately rated.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Demis Hassabis10 Mar 2016Chart grade 100 / 100Learning-based phone improvements become noticeable in two to three years, initially in subtle ways.
An Android developer report in November 2018 documented personalized brightness, matching the explicitly modest prediction.
OutcomeRightDirectionNot separately gradedMagnitudeWithin stated rangeTimingWithin original window
2016-03-10T14:50:00Z publication
Original horizon: Approximately March 2018–March 2019; no exact-day tolerance invented.
Further evidence: This establishes a learning-based phone improvement, not general assistant competence or equal benefits for every user. Personalized brightness matches the explicitly modest target; broader assistant competence was not required.
Direction: Not separately graded in the historical record.
Magnitude: No separately documented rationale is available.
Timing: The feature was documented in 2018 within the original window; its exact first rollout date is unverified.
Scope: This shares a consumer-AI diffusion trajectory with the 2015 forecast; it is not independent repeated breadth.
Evidence confidence: Not separately rated.
Current edition contribution · Demis Hassabis
Graded credit: 100 / 100.
- Recency weight
- 54.12054794520548%
- Credit × weight endpoint products
- 54.12054794520548
- Last documented backing
- 2016-03-10 to 2016-03-10
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 100 / 100
- Recency weight
- 23.53424658%
- Weighted credit term
- 23.53424658
- Same-claim backing date
- 2016-03-10 to 2016-03-10
Existing reviewed grade for the original scope; time intrinsic to that scope is retained.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
100,
100
]
},
"backingDateBounds": [
"2016-03-10",
"2016-03-10"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
100,
100
],
"weightBounds": [
0.23534246575342455,
0.23534246575342455
],
"normalizedBackingDateBounds": [
"2016-03-10",
"2016-03-10"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
100,
100
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Andrew NgMar–Jun 2016 · rangeNg hopes Baidu can commercialize autonomous vehicles in about three years, his best current guess.
Safety-operated public shuttles were in use by 2018, and later Baidu driverless operations support eventual bounded deployment.
OutcomeRightDirectionNot separately gradedMagnitudeNot quantifiedTimingTiming unresolved
2016-06-28
Original horizon: About three years, approximately 2019, from March 2016 interview / June publication.
Further evidence: These findings do not identify the first qualifying unattended paid-service date or establish every interpretation of mature commercialization. Observed operations support the bounded deployment component, without settling stricter commercial-maturity interpretations.
Direction: Not separately graded in the historical record.
Magnitude: The original forecast sets no numerical deployment, fare or coverage threshold.
Timing: The early shuttle component was timely; full-scope lateness cannot be quantified without a qualifying first-service date.
Scope: Limited adapted regions remain within scope. Strict unattended paid-service content and timing remain unresolved. This approximately-2019 version does not replace the separately retained 2018 deadline; the records share one related trajectory.
Evidence confidence: Not separately rated.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Andrew NgMar–Jun 2016 · rangeChart grade 100 / 100Over the next decade, frontier deep learning shifts toward high-performance computing.
PaLM and Llama3 combined frontier-level performance with multi-thousand-accelerator training clusters by 2022–24.
OutcomeRightDirectionRightMagnitudeNot quantifiedTimingWithin original window
2016-06-28
Further evidence: Large-scale specialized training infrastructure became integral to multiple leading models.
Direction: The observed frontier moved toward large high-performance accelerator clusters.
Magnitude: No number or fraction was predicted.
Timing: Documented outcomes precede either plausible 2016–2026 decade endpoint.
Evidence confidence: high for qualitative direction; moderate for breadth
Current edition contribution · Andrew Ng
Graded credit: 100 / 100.
- Recency weight
- 55.92876712328767%
- Credit × weight endpoint products
- 55.92876712328767
- Last documented backing
- 2016-06-28 to 2016-06-28
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 100 / 100
- Recency weight
- 26.54794521%
- Weighted credit term
- 26.54794521
- Same-claim backing date
- 2016-06-28 to 2016-06-28
Existing reviewed grade for the original scope; time intrinsic to that scope is retained.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
100,
100
]
},
"backingDateBounds": [
"2016-06-28",
"2016-06-28"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
100,
100
],
"weightBounds": [
0.2654794520547945,
0.2654794520547945
],
"normalizedBackingDateBounds": [
"2016-06-28",
"2016-06-28"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
100,
100
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Yoshua Bengio17 Feb 2016Chart grade 75 / 100More compute enables harder training over the next few years.
Selected large training runs expanded; restricted Dota2 learning was demonstrated in 2019.
OutcomePartly rightDirectionRightMagnitudeNot quantifiedTimingWithin original window
17 February 2016 recording label; public by April 2018, exact release day unknown
Further evidence: Qualified compute-enabled task-training progress, not compute-only causation.
Direction: More complex training became feasible.
Magnitude: No growth, task-count or accuracy threshold specified.
Timing: 2018–2019 fits the approximate outlook; no exact three-year deadline or first-publication day invented.
Scope: Training computation is not chip speed; selected major runs do not represent every researcher. The 2012–2018 aggregate is not post-2016 growth. Dota2 used structured observations, restricted heroes/items and scripted components, not unrestricted human-equivalent play. Data, algorithms and engineering matter. Weak continuation, not AGI. Captions were not audio-checked; production history corroborates the public corpus, not the exact sentence or release day.
Evidence confidence: Moderate: coherent publisher automatic captions, not audio-crosschecked. Historical production report corroborates public corpus. Outcomes are primary developer evidence with limits.
Current edition contribution · Yoshua Bengio
Graded credit: 75 / 100.
- Recency weight
- 53.775342465753425%
- Credit × weight endpoint products
- 40.33150684931507
- Last documented backing
- 2016-02-17 to 2016-02-17
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 75 / 100
- Recency weight
- 22.95890411%
- Weighted credit term
- 17.21917808
- Same-claim backing date
- 2016-02-17 to 2016-02-17
Existing reviewed grade for the original scope; time intrinsic to that scope is retained.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
75,
75
]
},
"backingDateBounds": [
"2016-02-17",
"2016-02-17"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
75,
75
],
"weightBounds": [
0.2295890410958904,
0.2295890410958904
],
"normalizedBackingDateBounds": [
"2016-02-17",
"2016-02-17"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
75,
75
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Jensen Huang12 Jan 2016Expects another tenfold DNN-training performance boost over the next few years through combined hardware, system, compiler and algorithm improvements.
NVIDIA reported in March 2018 that its updated DGX-2/software platform trained FAIRSeq in under two days, ten times faster than the September 2017 Volta DGX-1 comparison. Whole outcome unresolved.
OutcomeUnresolvedDirectionRightMagnitudeUnresolvedTimingTiming unresolved
2016-01-12
Further evidence: This supports substantial end-to-end training-speed progress, not a matched January 2016-to-2018 tenfold estimate. A narrow end-to-end DNN training comparison supports the expected performance advance, not the full quantitative scope.
Direction: Reported lower training time for a named neural translation workload after combined software/system/hardware improvements.
Magnitude: The tenfold outcome uses a September 2017 baseline and unspecified full training recipe/quality contract; original January 2016 baseline was not recovered. Do not label exact numerical hit.
Timing: Outcome occurred about two years later, but few years is imprecise and the original quantitative target lacks a matched baseline; no standalone timing score.
Evidence confidence: Moderate: explicit original forecast and named vendor benchmark; independent replication and matched original baseline absent.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Ilya SutskeverJan 2016 · rangeChart grade 75 / 100Algorithmic neural models: interesting real-data applications during 2016 as training/efficiency improve.
November 2016 Neural Programmer applied differentiable latent-program learning to real question/table data.
OutcomePartly rightDirectionRightMagnitudeNot quantifiedTimingWithin original window
2016-01-09 to 2016-01-11; exact comment day unverified
Further evidence: Real-data application supports the modest target, qualified by architecture-family ambiguity.
Direction: The predicted shift beyond exclusively synthetic tasks occurred.
Magnitude: No quantitative performance, reliability or adoption level was promised.
Timing: November 2016 fits the original calendar-year window, roughly 11 months after issuance.
Scope: Qualified broad algorithmic-model interpretation. Neural Programmer learns latent operation/column sequences with differentiable soft selection, three updated state variables and final-answer supervision; fixed operators and tables-as-input remain. Not a general free-address writable-memory/stack system; the narrower interpretation remains unresolved. Test accuracy: 34.2% single model, 37.2% for a 15-model ensemble, versus 37.1% parser; not high reliability or superiority. Programs can be spuriously correct. Forecaster coauthored antecedent work and outcome author has OpenAI/Google ties; same AMA as separate unsupervised forecast, not independent skill evidence. November 2016 v1 only; no 2017 revision backdating or production credit. DMN+ is weaker corroboration, not another success. Undated hybrid-supervision opinion remains ungraded.
Evidence confidence: Moderate; original model-family boundary is imprecise. Exact comment day inferred from thread and contemporary dating.
Current edition contribution · Ilya Sutskever
Graded credit: 75 / 100.
- Recency weight
- 53.13424657534247–53.16712328767124%
- Credit × weight endpoint products
- 39.850684931506855–39.87534246575343
- Last documented backing
- 2016-01-09 to 2016-01-11
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 75 / 100
- Recency weight
- 21.89041096–21.94520548%
- Weighted credit term
- 16.41780822–16.45890411
- Same-claim backing date
- 2016-01-09 to 2016-01-11
Existing reviewed grade for the original scope; time intrinsic to that scope is retained.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
75,
75
]
},
"backingDateBounds": [
"2016-01-09",
"2016-01-11"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
75,
75
],
"weightBounds": [
0.21890410958904116,
0.21945205479452057
],
"normalizedBackingDateBounds": [
"2016-01-09",
"2016-01-11"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
75,
75
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Ilya SutskeverJan 2016 · rangeChart grade 100 / 100Likely tangible unsupervised-learning progress over the next few years, given generative-training advances.
2018 ELMo learned representations from unlabeled language and improved six supervised downstream benchmarks.
OutcomeRightDirectionRightMagnitudeNot quantifiedTimingWithin original window
2016-01-09 to 2016-01-11; exact comment day unverified
Further evidence: Useful representations meet the modest progress target.
Direction: Progress, not a broad solution.
Magnitude: No numeric improvement threshold was specified.
Timing: March 2018, roughly 26 months later, fits the several-year outlook; no invented terminal boundary.
Scope: Modest research progress, not solving unsupervised learning, removing downstream supervision or achieving AGI. ELMo developer benchmarks are separate from the forecaster, not independent replication; methods, data and supervised training contributions are not fully isolated. Retained thread and contemporary recap support January 9–11; exact reply day unauthenticated. Earlier horizon-excluded forecasts remain excluded. Low-specificity continuation earns no exceptional-foresight bonus.
Evidence confidence: High for modest progress; moderate for exact original day, which is inferred rather than directly timestamped.
Current edition contribution · Ilya Sutskever
Graded credit: 100 / 100.
- Recency weight
- 53.13424657534247–53.16712328767124%
- Credit × weight endpoint products
- 53.13424657534247–53.16712328767124
- Last documented backing
- 2016-01-09 to 2016-01-11
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 100 / 100
- Recency weight
- 21.89041096–21.94520548%
- Weighted credit term
- 21.89041096–21.94520548
- Same-claim backing date
- 2016-01-09 to 2016-01-11
Existing reviewed grade for the original scope; time intrinsic to that scope is retained.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
100,
100
]
},
"backingDateBounds": [
"2016-01-09",
"2016-01-11"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
100,
100
],
"weightBounds": [
0.21890410958904116,
0.21945205479452057
],
"normalizedBackingDateBounds": [
"2016-01-09",
"2016-01-11"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
100,
100
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Kai-Fu Lee2016 · uncertainSensor prices would fall through autonomy/robotics-driven mass production, possibly in three years.
Unresolved overall: selected commercial LiDAR observations do not establish the whole target.
OutcomeUnresolvedDirectionPartly rightMagnitudeUnresolvedTimingTiming unresolved
2016; exact day unverified
Original horizon: Possibly three years; approximately late 2019.
Direction: Partial support: a same-model price fell in 2018; coverage is narrow.
Magnitude: Unresolved: subset evidence only.
Timing: Unjudgeable overall; observed component timing is not full attainment.
Limits: One vendor/subset. Strategic cuts intended to increase adoption do not prove the proposed causal sequence.
History: Annual 2019 observations partly extend beyond the approximate window; no deadline reset.
Evidence confidence: Moderate for observed LiDAR direction; insufficient for broad coverage, causality or whole-target timing.
Draft formula inputs
Not in this 424-record calculation edition. No score assigned here.
Ilya Sutskever29 Dec 2015Chart grade 75 / 100Five-year outlook: much deeper models, fewer training cases, substantial unsupervised-learning advances.
2018 CNNs trained 10,000 layers.
OutcomePartly rightDirectionRightMagnitudePartly supportedTimingWithin original window
29 December 2015 publication; answer day unknown
Further evidence: June 2019 selected half-data WRN scored 70.83% versus full-data All-CNN 70.85% on CIFAR-100. ELMo learned unlabeled-text representations benefiting supervised downstream tasks. Qualified research conjunction; synthetic-presentation interpretation unresolved.
Direction: All three predicates supported.
Magnitude: Selected twofold unique-case efficiency; generality unproved.
Timing: 2018–2019 reports fit the original window; first attainment unknown. No reset from 2019 republication.
Scope: Depth means trainability, not universal accuracy. The data comparison changes architecture/schedule, uses a non-frontier baseline and preserves augmentation; near equality is not statistical equivalence. Scientific v4 dates 2019 despite later PDF rendering metadata. Nominal schedules imply 100N versus 350N presentations, not audited exposure. N denotes the full original-example count.
Shared evidence: Shared original/trajectory with recognition/Karpathy and ELMo/January 2016; not independent forecast-skill confirmations.
Evidence confidence: Moderate for the bounded conjunction; lower for the broad data-efficiency magnitude and precise meaning of training cases. Primary research reports are not independent replications.
Current edition contribution · Ilya Sutskever
Graded credit: 75 / 100.
- Recency weight
- 52.953424657534256%
- Credit × weight endpoint products
- 39.71506849315069
- Last documented backing
- 2015-12-29 to 2015-12-29
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 75 / 100
- Recency weight
- 21.5890411%
- Weighted credit term
- 16.19178082
- Same-claim backing date
- 2015-12-29 to 2015-12-29
Existing reviewed grade for the original scope; time intrinsic to that scope is retained.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
75,
75
]
},
"backingDateBounds": [
"2015-12-29",
"2015-12-29"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
75,
75
],
"weightBounds": [
0.21589041095890416,
0.21589041095890416
],
"normalizedBackingDateBounds": [
"2015-12-29",
"2015-12-29"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
75,
75
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Ilya Sutskever29 Dec 2015Chart grade 100 / 100Over five years, speech and visual recognition systems will become more accurate and useful.
By 2017, Microsoft improved conversational-transcription benchmark error to 5.1%.
OutcomeRightDirectionRightMagnitudeNot quantifiedTimingWithin original window
2015-12-29 publication; answer date not specified
Further evidence: Google reported offline, real-time phone dictation in 2019. EfficientNet also improved vision accuracy and efficiency in 2019. Measured recognition improvements and practical efficiency/offline operation support the modest combined claim.
Direction: Both modalities advanced, rather than relying on one successful subfield.
Magnitude: No specific accuracy gain or adoption threshold was promised.
Timing: All supporting observations precede 2020 and therefore fit a five-year horizon for a 2015 answer, despite unknown exact answer date.
Evidence confidence: High for the bounded improvement claim; low-information trend, not a precise breakthrough prediction.
Current edition contribution · Ilya Sutskever
Graded credit: 100 / 100.
- Recency weight
- 52.953424657534256%
- Credit × weight endpoint products
- 52.953424657534256
- Last documented backing
- 2015-12-29 to 2015-12-29
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 100 / 100
- Recency weight
- 21.5890411%
- Weighted credit term
- 21.5890411
- Same-claim backing date
- 2015-12-29 to 2015-12-29
Existing reviewed grade for the original scope; time intrinsic to that scope is retained.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
100,
100
]
},
"backingDateBounds": [
"2015-12-29",
"2015-12-29"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
100,
100
],
"weightBounds": [
0.21589041095890416,
0.21589041095890416
],
"normalizedBackingDateBounds": [
"2015-12-29",
"2015-12-29"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
100,
100
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Elon Musk21 Dec 2015Chart grade 0 / 100Tesla achieves technical autonomy with lower accident risk than human driving around late 2017.
Tesla’s 2018–2019 disclosures showed the technical target was not delivered on time. Whole outcome unresolved.
OutcomeUnresolvedDirectionNot separately gradedMagnitudeNot separately gradedTimingOriginal deadline missed
2015-12-21
Original horizon: approximately two years after 2015-12-21; no exact tolerance supplied
Further evidence: Later restricted driverless service demonstrates genuine progress, but does not establish the original combination of broad capability and lower accident risk than human driving. Restricted driverless service demonstrates progress, not the full capability-and-safety target.
Direction: Not separately graded in the historical record.
Magnitude: Not separately graded in the historical record.
Timing: The original deadline was missed; eventual full-target attainment remains unverified, so no exact delay is assigned.
Scope: Technical readiness and regulatory permission are separate. Restricted fleet service does not establish broad consumer autonomy or validated safety superiority.
Evidence confidence: Not separately rated.
Earlier statement: 2014-10-10 publication; exact recording day not independently verified (Earlier dated technical-autonomy expectation, not a new independent target): Expected driver-independent Tesla travel around 2019–2020, with validation and later regulatory approval distinct. The disclosed 2020 system remained supervised; later restricted service is narrower progress. Secondary transcription, original audio not verified. Deadline: Approximate five-to-six-year window from October 2014, not two independent deadline promises. Outcome: Unresolved. Direction: approximately right. Magnitude: Unresolved. Timing: Deadline missed; eventual status unverified. One earlier material dated formulation; zero additional independent targets, related trajectories or main scorecard votes.
Related statement: Recorded 2018-10-31; public page URL 2018-11-02, visible update 2018-11-05. (Materially revised dated expectation within the existing technical-autonomy target): Expected generalized Tesla self-driving during 2019. Disclosed systems retained driver supervision; later restricted service is partial progress, not worldwide fulfillment. Deadline: 2019 year-end outer boundary; no exact first-availability day asserted. Outcome: Unresolved. Direction: approximately right. Magnitude: Unresolved. Timing: Deadline missed; eventual status unverified. One historical dated formulation; zero added main votes, independent targets or related trajectories.
Later statement: 2021-12-28 publication; recording date unknown (later deadline version of same Tesla autonomy trajectory): Expected Level 4 and below-average-human accident risk during 2022. The consumer system remained supervised; later restricted service does not establish the full comparative-safety target. Deadline: 2022. Outcome: Unresolved. Direction: right for limited later unattended operation only. Timing: Deadline missed; eventual status unverified. No additional independent target/trajectory or scorecard vote.
Current edition contribution · Elon Musk
Graded credit: 0 / 100.
- Recency weight
- 52.821917808219176%
- Credit × weight endpoint products
- 0
- Last documented backing
- 2015-12-21 to 2015-12-21
- Timing deduction recorded
- 0–100 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
Selected deadline or scoped criterion only. This is not a whole-outcome grade. Archive timing: Original deadline missed.
- Credit
- 0 / 100
- Recency weight
- 21.36986301%
- Weighted credit term
- 0
- Same-claim backing date
- 2015-12-21 to 2015-12-21
Known original safety/full-trip scope miss. Restricted later fleet service does not establish broad capability plus lower accident risk than humans; eventual whole-target content remains unverified. Waiver is an unknown range, not presumed partial attainment.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing. The archive identifies later dated expectations (2018-10-31 recording, page 2018-11-02, updated 2018-11-05; and 2021-12-28) as materially revised formulations, with altered deadlines/scope. Keep as version history, not a silent reset of the 2015 claim.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
0,
0
]
},
"backingDateBounds": [
"2015-12-21",
"2015-12-21"
],
"timingCostBounds": [
0,
100
],
"calculated": {
"creditBounds": [
0,
0
],
"weightBounds": [
0.2136986301369862,
0.2136986301369862
],
"normalizedBackingDateBounds": [
"2015-12-21",
"2015-12-21"
],
"timingCostBounds": [
0,
100
],
"deadlineWaiverCreditBounds": [
0,
100
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Andrej Karpathy20 Dec 2015Did not expect AI to threaten humanity over five to ten years beyond ordinary automation risks; five-year destruction was dismissed.
A February 2026 assessment found severe uncontrolled-operation capabilities incomplete, alongside real harms and improving dangerous precursors. Whole outcome unresolved.
OutcomeUnresolvedDirectionPartly rightMagnitudeUnresolvedTimingTiming unresolved
20 December 2015 publication; interview day not independently verified
Further evidence: Narrow capability support does not resolve the full qualitative threat claim or ex-ante risk.
Direction: Limited severe-threat restraint only; not a general risk estimate.
Magnitude: No probability or severity threshold; nonoccurrence does not establish negligible risk.
Timing: Both approximate five-/ten-year windows elapsed; five-year destruction did not occur. Broader threat timing remains unjudgeable.
Scope: Edited firsthand interview, not verified audio; a Tuesday-to-15-December inference is uncertain. Ordinary-automation and broader-threat boundaries remain interpretive; existing harms are not assumed ordinary. Assessment scope is general-purpose AI; evaluation gaps and expert disagreement persist. Survival alone is not full accuracy; no current belief is inferred. An adjacent illustrative percentage is not this forecast’s probability.
Evidence confidence: Moderate for narrow severe-threat capability restraint; low for broad risk characterization and unobserved probabilities.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Andrej Karpathy20 Dec 2015Over several decades, expects good progress approximating nonvisual cortex.
Auditory and language networks improved held-out neural predictions and selected behavioral fits, approximately supporting qualitative progress.
OutcomePartly rightDirectionRightMagnitudePartly supportedTimingTiming unresolved
20 December 2015 publication; interview day not independently verified
Further evidence: Progress, not completed replication; bounded functional matches are substantive.
Direction: Task-optimized modeling extended beyond vision.
Magnitude: Selected functions/datasets, not a representative survey of remaining cortex.
Timing: The vague multi-decade window remains open; early progress is not an exact timing hit.
Scope: Correlation does not establish cortical algorithms or biological identity. Reliability-normalized fits are not percentages of brain explained; weak absolute reliability, poorer story fits, residual variation and random-model signal qualify results. Small intracranial samples omit frontal/top-down systems; training differs from biological learning. Some recordings predate the papers: evidence concerns new comparisons, not newly collected data. Broad, low-discrimination progress; shared models/context are not independent trials. No current-belief update inferred.
Evidence confidence: Moderate: directly matched modeling progress is measured; original magnitude/breadth remains qualitative.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Andrej Karpathy27 Nov 2015Chart grade 100 / 100In a five-year outlook, expects larger composite neural systems built from pretrained, reusable modules and jointly adapted components.
ViLBERT in 2019 combined pretrained BERT and visual-network features with new cross-modal layers and downstream fine-tuning.
OutcomeRightDirectionRightMagnitudeNot quantifiedTimingWithin original window
2015-11-27 publication; answer day unspecified
Further evidence: End-to-End Module Networks in 2017 learned question-specific arrangements of neural components. VL-BERT’s August 2019 primary report additionally documents joint training of pretrained text and visual networks, closing the previous frozen-vision-component gap. Region proposals and annotations still require external provision. The bounded architectural trend is directly realized: pretrained visual/text components plus new modules, jointly adapted. This is not universal plug-and-play compatibility, arbitrary composition or guaranteed improvement on every task.
Direction: Reuse, composition and subsequent adaptation appeared in substantive new systems.
Magnitude: No numerical model-size or adoption share threshold.
Timing: Both reports are comfortably within five years of any 2015 answer; the November original controls, not its December excerpt.
Evidence confidence: Moderate-high for bounded realized architecture; field-wide prevalence and unrestricted compatibility not claimed.
Current edition contribution · Andrej Karpathy
Graded credit: 100 / 100.
- Recency weight
- 52.42739726027398%
- Credit × weight endpoint products
- 52.42739726027398
- Last documented backing
- 2015-11-27 to 2015-11-27
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 100 / 100
- Recency weight
- 20.71232877%
- Weighted credit term
- 20.71232877
- Same-claim backing date
- 2015-11-27 to 2015-11-27
Existing reviewed grade for the original scope; time intrinsic to that scope is retained.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
100,
100
]
},
"backingDateBounds": [
"2015-11-27",
"2015-11-27"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
100,
100
],
"weightBounds": [
0.2071232876712329,
0.2071232876712329
],
"normalizedBackingDateBounds": [
"2015-11-27",
"2015-11-27"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
100,
100
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Demis Hassabis4 Nov 2015Chart grade 75 / 100Better content recommendations in four or five years.
YouTube production tests reported 0.85% more viewing time but 0.16% fewer viewed videos.
OutcomePartly rightDirectionRightMagnitudePartly supportedTimingWithin original window
4 November 2015 event; host reports on 5 and 20 November
Further evidence: Another correction nearly tripled less-popular candidate nominations and increased viewed videos 0.53%, without significant viewing-time change. Supported availability/improvement core, not the whole experiential ambition.
Direction: Measured live gains, not mere continued existence.
Magnitude: Modest and mixed proxies; no forecast percentage.
Timing: Available before the approximate 2019–2020 horizon; early evidence is not exact arrival timing.
Scope: One intact content/viewer-matching target; user-journey and long-tail context are not separate votes. Host reporting, not independently heard audio. No named DeepMind broadcaster release, exact-day deadline or first-arrival claim; recommendation development already existed. The production recurrent recommender used interaction histories. Reward horizons were 4–10 hours; successive experiments changed baselines, so component gains must not be summed. Engagement is not satisfaction or welfare; candidate nomination is not comprehensive long-tail preference coverage. Public v1 was posted 6 December 2018; experiment and first-deployment dates are unspecified. Later 2020/2021 revisions are not backdated.
Shared evidence: One Alphabet platform; outcome authors and forecaster share affiliation. No independent replication or exceptional-foresight inference.
Evidence confidence: Moderate for qualified application improvement; not high for broad qualitative experience or timing precision.
Current edition contribution · Demis Hassabis
Graded credit: 75 / 100.
- Recency weight
- 52.049315068493144%
- Credit × weight endpoint products
- 39.03698630136986
- Last documented backing
- 2015-11-04 to 2015-11-04
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 75 / 100
- Recency weight
- 20.08219178%
- Weighted credit term
- 15.06164384
- Same-claim backing date
- 2015-11-04 to 2015-11-04
Existing reviewed grade for the original scope; time intrinsic to that scope is retained.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
75,
75
]
},
"backingDateBounds": [
"2015-11-04",
"2015-11-04"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
75,
75
],
"weightBounds": [
0.20082191780821912,
0.20082191780821912
],
"normalizedBackingDateBounds": [
"2015-11-04",
"2015-11-04"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
75,
75
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Stuart Russell23 Oct 2015Widespread domestic-robot impact would take more than five years after October 2015, despite possible limited-task versions.
A 2018 nine-country survey reports robot-vacuum use by 17% of respondents. iRobot separately reported over nine million connected devices in 2019. Whole outcome unresolved.
OutcomeUnresolvedDirectionNot applicableMagnitudePartly matched scopeTimingTiming unresolved
2015-10-23
Further evidence: The original next-breakthrough question remains ambiguous. Pre-2020 routine cleaner use is material counterevidence under the ordinary domestic category, but cannot establish the intended scope of a new-breakthrough impact claim. No whole hit or miss is awarded.
Direction: No separate ultimate-robotics or automation direction is credited. This is a bounded timing/scope assessment.
Magnitude: A 2018 nine-country survey reports robot-vacuum use by 17% of respondents, corroborated in scale but not in rates by a large connected installed base in a 2019 company filing. This is meaningful deployment/use, not a global household census or measured aggregate welfare gain.
Timing: Actual use predates October 2020, but original referent/impact threshold is unresolved. Do not add a humanoid, majority, welfare or time-saved threshold; do not manufacture a precise crossing date.
Scope: Partial magnitude review only: full outcome and timing remain unresolved; direction is not separately credited. This is a more-than-five-year lower bound, not a by-2020 promise; the adjacent cars/assistants answer is not imported. Kärcher sponsored Research Now’s online survey of 9,125 people across nine countries. The sponsor describes national samples as representative of ages 18–65, but the questionnaire, country sample sizes, pooling weights and confidence intervals are unavailable. The pooled 17% is neither worldwide prevalence nor a uniform country rate; the China estimate is not independently corroborated. Connected devices are not unique households or an active-use rate; vendor scale does not validate survey percentages, and cumulative sales are not converted to users. No aggregate welfare or time-saved estimate is supplied or imposed as the success threshold. Established cleaners predated issuance; the new-breakthrough referent stays open, without an invented humanoid or majority requirement. IFR supplies category/baseline context, not its forward projection as an observed outcome. This is one lower-bound target, thematically related to SR-C005; no extra use/sales votes or general-assistant verdict.
Evidence confidence: Moderate under the literal limited-task category; lower for the intended breadth of widespread impact. No arbitrary majority threshold is imposed.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Elon Musk8 Oct 2015Chart grade 100 / 100AI becomes pressing before a full Mars colony.
A 2023 multinational urgent-action agreement preceded any human Mars exploration, confirmed absent by NASA in 2025.
OutcomeRightDirectionRightMagnitudeNot quantifiedTimingNo fixed deadline
2015-10-08
Further evidence: Qualitative institutional-priority test is met before the comparison event.
Direction: The stated ordering is supported, not a claim of realized catastrophe.
Magnitude: No objective danger magnitude is credited.
Timing: No calendar deadline; relative order is assessed once as content.
Scope: Altman originated the forecast; Musk explicitly endorsed it. Institutional urgency is the proxy, not proof of catastrophe, AGI or successful mitigation. Low novelty; relative ordering counted once.
Evidence confidence: Moderate: explicit endorsement and primary outcomes, qualitative urgency proxy and low novelty.
Current edition contribution · Elon Musk
Graded credit: 100 / 100.
- Recency weight
- 51.605479452054794%
- Credit × weight endpoint products
- 51.605479452054794
- Last documented backing
- 2015-10-08 to 2015-10-08
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 100 / 100
- Recency weight
- 19.34246575%
- Weighted credit term
- 19.34246575
- Same-claim backing date
- 2015-10-08 to 2015-10-08
Existing reviewed grade for the original scope; time intrinsic to that scope is retained.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
100,
100
]
},
"backingDateBounds": [
"2015-10-08",
"2015-10-08"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
100,
100
],
"weightBounds": [
0.19342465753424642,
0.19342465753424642
],
"normalizedBackingDateBounds": [
"2015-10-08",
"2015-10-08"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
100,
100
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Elon Musk7 Oct 2015Chart grade 100 / 100Major AI breakthroughs will occur within the next few years.
AlphaGo defeated Lee Sedol in March 2016 and Libratus defeated specialist poker professionals in January 2017.
OutcomeRightDirectionRightMagnitudeNot quantifiedTimingWithin original window
2015-10-07
Further evidence: Two major bounded technical advances fit the broad prediction.
Direction: Substantial AI capability progress occurred.
Magnitude: No numerical scale or task threshold was specified.
Timing: Within the broad multi-year window, not evidence of exact-date skill.
Evidence confidence: high for source and events, low specificity and unestablished novelty
Current edition contribution · Elon Musk
Graded credit: 100 / 100.
- Recency weight
- 51.58904109589041%
- Credit × weight endpoint products
- 51.58904109589041
- Last documented backing
- 2015-10-07 to 2015-10-07
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 100 / 100
- Recency weight
- 19.31506849%
- Weighted credit term
- 19.31506849
- Same-claim backing date
- 2015-10-07 to 2015-10-07
Existing reviewed grade for the original scope; time intrinsic to that scope is retained.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
100,
100
]
},
"backingDateBounds": [
"2015-10-07",
"2015-10-07"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
100,
100
],
"weightBounds": [
0.19315068493150678,
0.19315068493150678
],
"normalizedBackingDateBounds": [
"2015-10-07",
"2015-10-07"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
100,
100
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Elon Musk7 Oct 2015Chart grade 0 / 100General autonomous-driving technology works within three years.
Driverless Phoenix rides existed by May 2018, but demonstrated operation remained restricted; full general scope is unverified. Whole outcome unresolved.
OutcomeUnresolvedDirectionPartly rightMagnitudeOverestimatedTimingOriginal deadline missed
2015-10-07
Further evidence: Full general-driving target remains unestablished; no permanent-impossibility inference.
Direction: Actual unattended rides support partial progress, not the fully general operating-domain target.
Magnitude: Operating breadth was overestimated at the original horizon.
Timing: Approximately 2018 target was not demonstrated; no full attainment date is fabricated.
Scope: Industry-wide technical forecast, not Tesla-only or a consumer release date. Restricted driverless rides earn partial direction credit; general anywhere capability and full eventual attainment remain unverified.
Evidence confidence: high original quality; moderate inference about industry breadth
Current edition contribution · Elon Musk
Graded credit: 0 / 100.
- Recency weight
- 51.58904109589041%
- Credit × weight endpoint products
- 0
- Last documented backing
- 2015-10-07 to 2015-10-07
- Timing deduction recorded
- 0–100 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
Selected deadline or scoped criterion only. This is not a whole-outcome grade. Archive timing: Original deadline missed.
- Credit
- 0 / 100
- Recency weight
- 19.31506849%
- Weighted credit term
- 0
- Same-claim backing date
- 2015-10-07 to 2015-10-07
Known general-driving deadline miss. Restricted Phoenix rides do not establish general-anywhere scope. Full current content remains unverified; narrower partial progress is not substituted for the original target.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
0,
0
]
},
"backingDateBounds": [
"2015-10-07",
"2015-10-07"
],
"timingCostBounds": [
0,
100
],
"calculated": {
"creditBounds": [
0,
0
],
"weightBounds": [
0.19315068493150678,
0.19315068493150678
],
"normalizedBackingDateBounds": [
"2015-10-07",
"2015-10-07"
],
"timingCostBounds": [
0,
100
],
"deadlineWaiverCreditBounds": [
0,
100
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Elon Musk7 Oct 2015In a twenty-year outlook, probably more brain-computer-interface activity alongside synthetic AI.
A 2023 Stanford/BrainGate research demonstration combined a brain-computer interface with AI decoding and a language model to translate attempted speech into text.
OutcomePartly rightDirectionRightMagnitudeUnresolvedTimingWithin original window
2015-10-07
Further evidence: This is a concrete new interface capability, not a demonstration of cognitive merger or general intelligence augmentation. Supports the narrow expectation of further BCI activity alongside AI, not stronger notions of cyborg cognition.
Direction: Post-forecast experimental human communication interface with learned decoding supports the stated development direction.
Magnitude: More and truly cyborg lack measurable adoption or integration thresholds; a research demonstration does not establish mass diffusion.
Timing: Observed before the original approximately 2035 outer horizon, an extremely broad low-information upper bound. Not a precise timing hit.
Evidence confidence: High for the dated original and narrow research outcome; moderate for forecast classification and AI-adjacent scope.
Draft formula inputs
No draft score: AI link unclear. No vote, not zero.
Sam Altman6 Oct 2015Driverless-car availability around 2018–2019, with ordinary-consumer access left ambiguous.
Select Waymo riders had fully driverless trips by December 2018, with 2019 continuation and broader October 2020 access.
OutcomePartly rightDirectionNot separately gradedMagnitudeUnresolvedTimingWithin original window
2015-10-06
Original horizon: 3–4 years; calendar window 2018–2019; year-range precision, not exact-day.
Further evidence: The early rides support limited deployment within the forecast window, not unrestricted ordinary-consumer availability. Actual driverless trips support limited deployment, while ordinary-consumer availability remains a narrower or ambiguous match.
Direction: Not separately graded in the historical record.
Magnitude: No separately documented rationale is available.
Timing: Early service fits; broader access doesn’t.
Scope: No first-attainment dates.
Evidence confidence: Not separately rated.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Elon MuskJul–Dec 2015 · rangeChart grade 75 / 100Endorsed practical autonomous-weapon feasibility within years, not decades.
A successor introduced in 2016 was classified operational and autonomous by SIPRI in 2017.
OutcomePartly rightDirectionRightMagnitudePartly supportedTimingTiming unresolved
28 July 2015 letter; endorsement documented by 31 December 2015; exact signature day unknown
Further evidence: Qualified practical availability beyond mixed synthetic tests.
Direction: Constrained operational progress.
Magnitude: Partial; no generality or proliferation claim resolved.
Timing: No exact deadline or first-attainment credit.
Scope: Shared endorsement, not personal authorship. Narrow capability; institutional open-source mapping, not independent testing. Older systems limit novelty. No human-target, unrestricted-reliability or combat-use achievement inferred. HAROP is excluded because classifications conflict.
Shared evidence: Same letter, signatories and technological trajectory are dependent; no extra person or component votes.
Evidence confidence: Moderate-low: dated manufacturer chronology and institutional synthesis, not independently observed operational validation.
Current edition contribution · Elon Musk
Graded credit: 75 / 100.
- Recency weight
- 47.0027397260274–52.98630136986301%
- Credit × weight endpoint products
- 35.25205479452055–39.73972602739725
- Last documented backing
- 2015-01-01 to 2015-12-31
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 75 / 100
- Recency weight
- 11.67123288–21.64383562%
- Weighted credit term
- 8.75342466–16.23287671
- Same-claim backing date
- 2015-01-01 to 2015-12-31
Existing reviewed grade for the original scope; time intrinsic to that scope is retained.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
75,
75
]
},
"backingDateBounds": [
"2015-01-01",
"2015-12-31"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
75,
75
],
"weightBounds": [
0.11671232876712323,
0.21643835616438356
],
"normalizedBackingDateBounds": [
"2015-01-01",
"2015-12-31"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
75,
75
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Jürgen Schmidhuber11 Jul 2015Animal-like interaction and planning in simulation within roughly a decade.
SIMA 2 demonstrates visual interaction, dialogue, goal-directed actions and some transfer across 3D games. Whole outcome unresolved.
OutcomeUnresolvedDirectionRightMagnitudePartly matched scopeTimingTiming unresolved
2015-07-11
Further evidence: Self-improvement uses external Gemini task-setting and reward models; stronger hierarchical examples add Gemini Pro. The Gunk and ASKA progression demonstrations use manual instructions; Genie transfer mainly tests navigation. Short timeouts and different failure modes qualify human comparisons. Memory, long-horizon planning, precise control and robust perception remain limited. Human demonstrations and foundation pretraining remain essential. Broader adaptive cognition remains unresolved; exact mechanism or formal animal certification is not required.
Direction: Relevant virtual-agent functions are demonstrated.
Magnitude: Partly matched; broad animal-like learning remains unverified.
Timing: Uncertain original horizon; partial demonstrations do not establish timely completion.
Scope: A contemporaneous participant recalled five or ten years; the later transcript is edited, not verbatim. No physical body is required. Related 23 November 2016 wording has a different horizon and robotics context; it remains a held version, not a reset, current reaffirmation or second count.
Evidence confidence: moderate for original broad target and partial direction; exact wording unverified
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Yann LeCun2 Jul 2015Chart grade 75 / 100Specialized CNN circuits from developers such as Nvidia, Intel and Qualcomm were expected within one year, enabling varied system integration.
TX1 ran AlexNet in independent November 2015 hardware tests; measured Eyeriss circuitry followed on 2 February 2016.
OutcomePartly rightDirectionRightMagnitudePartly supportedTimingWithin original window
2 July 2015 talk; 3 July publication; unexplained 2 March 2021 page update
Further evidence: Qualcomm demonstrated Snapdragon 820 functionality; QCT launched an Intel-based server in June 2016. Qualified hardware emergence, not complete commercial delivery by every named vendor; that stronger reading remains unresolved, not wrong.
Direction: Actual embedded implementation and a fabricated dedicated CNN accelerator support specialization, not merely generic semiconductor speed.
Magnitude: Partly realized class; no numerical speed, power, price or market-share target.
Timing: Bounded emergence before approximately early July 2016. Qualcomm’s general SDK remained prospective for H2 2016; the undated Eyeriss demonstration is not backdated.
Scope: Expected emergence, not first invention: TK1 and Qualcomm roadmaps already existed. Eyeriss was an MIT-led research prototype with NVIDIA affiliation and Intel support, not demonstrated commercial delivery by those firms. Complete dedicated-chip delivery by all named vendors, mass adoption and autonomous-vehicle deployment remain unestablished. The contemporary attributed report has an unexplained 2021 update; original audio and edit history are unverified.
Shared evidence: One emergence target, related to but distinct from later consumer diffusion; not independent evidence or separate chip/vendor votes. Existing roadmaps limit novelty. Eyeriss reports are same-team, not replication. No current endorsement inferred.
Evidence confidence: Moderate for bounded hardware emergence: contemporary attributed original, independent physical-hardware testing and dated measured test-chip paper. Lower for precise commercial/vendor scope and unchanged original wording after 2021 update.
Current edition contribution · Yann LeCun
Graded credit: 75 / 100.
- Recency weight
- 49.99452054794521%
- Credit × weight endpoint products
- 37.49589041095891
- Last documented backing
- 2015-07-02 to 2015-07-02
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 75 / 100
- Recency weight
- 16.65753425%
- Weighted credit term
- 12.49315068
- Same-claim backing date
- 2015-07-02 to 2015-07-02
Existing reviewed grade for the original scope; time intrinsic to that scope is retained.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
75,
75
]
},
"backingDateBounds": [
"2015-07-02",
"2015-07-02"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
75,
75
],
"weightBounds": [
0.16657534246575345,
0.16657534246575345
],
"normalizedBackingDateBounds": [
"2015-07-02",
"2015-07-02"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
75,
75
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Demis Hassabis22 Jun 2015Self-driving cars within twenty years.
Waymo reported public Phoenix rides by October 2020 without onboard or remote drivers; Waymo reported 65,000 fully autonomous miles during 2019 and the first nine months of 2020.
OutcomeRightDirectionRightMagnitudeNot quantifiedTimingWithin original window
2015-06-22
Further evidence: Geofenced, with operational support. Limited existence supported.
Direction: Observed driverless service.
Magnitude: No fleet share or universal coverage threshold was fixed.
Timing: Realization was documented before the original June 2035 upper bound; no claim of exact first attainment or impressive timing precision.
Evidence confidence: High for restricted driverless operation; moderate for implied practical-service scope.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Demis Hassabis22 Jun 2015Chart grade 75 / 100Predicts expert-level scan interpretation, with AI augmentation of some tasks.
A 2020 primary mammography study reported better discrimination than six radiologists and non-inferior simulated double reading.
OutcomePartly rightDirectionRightMagnitudeUnresolvedTimingNo fixed deadline
2015-06-22
Further evidence: It was a retrospective evaluation, not proof across all scans or routine clinical practice. A substantial example meets the narrow scan-reading comparison; the unrestricted modality/population claim is not fully established.
Direction: Documented expert-comparison performance supports the predicted capability trajectory.
Magnitude: No fixed collection of scan types, clinician population or clinical deployment threshold was specified.
Timing: Long-run placement is clear, but no exact deadline is attached to this sentence.
Evidence confidence: Moderate: peer-reviewed primary study, developer participation and retrospective limits.
Current edition contribution · Demis Hassabis
Graded credit: 75 / 100.
- Recency weight
- 49.83013698630137%
- Credit × weight endpoint products
- 37.37260273972603
- Last documented backing
- 2015-06-22 to 2015-06-22
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 75 / 100
- Recency weight
- 16.38356164%
- Weighted credit term
- 12.28767123
- Same-claim backing date
- 2015-06-22 to 2015-06-22
Existing reviewed grade for the original scope; time intrinsic to that scope is retained.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
75,
75
]
},
"backingDateBounds": [
"2015-06-22",
"2015-06-22"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
75,
75
],
"weightBounds": [
0.1638356164383561,
0.1638356164383561
],
"normalizedBackingDateBounds": [
"2015-06-22",
"2015-06-22"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
75,
75
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Demis Hassabis22 Jun 2015Scientific discovery benefits within twenty years.
AlphaFold reported strong blind CASP14 structure-prediction performance in 2020.
OutcomePartly rightDirectionRightMagnitudeNot quantifiedTimingWithin original window
2015-06-22
Further evidence: A 2025 primary clinical report documents an AI-assisted discovery reaching a randomized phase 2a study, not approved treatment. Concrete benefits to structure research and an early drug-development example support the modest assistance forecast, not every exploratory scientific field.
Direction: AI contributed to scientifically useful predictions and candidate discovery.
Magnitude: No minimum discovery count, time saving or clinical success rate was promised.
Timing: Documented examples precede June 2035; a very broad twenty-year upper bound carries little timing information.
Evidence confidence: Moderate-high for structure research; moderate for drug-discovery contribution, with abstract-only clinical evidence.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Demis Hassabis22 Jun 2015Smarter adaptive tools around five years, with hoped-for contextual search and complex travel assistance.
Contextual search, hotel assistance and reservation functions were available in 2019.
OutcomePartly rightDirectionNot separately gradedMagnitudeUnresolvedTimingWithin original window
2015-06-22
Original horizon: Around five years (approximately 2020); hope and approximate timing.
Further evidence: These are useful realizations of the tool forecast, but they do not establish the stronger vision of a complete, personalized, end-to-end travel workflow. Useful contextual and booking tools emerged; the complete personalized workflow remains unestablished.
Direction: Not separately graded in the historical record.
Magnitude: No separately documented rationale is available.
Timing: Several named functions were available in 2019; timing credit covers those components, not the unverified full workflow.
Scope: The 2015 and 2016 phone forecasts share a diffusion trajectory; they are not independent evidence of repeated broad foresight.
Evidence confidence: Not separately rated.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Yoshua Bengio28 May 2015Chart grade 75 / 100RNN attention substantially improves text comprehension over the next few years.
BiDAF attention ablations improved comprehension by 2017, but adversarial sentences exposed weaknesses.
OutcomePartly rightDirectionRightMagnitudeNot quantifiedTimingWithin original window
2015-05-28
Further evidence: Approximate architecture-specific realization.
Direction: Measured improvement.
Magnitude: No numerical target.
Timing: Observed within the qualitative horizon.
Scope: Benchmark gains do not establish robust understanding.
Shared evidence: Joint LeCun/Bengio/Hinton source; shared attention forecast, not independent evidence.
Evidence confidence: moderate; scope not separately specified.
Current edition contribution · Yoshua Bengio
Graded credit: 75 / 100.
- Recency weight
- 49.41917808219178%
- Credit × weight endpoint products
- 37.06438356164384
- Last documented backing
- 2015-05-28 to 2015-05-28
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 75 / 100
- Recency weight
- 15.69863014%
- Weighted credit term
- 11.7739726
- Same-claim backing date
- 2015-05-28 to 2015-05-28
Existing reviewed grade for the original scope; time intrinsic to that scope is retained.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
75,
75
]
},
"backingDateBounds": [
"2015-05-28",
"2015-05-28"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
75,
75
],
"weightBounds": [
0.1569863013698629,
0.1569863013698629
],
"normalizedBackingDateBounds": [
"2015-05-28",
"2015-05-28"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
75,
75
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Yoshua Bengio28 May 2015Chart grade 75 / 100Longer-term unsupervised learning becomes much more important.
Language, speech and vision pretraining improved; ecosystem-wide magnitude remains unmeasured.
OutcomePartly rightDirectionRightMagnitudeUnresolvedTimingNo fixed deadline
2015-05-28
Further evidence: Broad transfer supports approximate credit.
Direction: Supported across three modalities.
Magnitude: No ecosystem census.
Timing: No calendar deadline.
Scope: Pretraining does not exclude supervised refinement.
Shared evidence: Joint LeCun/Bengio/Hinton source; shared unsupervised forecast, not independent evidence.
Evidence confidence: moderate-high for direction; moderate for full qualitative content
Current edition contribution · Yoshua Bengio
Graded credit: 75 / 100.
- Recency weight
- 49.41917808219178%
- Credit × weight endpoint products
- 37.06438356164384
- Last documented backing
- 2015-05-28 to 2015-05-28
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 75 / 100
- Recency weight
- 15.69863014%
- Weighted credit term
- 11.7739726
- Same-claim backing date
- 2015-05-28 to 2015-05-28
Existing reviewed grade for the original scope; time intrinsic to that scope is retained.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
75,
75
]
},
"backingDateBounds": [
"2015-05-28",
"2015-05-28"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
75,
75
],
"weightBounds": [
0.1569863013698629,
0.1569863013698629
],
"normalizedBackingDateBounds": [
"2015-05-28",
"2015-05-28"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
75,
75
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Geoffrey Hinton28 May 2015Chart grade 75 / 100RNN attention substantially improves text comprehension over the next few years.
BiDAF attention ablations improved comprehension by 2017, but adversarial sentences exposed weaknesses.
OutcomePartly rightDirectionRightMagnitudeNot quantifiedTimingWithin original window
2015-05-28
Further evidence: Approximate architecture-specific realization.
Direction: Measured improvement.
Magnitude: No numerical target.
Timing: Observed within the qualitative horizon.
Scope: Benchmark gains do not establish robust understanding.
Shared evidence: Joint LeCun/Bengio/Hinton source; shared attention forecast, not independent evidence.
Evidence confidence: moderate; scope not separately specified.
Current edition contribution · Geoffrey Hinton
Graded credit: 75 / 100.
- Recency weight
- 49.41917808219178%
- Credit × weight endpoint products
- 37.06438356164384
- Last documented backing
- 2015-05-28 to 2015-05-28
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 75 / 100
- Recency weight
- 15.69863014%
- Weighted credit term
- 11.7739726
- Same-claim backing date
- 2015-05-28 to 2015-05-28
Existing reviewed grade for the original scope; time intrinsic to that scope is retained.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
75,
75
]
},
"backingDateBounds": [
"2015-05-28",
"2015-05-28"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
75,
75
],
"weightBounds": [
0.1569863013698629,
0.1569863013698629
],
"normalizedBackingDateBounds": [
"2015-05-28",
"2015-05-28"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
75,
75
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Geoffrey Hinton28 May 2015Chart grade 75 / 100Longer-term unsupervised learning becomes much more important.
Language, speech and vision pretraining improved; ecosystem-wide magnitude remains unmeasured.
OutcomePartly rightDirectionRightMagnitudeUnresolvedTimingNo fixed deadline
2015-05-28
Further evidence: Broad transfer supports approximate credit.
Direction: Supported across three modalities.
Magnitude: No ecosystem census.
Timing: No calendar deadline.
Scope: Pretraining does not exclude supervised refinement.
Shared evidence: Joint LeCun/Bengio/Hinton source; shared unsupervised forecast, not independent evidence.
Evidence confidence: moderate-high for direction; moderate for full qualitative content
Current edition contribution · Geoffrey Hinton
Graded credit: 75 / 100.
- Recency weight
- 49.41917808219178%
- Credit × weight endpoint products
- 37.06438356164384
- Last documented backing
- 2015-05-28 to 2015-05-28
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 75 / 100
- Recency weight
- 15.69863014%
- Weighted credit term
- 11.7739726
- Same-claim backing date
- 2015-05-28 to 2015-05-28
Existing reviewed grade for the original scope; time intrinsic to that scope is retained.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
75,
75
]
},
"backingDateBounds": [
"2015-05-28",
"2015-05-28"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
75,
75
],
"weightBounds": [
0.1569863013698629,
0.1569863013698629
],
"normalizedBackingDateBounds": [
"2015-05-28",
"2015-05-28"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
75,
75
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Yann LeCun28 May 2015Chart grade 75 / 100RNN attention substantially improves text comprehension over the next few years.
BiDAF attention ablations improved comprehension by 2017, but adversarial sentences exposed weaknesses.
OutcomePartly rightDirectionRightMagnitudeNot quantifiedTimingWithin original window
2015-05-28
Further evidence: Approximate architecture-specific realization.
Direction: Measured improvement.
Magnitude: No numerical target.
Timing: Observed within the qualitative horizon.
Scope: Benchmark gains do not establish robust understanding.
Shared evidence: Joint LeCun/Bengio/Hinton source; shared attention forecast, not independent evidence.
Evidence confidence: moderate; scope not separately specified.
Current edition contribution · Yann LeCun
Graded credit: 75 / 100.
- Recency weight
- 49.41917808219178%
- Credit × weight endpoint products
- 37.06438356164384
- Last documented backing
- 2015-05-28 to 2015-05-28
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 75 / 100
- Recency weight
- 15.69863014%
- Weighted credit term
- 11.7739726
- Same-claim backing date
- 2015-05-28 to 2015-05-28
Existing reviewed grade for the original scope; time intrinsic to that scope is retained.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
75,
75
]
},
"backingDateBounds": [
"2015-05-28",
"2015-05-28"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
75,
75
],
"weightBounds": [
0.1569863013698629,
0.1569863013698629
],
"normalizedBackingDateBounds": [
"2015-05-28",
"2015-05-28"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
75,
75
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Yann LeCun28 May 2015Chart grade 75 / 100Longer-term unsupervised learning becomes much more important.
Language, speech and vision pretraining improved; ecosystem-wide magnitude remains unmeasured.
OutcomePartly rightDirectionRightMagnitudeUnresolvedTimingNo fixed deadline
Canonical scope note: Pretraining does not exclude supervised refinement. No all-AI majority or human-cognition claim. Dependent dated version of YL15-F03: zero new-target/minimum credit; the excluded IEEE horizon and historical grades stay unchanged. No uniqueness, above-consensus foresight or present endorsement inferred.
2015-05-28
Further evidence: Broad transfer supports approximate credit.
Direction: Supported across three modalities.
Magnitude: No ecosystem census.
Timing: No calendar deadline.
Scope: Pretraining does not exclude supervised refinement. No all-AI majority or human-cognition claim. Related to YL15-F03, which remains excluded. No uniqueness, above-consensus foresight or present endorsement inferred.
Shared evidence: Joint LeCun/Bengio/Hinton forecast; shared source and outcomes. Dependent LeCun version of YL15-F03, not independent replication.
Evidence confidence: moderate-high for direction; moderate for full qualitative content
Current edition contribution · Yann LeCun
Graded credit: 75 / 100.
- Recency weight
- 49.41917808219178%
- Credit × weight endpoint products
- 37.06438356164384
- Last documented backing
- 2015-05-28 to 2015-05-28
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 75 / 100
- Recency weight
- 15.69863014%
- Weighted credit term
- 11.7739726
- Same-claim backing date
- 2015-05-28 to 2015-05-28
Existing reviewed grade for the original scope; time intrinsic to that scope is retained.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
75,
75
]
},
"backingDateBounds": [
"2015-05-28",
"2015-05-28"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
75,
75
],
"weightBounds": [
0.1569863013698629,
0.1569863013698629
],
"normalizedBackingDateBounds": [
"2015-05-28",
"2015-05-28"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
75,
75
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Geoffrey Hinton21 May 2015Chart grade 75 / 100Approximately humanlike everyday reasoning within ten years via learned representations; conversation is related; companionship remains possible.
Selected tasks support everyday linguistic inference/judgment.
OutcomePartly rightDirectionRightMagnitudePartly supportedTimingWithin original window
21 May 2015 publication; interview date unknown
Further evidence: Qualified functional attainment; broad-flexibility partial-only alternative remains.
Direction: Relevant neural competence; exact mechanism unvalidated.
Magnitude: Selected-task comparability; no synthetic best-model pooling.
Timing: By May 2025; not earliest or unrestricted attainment.
Scope: Reporter-attributed timeline; quoted modality softer; categorical audio unverified. Nature’s method row is unchanged. Text tasks, not unrestricted embodied/conversational reliability. Nguyen: 34 models/4,407 statements/2,046 mostly US participants. Ten exceeded the human median; 24 did not. Majority agreement/awareness is not objective correctness or comprehensive reasoning. Forced yes/no prompts, cultural/sample dependence and mixed factual/opinion stimuli constrain interpretation. Hu: seven models/374 humans; selected English pragmatics, answer probabilities rather than conversation. Humor, irony and maxims remained weak; scrambling survived without a matched human test. API tests: 11 October 2022. Puzzle: presentation/coding and o1/o1-mini naming matter; GPT-4 outputs were inherited, not a newly dated run; no reliability estimate. Discourse: historical controls and unequal exposures; nonsignificance is not equivalence; unmatched summary assessment. March/April 2024 tests. May 2025 publications bound existence, not unknown run dates. The July 2024 reasoning abstract reports shared content effects and differing errors; no full-methods/numeric audit. July 2025 argumentation is abstract-only, with unknown run dates and unread full methods; no pre-May evidence. SimpleBench’s August 2026 operator snapshot: 81.9% leading score versus nine humans’ 83.7%; small multiple-choice baseline and unavailable full methods preclude representative equivalence or May 2025 timing.
Shared evidence: Nature/translation are dependent historical context with distinct predicates, not new confirmations. Hu coauthors pragmatics and puzzles: distinct data, not independent teams.
Evidence confidence: Moderate for qualified functional attainment; lower for broad flexible reasoning and exact mechanism correspondence.
Current edition contribution · Geoffrey Hinton
Graded credit: 75 / 100.
- Recency weight
- 49.30410958904109%
- Credit × weight endpoint products
- 36.978082191780814
- Last documented backing
- 2015-05-21 to 2015-05-21
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 75 / 100
- Recency weight
- 15.50684932%
- Weighted credit term
- 11.63013699
- Same-claim backing date
- 2015-05-21 to 2015-05-21
Existing reviewed grade for the original scope; time intrinsic to that scope is retained.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
75,
75
]
},
"backingDateBounds": [
"2015-05-21",
"2015-05-21"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
75,
75
],
"weightBounds": [
0.15506849315068483,
0.15506849315068483
],
"normalizedBackingDateBounds": [
"2015-05-21",
"2015-05-21"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
75,
75
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Kai-Fu Lee17 May 2015Chart grade 25 / 100Machines can perform most human jobs by May 2025.
Approximate miss: broad 2025 assessments still require human duties and oversight, despite substantial task automation.
OutcomeMostly wrongDirectionRightMagnitudeOverestimated at deadlineTimingOriginal deadline missed
2015-05-17
Further evidence: Qualified approximate miss inferred from complementary broad capability assessments, not from a census of unavailable products or employment totals. GenAI-only global evidence and all-automation US evidence each have scope limits.
Direction: Substantial cognitive and physical task automation is real; the report includes positive technical potential, not only contrary examples.
Magnitude: Majority of complete human jobs is substantially stronger than majority of task-hours. Human oversight and nonautomatable duties remain important even in highly exposed occupations.
Timing: Ten years from the explicitly dated May 17, 2015 speech ends May 17, 2025. The May 20 report and November cross-check support an approximate deadline miss; no eventual impossibility or exact worldwide May 17 share is claimed.
Evidence confidence: Moderate for approximate whole-job deadline miss; not a precise global capability estimate.
Current edition contribution · Kai-Fu Lee
Graded credit: 25 / 100.
- Recency weight
- 49.23835616438356%
- Credit × weight endpoint products
- 12.30958904109589
- Last documented backing
- 2015-05-17 to 2015-05-17
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 25 / 100
- Recency weight
- 15.39726027%
- Weighted credit term
- 3.84931507
- Same-claim backing date
- 2015-05-17 to 2015-05-17
This state-at-time, annual trajectory or original-period market/adoption predicate already includes time in its meaning. There is no separate event-arrival penalty to add back; preserve the reviewed original credit and temporal scope.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
25,
25
]
},
"backingDateBounds": [
"2015-05-17",
"2015-05-17"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
25,
25
],
"weightBounds": [
0.1539726027397259,
0.1539726027397259
],
"normalizedBackingDateBounds": [
"2015-05-17",
"2015-05-17"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
25,
25
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Elon Musk30 Mar 2015Chart grade 75 / 100Fully autonomous cars will become substantially safer than human driving within the next decade.
Primary retrospective studies establish materially lower collision/injury rates for actual Waymo driverless deployments during the original decade, against relevant human exposure benchmarks.
OutcomePartly rightDirectionRightMagnitudePartly supportedTimingWithin original window
2015-03-30 (publication; interview day unspecified)
Further evidence: Substantial support from real driverless deployments, but a bounded operational example does not resolve all breadth in the original general wording. No universal/all-road condition is retroactively imposed.
Direction: Positive relative safety performance is established in the studied deployments.
Magnitude: Large reductions support the qualitative emphasis approximately; no precise factor was forecast. No broad mortality reduction or zero-risk inference.
Timing: The demonstrated domain-limited advantage falls before March 2025, within the original decade. This is not a claim that every possible interpretation was fulfilled by that deadline.
Evidence confidence: High for bounded empirical evidence; moderate for original reporter-attributed claim and qualitative scope interpretation.
Current edition contribution · Elon Musk
Graded credit: 75 / 100.
- Recency weight
- 48.44931506849315%
- Credit × weight endpoint products
- 36.33698630136986
- Last documented backing
- 2015-03-30 to 2015-03-30
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 75 / 100
- Recency weight
- 14.08219178%
- Weighted credit term
- 10.56164384
- Same-claim backing date
- 2015-03-30 to 2015-03-30
Existing reviewed grade for the original scope; time intrinsic to that scope is retained.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
75,
75
]
},
"backingDateBounds": [
"2015-03-30",
"2015-03-30"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
75,
75
],
"weightBounds": [
0.14082191780821907,
0.14082191780821907
],
"normalizedBackingDateBounds": [
"2015-03-30",
"2015-03-30"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
75,
75
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Jensen Huang17 Mar 2015Pascal training systems would deliver roughly ten times Maxwell performance, via compute/memory advances and greater multi-GPU scaling.
Vendor reports show substantial training progress, but the rough tenfold architectural target is unresolved.
OutcomeUnresolvedDirectionRightMagnitudePartly supportedTimingTiming unresolved
2015-03-17
Further evidence: AlexNet fell from 25 hours on four Maxwell GPUs to two on eight Pascal GPUs; updating Maxwell software cut its time to 8.2 hours. Neither comparison isolates the forecast mechanism. Broad progress cannot replace the defining numerical mechanism; the earlier yellow was withdrawn, not reversed to wrong.
Direction: Both historical and updated-baseline comparisons support improvement.
Magnitude: 25/2 = 12.5× includes software gains; 8.2/2 = 4.1× is not an isolated architectural estimate. Original 5× compute/memory and 2× scaling remain unvalidated.
Timing: 2016 generation horizon, not an exact benchmark deadline. Full-target attainment is unverified; no timing success or delay inferred.
Scope: Four-to-eight GPUs and mixed precision were allowed; no fixed cost/power or universal-workload promise. Figure 24 is vendor-selected AlexNet evidence, not independent replication; quality, software, batching and stopping remain incomplete. A preproduction label on another figure is not transferred. August 2016 Caffe/cuDNN5 makes the Maxwell baseline 8.2 hours; its four-Pascal comparison takes 5.5, versus DGX-1 at two. The DGX-1 row leaves configuration details unspecified, so this is not a common-code causal test. A November 2017 independent study identifies NVIDIA’s result as FP16/90 epochs. Its own FP32 DGX-1 takes 6h09/100 epochs/batch512, or 2h10 with LARS/batch4096, at 58.3%/58.4% accuracy. Protocol sensitivity is not disproof of permitted mixed precision or independent reproduction of the original Maxwell comparison; later gains cannot repair 2016 magnitude. Right direction and partial magnitude only; no completed credit. Related H-C002 remains unresolved. Not a wrong forecast. No later same-scope endorsement is established; the original generation and magnitude are not reset. The earlier yellow remains historical provenance after the independent fairness correction.
Shared evidence: Distinct earlier generation target; related H-C002 stays separate and unresolved. The shared trajectory is dependent, not an independent forecasting vote.
Evidence confidence: Moderate for substantial direction; insufficient for full numerical architectural fulfillment. Original estimate was explicitly rough; the forecast is not scored wrong.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Jürgen SchmidhuberMar 2015 · rangeChart grade 100 / 100Supervised and reinforcement-learning recurrent networks will scale substantially within roughly five years.
Deep Speech 2 enlarged recurrent speech workloads; OpenAI Five expanded recurrent self-play training.
OutcomeRightDirectionRightMagnitudeQualitatively supportedTimingWithin original window
2015-03
Further evidence: Both preceded 2020. Both branches of the explicit scaling forecast are supported by primary system reports, not by transformer scaling or generic hardware improvements. Supervised speech and recurrent self-play reinforcement learning are direct scope matches.
Direction: Recurrent systems were made deeper/larger and their actual training workloads materially expanded.
Magnitude: Nearly eightfold per-example computation in supervised speech and large recurrent-RL training provide substantial examples. The forecast supplies no universal numerical threshold or requirement that every RNN application scale.
Timing: The dated reports fall within the approximately five-year March 2015–March 2020 horizon posed in the original question. Exact answer day is not established and is not invented.
Scope: Commercial dominance was not established.
Evidence confidence: High for the stated scaling occurrence; moderate for the vague adjective substantial and contextual horizon.
Current edition contribution · Jürgen Schmidhuber
Graded credit: 100 / 100.
- Recency weight
- 47.97260273972603–48.465753424657535%
- Credit × weight endpoint products
- 47.97260273972603–48.465753424657535
- Last documented backing
- 2015-03-01 to 2015-03-31
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 100 / 100
- Recency weight
- 13.28767123–14.10958904%
- Weighted credit term
- 13.28767123–14.10958904
- Same-claim backing date
- 2015-03-01 to 2015-03-31
Existing reviewed grade for the original scope; time intrinsic to that scope is retained.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
100,
100
]
},
"backingDateBounds": [
"2015-03-01",
"2015-03-31"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
100,
100
],
"weightBounds": [
0.13287671232876708,
0.14109589041095894
],
"normalizedBackingDateBounds": [
"2015-03-01",
"2015-03-31"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
100,
100
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Jürgen SchmidhuberMar 2015 · rangeExisting ML methods with minor extensions achieve many important superhuman feats.
AlphaGo beat Lee Sedol 4–1 in 2016; LipNet outperformed three experienced lipreaders; OpenAI Five beat champion OG 2–0 in 2019 under restricted rules.
OutcomePartly rightDirectionRightMagnitudePartly matched scopeTimingTiming unresolved
March 2015 AMA; exact answer day unverified.
Further evidence: Qualified core-method continuity across consequential tasks, not proof that every change was minor.
Direction: Direct human comparisons support task-level advances.
Magnitude: Many/important and minor are unquantified; task breadth remains limited.
Timing: 2016–2019 fits the 5/10/20-year question, not a unique deadline; the separate 2035 hardware scenario is not imported.
Scope: AlphaGo combined familiar policy/value networks, search and supervised/self-play learning; Lee Sedol won one game. LipNet’s 11.4% word error versus 47.7% human mean used unseen speakers and fixed six-word grammar; three hearing-impaired participants had instructions and ten-minute familiarization. The separate 95.2% accuracy uses overlapping speakers, not this comparison. Its CNN/GRU/bidirectional/CTC components predate 2015. Five used LSTM/PPO, restricted heroes/items, structured observations and scripted actions. Its 99.4% public win rate includes abandonments, not population mastery. PPO introduced a new policy-gradient objective; continuity is not unchanged 2015 code. New combinations, optimization and engineering matter. Under strict no-material-innovation or broad-domain readings, full content remains unresolved. Details were explicitly uncertain. Prior superhuman AI limits novelty. No AGI or universal professional/clinical superiority follows. Shared AMA/Dota evidence adds no independent trials; no current-belief update.
Evidence confidence: Moderate, strongly interpretation-sensitive on minor extensions and the breadth of superhuman feats.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Jensen Huang11 Feb 2015NVIDIA’s Tesla accelerator business maintains its rapid growth trajectory over the coming year.
The FY 2016 filing reports increased Tesla revenue in the year ended January 31, 2016. Whole outcome unresolved.
OutcomeUnresolvedDirectionRightMagnitudeUnresolvedTimingTiming unresolved
2015-02-11
Further evidence: A comparable Tesla-only growth rate is unavailable, so maintained trajectory remains unresolved. Positive revenue change does not establish maintained growth trajectory.
Direction: Same-business increase is directly disclosed.
Magnitude: Tesla-only year-over-year rate unavailable in inspected primary disclosures; trajectory wording also ambiguous.
Timing: Increase occurred in target year, but the full trajectory claim cannot be timed as fulfilled.
Scope: NVIDIA’s own accelerator business, not Tesla cars: HPC/cloud and AI mix, not AI-only revenue. The coming-year answer extends beyond the interviewer’s separate Q1 question. Recent near-doubling supplies context, not an exact 100% threshold. Quartr-attributed professional transcription, not independently audio-verified. Data-center reporting combines Tesla and GRID; total company or aggregate data-center growth cannot settle Tesla’s rate. The April 2016 analyst comparison with overall-company growth is not a management Tesla-only statistic. Positive annual direction is not full trajectory or timing success. Related H-C001 platform diffusion shares a mechanism, not an independent trial; no extra product/business votes. The February 2015 filed CFO tables aggregate GPU products and give Tesla only qualitative growth; no comparable numerical annual Tesla baseline is disclosed. An annual-basis reply does not unambiguously identify realized full-year sales versus an annualized exit rate. The conditional inequality is sensitivity, not an observed growth rate or miss.
Evidence confidence: High for disclosed positive direction; unresolved for full magnitude.
Draft formula inputs
No draft score: out of scope. No vote, not zero.
Jürgen Schmidhuber2 Feb 2015Neural-network assistance enables faster diagnoses and access for substantially more patients.
Qualified pathway-level success: rapid retinal-screening feedback increased completed referral visits in a randomized Rwandan study.
OutcomePartly rightDirectionRightMagnitudePartly matched scopeTimingTiming unresolved
2 February 2015 authored article
Further evidence: Another implementation had poor follow-through. Qualified enabling-capability example; medicine-wide realization remains unverified.
Direction: Completed visits, not benchmark accuracy alone.
Magnitude: No numerical threshold; local increase, but population totals, affordability and equal access remain unestablished.
Timing: 2021 fits the contextual window; no exact deadline or first-realization verdict.
Scope: The explicit 2025-series context supports a moderate-confidence multiyear horizon; the clause says near future, not a hard 2025 deadline. Enabling assistance, not every diagnosis, physician replacement or guaranteed global uptake. No current same-scope endorsement is inferred. Four Rwandan diabetes clinics randomized 275 AI-positive adults with gradable images. Neural-network feedback arrived within 60 seconds versus human-grading feedback after 3–5 days. Completed referral examinations were 70/136 (51.5%) versus 55/139 (39.6%). Trained staff captured images and human overreading remained. Both groups received travel/copayment reimbursement information; counseling and report timing differed, so the effect belongs to the supported pathway, not an isolated algorithm. Nearly half still did not attend. Selection required willingness and ability to travel; 60% were urban and prior peer-reviewed local diagnostic validation was lacking. Screening occurred March–June 2021, follow-up through July; publication was April 2022. No blindness reduction or general medical-access effect is established. A different Indian public-health implementation in February–June 2022, published September 2025, recorded only 9/64 referral attendances. Diagnostic performance varied with image quality, infrastructure and workflow. It is counterweight to generalization, not a replication of the Rwandan treatment effect.
Evidence confidence: Moderate for narrow enabled-access outcome; limited for broader medical scope, magnitude and timing.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Rodney Brooks22 Jan 2015Exponential cobot sales/deployment growth over several years, with takeoff in 2015.
Universal Robots reported 2015 revenue DKK418 million, up 91%; 2016 revenue DKK662 million implies 58.4%, not the separately stated 62%. Whole outcome unresolved.
OutcomeUnresolvedDirectionRightMagnitudePartly supportedTimingTiming unresolved
22 January 2015
Further evidence: Disclosures cite over 6,500 cumulatively sold and later over 10,000 operating robots. Full exponential trajectory and new 2015 takeoff remain unresolved; partial evidence only.
Direction: Substantive competitive expansion is supported.
Magnitude: Incomplete annual units and lower bounds preclude precise unit-growth multiples or CAGR.
Timing: 2015 growth cannot distinguish new takeoff from an earlier trend; no fixed end year invented.
Scope: Industry-wide forecast; one vendor is not the whole market. Revenue, cumulative sales and operating stock are different measures, not a comparable annual unit series. Analyst estimates are not an audited industry census. Forecast future sales are excluded.
Shared evidence: Strongly dependent on the later 2018 growth forecast; not a Rethink product schedule.
Evidence confidence: Moderate for substantive expansion; low for the full growth shape and onset. Vendor disclosures and analyst estimates are not an industry-wide audited unit series.
Draft formula inputs
No draft score: AI link unclear. No vote, not zero.
Stuart RussellJan 2015 · rangeOver the long run, commercial and military AI momentum would only strengthen.
Global AI investment rose strongly over 2014–2025 but fell in 2022–2023.
OutcomePartly rightDirectionPartly rightMagnitudeNot quantifiedTimingNo fixed deadline
January 2015; delivery day not independently verified
Further evidence: US military AI institutions gained budgets and persisted through reorganizations. Qualified paired strengthening, not an everlasting no-reversal law; individual military programs also ended.
Direction: Both sectors strengthened; military evidence is principally US, not a country census.
Magnitude: No multiplier or market-share target; observed amounts are evidence, not a forecast threshold.
Timing: No calendar endpoint. Current support is neither a timing hit nor a guarantee of further growth.
Scope: AAAI slides and editable metadata support January, not an independently verified delivery day. One paired target; no sector votes, quantitative success or operational-effectiveness credit. AI Index 2026 reports nominal corporate investment of $19.04 billion (2014) and $581.69 billion (2025), with 2022–2023 declines. Its transaction coverage is not R&D, profit or adoption; one edition’s revised history is used. GAO reports JAIC’s 2018 creation and budgets of $89/$242.5/$278.2 million for FY 2019/2020/2021—not outlays or deployed-system counts. Pre-2015 AI work limits novelty. Joint Common Foundation ended while alternatives and successor CDAO continued; dated follow-ups retain unfinished coordination. The live follow-up page is used only for explicitly dated pre-cutoff events. The 2026 strategy indicates commitment, not performance. The 2026 report’s incomplete 378-use-case inventory is not comparable with 2021’s 685 project/line-item accounts. The 2021 inventory omitted operations/maintenance and classified work; staffing and collaboration gaps remain. Not an all-country or all-future finding.
Shared evidence: Shares Russell’s broader thesis and commercial evidence with other reviewed forecasts; not independent replications.
Evidence confidence: Moderate: strong aggregate trajectory evidence; informal momentum metric, principally US military coverage, no exact deadline and a stronger rhetorical monotonic clause.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Gary MarcusDec 2014 · rangeData for complete human-brain simulation remain unavailable for a decade, with a more tentative second-decade extension.
Brain-mapping evidence supports a detailed-input bottleneck, while a human-scale functional simulation contradicts an overly broad claim that no simulation was possible.
OutcomePartly rightDirectionNot separately gradedMagnitudeUnresolvedTimingTiming unresolved
Recorded 2014-12-08; published 2014-12-15
Original horizon: primary boundary 2014-12-08 through 2024-12-08, publication-date sensitivity through 2024-12-15; second-decade possibility not mature
Further evidence: The substantive distinction is biological fidelity and measured input detail, not merely missing evidence. Detailed-input limitations remain substantive, but an actual functional simulation defeats the broadest no-simulation interpretation.
Direction: Not separately graded in the historical record.
Magnitude: No separately documented rationale is available.
Timing: Evidence near the 2024 horizon does not resolve the exact December boundary or required fidelity.
Scope: Measured individual-brain inputs differ from imaging-based functional or sampled models. Evidence includes scale documentation and a simulation abstract and figures; the full simulation paper was not read.
Evidence confidence: Not separately rated.
Draft formula inputs
No draft score: AI link unclear. No vote, not zero.
Elon Musk5 Nov 2014Chart grade 100 / 100Mainstream regulated driverless adoption probably no sooner than seven years, perhaps ten.
Restricted services existed earlier; 2021 and June 2022 regulator observations still described limited deployment. Whole outcome unresolved.
OutcomeUnresolvedDirectionPartly rightMagnitudeUnresolvedTimingCorrect lower bound
2014-11-05
Further evidence: Full mainstream target remains undefined and unestablished.
Direction: Localized adoption.
Magnitude: No penetration threshold was given.
Timing: Paired observations support the qualified seven-year lower bound; US scope, not a global exact-day census.
Evidence confidence: moderate-low: publisher transcript and broad adoption definition
Current edition contribution · Elon Musk
Graded credit: 100 / 100.
- Recency weight
- 46.06575342465754%
- Credit × weight endpoint products
- 46.06575342465754
- Last documented backing
- 2014-11-05 to 2014-11-05
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
Selected deadline or scoped criterion only. This is not a whole-outcome grade. Archive timing: Correct lower bound.
- Credit
- 100 / 100
- Recency weight
- 10.10958904%
- Weighted credit term
- 10.10958904
- Same-claim backing date
- 2014-11-05 to 2014-11-05
Existing reviewed grade for the original scope; time intrinsic to that scope is retained.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
100,
100
]
},
"backingDateBounds": [
"2014-11-05",
"2014-11-05"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
100,
100
],
"weightBounds": [
0.1010958904109589,
0.1010958904109589
],
"normalizedBackingDateBounds": [
"2014-11-05",
"2014-11-05"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
100,
100
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Geoffrey HintonNov 2014 · rangeChart grade 75 / 100Neural encoder–decoders displace phrase-based translation within a few years, using language-specific networks for all pairings.
Major services switched by 2017; multilingual designs partly differed.
OutcomePartly rightDirectionRightMagnitudePartly matched scopeTimingTiming unresolved
2014-11
Further evidence: Approximately right for the central displacement forecast, supported by comparative evaluations and actual major-service transitions. The asserted per-language/all-pairings design was only partly demonstrated; a prominent deployed multilingual model shared networks. This is not literal full conformity.
Direction: Independent 2017 analysis of 2016 systems and two major providers document the predicted neural encoder–decoder transition away from phrase-based translation.
Magnitude: Broad transition across tested directions and deployed languages is supported. No universal model-pairing or language-independent human-thought representation is established.
Timing: The central transition occurred in 2016–2017, within an ordinary reading of a few years. Exact completion of the entire architecture/pairing bundle is unverified, so overall timing remains unresolved.
Scope: Approximate central success, not exact mechanism fulfillment. Google shared networks; all-pairing scope remains unverified. Direct translation required further training.
Evidence confidence: Moderate. Strong matched evidence for central transition, with incomplete multilingual scope and an alternative deployed architecture.
Current edition contribution · Geoffrey Hinton
Graded credit: 75 / 100.
- Recency weight
- 46–46.47671232876712%
- Credit × weight endpoint products
- 34.5–34.85753424657534
- Last documented backing
- 2014-11-01 to 2014-11-30
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 75 / 100
- Recency weight
- 10–10.79452055%
- Weighted credit term
- 7.5–8.09589041
- Same-claim backing date
- 2014-11-01 to 2014-11-30
Existing reviewed grade for the original scope; time intrinsic to that scope is retained.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
75,
75
]
},
"backingDateBounds": [
"2014-11-01",
"2014-11-30"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
75,
75
],
"weightBounds": [
0.1,
0.10794520547945208
],
"normalizedBackingDateBounds": [
"2014-11-01",
"2014-11-30"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
75,
75
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Geoffrey HintonNov 2014 · rangeChart grade 50 / 100Expects a system that watches a YouTube video and narrates its events within five years.
Pre-2019 systems described multiple visual events without supplied boundaries, but retained repetition, mistaken actions and broken narration.
OutcomeMixedDirectionRightMagnitudeUnresolvedTimingTiming unresolved
2014-11
Further evidence: Later 2026 studies show coherent longer-video summaries alongside grounding and prioritization weaknesses; they do not resolve full-target timing. Genuine multi-event narration supports a mixed qualitative judgment, not a measured pass rate or unqualified success.
Direction: Event detection with natural-language descriptions substantively advanced.
Magnitude: No original accuracy threshold, universal reliability or human-parity requirement.
Timing: Partial realization preceded November 2019; full-target timing remains unresolved.
Scope: Uncertain expectation, not a guarantee; connected events, not object labels. Exact timestamps, compression budgets and perfection are not required. Later results depend substantially on transcripts; model-label inconsistencies preclude precise score reuse. Caption/LLM metrics are not success percentages.
Evidence confidence: Moderate for mixed capability judgment; low for a binary deadline verdict.
Current edition contribution · Geoffrey Hinton
Graded credit: 50 / 100.
- Recency weight
- 46–46.47671232876712%
- Credit × weight endpoint products
- 23–23.23835616438356
- Last documented backing
- 2014-11-01 to 2014-11-30
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 50 / 100
- Recency weight
- 10–10.79452055%
- Weighted credit term
- 5–5.39726027
- Same-claim backing date
- 2014-11-01 to 2014-11-30
Existing reviewed grade for the original scope; time intrinsic to that scope is retained.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
50,
50
]
},
"backingDateBounds": [
"2014-11-01",
"2014-11-30"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
50,
50
],
"weightBounds": [
0.1,
0.10794520547945208
],
"normalizedBackingDateBounds": [
"2014-11-01",
"2014-11-30"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
50,
50
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Nick Bostrom22 Jul 2014Chart grade 75 / 100General learning would broaden cognitive capability and begin substituting for human effort, at an uncertain pace.
Qualified early cross-task substitution is supported; not whole-job, economy-wide replacement or AGI.
OutcomePartly rightDirectionPartly rightMagnitudePartly matched scopeTimingNo fixed deadline
2014-07-22
Further evidence: Completed, assessed outputs—not just releases—support this weaker, earlier predicate.
Direction: Abstract reasoning and cross-task progress are supported.
Magnitude: Local gains across tasks; prevalence, workforce-average effects and all-condition reliability remain unestablished.
Timing: No pace commitment; the 5/10/15-year question was context, not a deadline.
Scope: Official corrected 2014 testimony, not the separate 2017 session. Broad, weakly discriminating trajectory; no prescribed architecture. Human direction, checking and editing can coexist with early substitution; unconstrained general learning remains unestablished. Matched geometry: AG2 solved 30/30 versus AG1’s 25, strengthened classical baseline 21 and hybrid 27; on 50 problems, 42 versus AG1’s 27. TongGeometry also reached 30/30. Narrow geometry/formalization, not exclusive primacy; compute and engineering were not controlled. May 2026 expert mathematical papers verify a new AI-derived primitive-set contribution resolving two 1966 conjectures. Human checking, exposition and extension remain integral; not autonomous general mathematics. March 2023 Noy–Zhang preprint: 444 professionals, bounded writing tasks and blinded same-occupation grading; time fell 37%, grades rose 0.45 SD. Unedited initial outputs and brief post-paste activity support drafting-effort substitution, not whole jobs. The final abstract reports 453 participants, 40% less time and 18% better quality; full final methods were not inspected. Versions are one study, not replications. MIT’s researcher account: short, explicit tasks did not require precise factual accuracy or company/customer context; participants were anonymous. Transfer to actual employment remains limited. ChatGPT’s pretrained GPT-3.5 model used supervised conversation and human-feedback learning; this anchors general-model learning, not independently verified output quality. Errors and prompt sensitivity remain. Peng’s one-task Copilot trial showed assisted completion-time gains, conditioned on completers; not autonomous developer replacement. Vendor affiliation, possible training familiarity and untested broader quality, security and maintenance limit transfer. Google’s one-employer, constructed coding task also showed local assistance; its preferred adjusted estimate was uncertain. Vendor-affiliated tools, not independent replication or a workforce average. Narrow maintainer trial found slower work. GDPval: same frontier models produced 220 specified professional deliverables across 44 occupations, judged blind against expert work. Provider-associated evaluation supports breadth, not a random occupational census, sustained autonomy or full-job replacement. One 758-consultant study found assisted creative work improved but difficult business analysis worsened. BCG and Harvard summaries describe the same jagged-frontier experiment, not replications. No numerical pooling across studies or extra forecast counts; shared outcomes are not independent forecasting observations.
Evidence confidence: Moderate for beginning cross-domain task substitution; limited for representative economic breadth and no AGI/timing judgment.
Current edition contribution · Nick Bostrom
Graded credit: 75 / 100.
- Recency weight
- 44.323287671232876%
- Credit × weight endpoint products
- 33.24246575342465
- Last documented backing
- 2014-07-22 to 2014-07-22
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 75 / 100
- Recency weight
- 10%
- Weighted credit term
- 7.5
- Same-claim backing date
- 2014-07-22 to 2014-07-22
Existing reviewed grade for the original scope; time intrinsic to that scope is retained.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
75,
75
]
},
"backingDateBounds": [
"2014-07-22",
"2014-07-22"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
75,
75
],
"weightBounds": [
0.1,
0.1
],
"normalizedBackingDateBounds": [
"2014-07-22",
"2014-07-22"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
75,
75
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Andrej Karpathy3 Jul 2014Chart grade 100 / 100Expects considerable improvements in video models over the coming years.
I3D reported substantial action-recognition gains and temporally structured features by 2018.
OutcomeRightDirectionRightMagnitudeNot quantifiedTimingNo fixed deadline
2014-07-03
Further evidence: Its evaluation improved on earlier models across UCF-101 and HMDB-51, while leaving broader transfer to other video tasks unverified. The modest substantive forecast of considerable video-model improvements is directly supported by later comparative action-recognition research and learned temporal features.
Direction: Performance and feature transfer improved on two established video-action benchmarks.
Magnitude: Considerable was not a numerical threshold. Later large measured gains support the wording but do not manufacture a numeric prediction.
Timing: Coming years is an explicitly multi-year horizon without a fixed upper endpoint. The inspected result was published about four years later; no exact deadline accuracy is claimed.
Evidence confidence: Moderate-high for bounded video-action-recognition target; low-specificity continuation forecast.
Current edition contribution · Andrej Karpathy
Graded credit: 100 / 100.
- Recency weight
- 44.010958904109586%
- Credit × weight endpoint products
- 44.010958904109586
- Last documented backing
- 2014-07-03 to 2014-07-03
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 100 / 100
- Recency weight
- 10%
- Weighted credit term
- 10
- Same-claim backing date
- 2014-07-03 to 2014-07-03
Existing reviewed grade for the original scope; time intrinsic to that scope is retained.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
100,
100
]
},
"backingDateBounds": [
"2014-07-03",
"2014-07-03"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
100,
100
],
"weightBounds": [
0.1,
0.1
],
"normalizedBackingDateBounds": [
"2014-07-03",
"2014-07-03"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
100,
100
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Yann LeCun20 Feb 2014Within a couple of years, Facebook AI advances content understanding across modalities to help users sift information.
Meta reports 2021 Reels themed recommendations and 2023 Facebook/Instagram content-to-interest production.
OutcomePartly rightDirectionPartly rightMagnitudePartly supportedTimingTiming unresolved
20 February 2014
Further evidence: A 2026 private multiweek ConnectionMind test reported exposure +0.33% ±0.08%, watch time +0.43% ±0.14%, and video sessions +0.22% ±0.13%. Qualified eventual functional bundle; unrestricted deep comprehension remains unresolved.
Direction: Beyond existing 2014 recognition: actual content-to-interest deployment.
Magnitude: Local engagement proxies, not every modality, universal benefit, human equivalence or wellbeing.
Timing: 2021–2026 evidence is not a 2016 hit. Couple-of-years wording is approximate; first attainment unknown, no exact miss/lag invented.
Scope: Provider accounts, not independent replication. Multimodal summaries, personal profiles and social-graph reasoning are bundled; semantic causation is not isolated. Tens of millions reported; allocation, test dates and ± confidence level unstated. Preprint, not established peer review; 2018 template boilerplate does not date it. Earlier synthetic text/visual QA and narrow 2016 photo descriptions remain bounded; 2016 deep feed-understanding counterevidence remains. June 2016 DeepText is not backdated.
Shared evidence: One linked content/user-interest forecast, not six modality votes.
Evidence confidence: Moderate for eventual bounded functional implementation; lower for broad semantic completeness, independent outcome validation and first-attainment timing.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Andrej KarpathyJan–Apr 2014 · rangeChart grade 75 / 100Expects a very successful, widely used JavaScript machine-learning library within a few years.
By 2018–early 2019 TensorFlow.js had substantial distribution, contributors and reported production use, with independent research documenting functioning browser ML.
OutcomePartly rightDirectionRightMagnitudePartly supportedTimingTiming unresolved
Public by 2014-04-26; interview approximately February 2014
Further evidence: Numerical success threshold and exact punctuality are unspecified. Approximately right for substantial successful JS ML tooling and use; stronger ubiquitous adoption is not established.
Direction: JS-specific ML progressed from early libraries to broad technical functionality and consequential applications.
Magnitude: Hundreds of thousands of downloads plus multiple production users support the qualitative widespread-use expectation, without equating downloads to people or inventing a threshold.
Timing: Evidence dates are retained: roughly 4.8–5 years after early 2014. Original few-years wording cannot justify a hard deadline hit or exact lateness.
Scope: AI-enabling developer tooling and its adoption; not a promise to release a specific own product. Stronger adjacent ubiquity language remains qualified and unresolved. Independent study finds immature browser DL and major performance/training limitations; some early libraries became inactive. This is not proof most ML workloads moved to JavaScript.
Evidence confidence: Moderate; primary usage reports and independent functional comparison, but vague success threshold and timing.
Current edition contribution · Andrej Karpathy
Graded credit: 75 / 100.
- Recency weight
- 41.0027397260274–42.893150684931506%
- Credit × weight endpoint products
- 30.75205479452055–32.16986301369863
- Last documented backing
- 2014-01-01 to 2014-04-26
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 75 / 100
- Recency weight
- 10%
- Weighted credit term
- 7.5
- Same-claim backing date
- 2014-01-01 to 2014-04-26
Existing reviewed grade for the original scope; time intrinsic to that scope is retained.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
75,
75
]
},
"backingDateBounds": [
"2014-01-01",
"2014-04-26"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
75,
75
],
"weightBounds": [
0.1,
0.1
],
"normalizedBackingDateBounds": [
"2014-01-01",
"2014-04-26"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
75,
75
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Ben Goertzel2014–2015 · rangeChart grade 75 / 100Practical self-driving cars arrive within the next decade.
Geofenced driverless rides emerged by 2020; later independent analysis documents 2022–2023 service mileage.
OutcomePartly rightDirectionRightMagnitudeNot quantifiedTimingWithin original window
2015 book; passage anchored in 2014; exact public day unverified
Further evidence: Qualified practical advent, not universal availability or a safety verdict.
Direction: Actual rides followed prototypes.
Magnitude: No scale, reliability or market-share threshold was promised.
Timing: Evidence falls within a decade from either textual/edition anchor; exact first-worldwide date unverified.
Scope: Joint Ted/Ben forecast, not independent author votes. The older quoted highway/intelligent-road bundle and another contributor’s claims are not imported. Restricted access/territory differs from supervised service or general ownership. Remote information/support is not remote driving or absence of human operations. Pilot and paid mileage remain separate; small local-road samples and differing operator results do not establish safety superiority. Undated notes aren’t backdated. Existing prototypes limit novelty; indexed catalog metadata, not inspected body, does not authenticate immutable 2014 wording.
Evidence confidence: Moderate. Joint-authored primary PDF visually checked; printed edition, PDF metadata and bibliographic records support 2015 provenance but not immutable 2014 wording. Outcome has both operator records and independent primary analysis.
Current edition contribution · Ben Goertzel
Graded credit: 75 / 100.
- Recency weight
- 47.0027397260274–52.98630136986301%
- Credit × weight endpoint products
- 35.25205479452055–39.73972602739725
- Last documented backing
- 2015-01-01 to 2015-12-31
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 75 / 100
- Recency weight
- 11.67123288–21.64383562%
- Weighted credit term
- 8.75342466–16.23287671
- Same-claim backing date
- 2015-01-01 to 2015-12-31
Existing reviewed grade for the original scope; time intrinsic to that scope is retained.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
75,
75
]
},
"backingDateBounds": [
"2015-01-01",
"2015-12-31"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
75,
75
],
"weightBounds": [
0.11671232876712323,
0.21643835616438356
],
"normalizedBackingDateBounds": [
"2015-01-01",
"2015-12-31"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
75,
75
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Andrew Ng2014 · uncertainChart grade 100 / 100Substantial machine-perception progress in the coming years, with deep learning hoped to contribute.
Large image and speech improvements documented in 2015 and 2017 support the predicted progress before the upper horizon.
OutcomeRightDirectionNot separately gradedMagnitudeNot quantifiedTimingWithin original window
Approximately 2014; exact public day and excerpt-version identity not fully authenticated.
Original horizon: five or ten years after issue, upper window approximately 2024
Further evidence: They do not establish universal perception, universal human parity or a separately proven forecast about deep learning’s causal contribution. Large image and speech gains support substantial progress without requiring an invented numerical threshold.
Direction: Not separately graded in the historical record.
Magnitude: The forecast specified substantial progress without a numerical error-reduction target.
Timing: The 2015 and 2017 evidence precedes the upper horizon; “coming years” does not require waiting until 2019.
Scope: The original issue day remains approximate. The mechanism was expressed as a hope, not a separate probabilistic prediction.
Evidence confidence: Not separately rated.
Current edition contribution · Andrew Ng
Graded credit: 100 / 100.
- Recency weight
- 41.0027397260274–46.986301369863014%
- Credit × weight endpoint products
- 41.0027397260274–46.986301369863014
- Last documented backing
- 2014-01-01 to 2014-12-31
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 100 / 100
- Recency weight
- 10–11.64383562%
- Weighted credit term
- 10–11.64383562
- Same-claim backing date
- 2014-01-01 to 2014-12-31
Existing reviewed grade for the original scope; time intrinsic to that scope is retained.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
100,
100
]
},
"backingDateBounds": [
"2014-01-01",
"2014-12-31"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
100,
100
],
"weightBounds": [
0.1,
0.11643835616438358
],
"normalizedBackingDateBounds": [
"2014-01-01",
"2014-12-31"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
100,
100
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Demis Hassabis2014 · uncertainChart grade 75 / 100Large gains from unstructured-data learning over the next few years.
2018 ULMFiT/BERT language studies and RotNet vision experiments found transfer gains from unlabeled-data pretraining.
OutcomePartly rightDirectionRightMagnitudePartly supportedTimingTiming unresolved
Late 2014 interview; published January 16, 2015. Exact interview month/day unknown.
Further evidence: Supervised downstream training remained; vision lagged supervised comparators, TREC gains were nonsignificant, and methods were not uniformly best. Text and vision gains, not field-wide supremacy.
Direction: Useful representations improved downstream performance.
Magnitude: Task-specific gains; some small or nonsignificant.
Timing: 2018 results fit a broad interval; exact punctuality is unresolved.
Scope: Unsupervised/self-supervised representation learning; not an exclusive method or release schedule. Field-wide primacy and exact punctuality remain unproved.
Evidence confidence: Moderate qualitative outcome; strong original provenance and primary controlled studies, but vague size/ranking and timing.
Current edition contribution · Demis Hassabis
Graded credit: 75 / 100.
- Recency weight
- 41.0027397260274–46.986301369863014%
- Credit × weight endpoint products
- 30.75205479452055–35.23972602739726
- Last documented backing
- 2014-01-01 to 2014-12-31
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 75 / 100
- Recency weight
- 10–11.64383562%
- Weighted credit term
- 7.5–8.73287671
- Same-claim backing date
- 2014-01-01 to 2014-12-31
Existing reviewed grade for the original scope; time intrinsic to that scope is retained.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
75,
75
]
},
"backingDateBounds": [
"2014-01-01",
"2014-12-31"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
75,
75
],
"weightBounds": [
0.1,
0.11643835616438358
],
"normalizedBackingDateBounds": [
"2014-01-01",
"2014-12-31"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
75,
75
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Elon MuskSep 2013 · rangeTesla handles 90% of driven mileage within three years.
Regulator-held Tesla manual documents limited-domain partial automation with active driver supervision. Whole outcome unresolved.
OutcomeUnresolvedDirectionPartly rightMagnitudeUnresolvedTimingTiming unresolved
2013-09 (exact interview day unverified)
Further evidence: Full quantitative target remains unverified.
Direction: Real partial automation supports a meaningful component.
Magnitude: No representative 90% mileage coverage measurement.
Timing: Neither timed threshold success nor failure established; no partial-feature timing credit.
Scope: Partial capability, not fleet adoption. Mileage population and original supervision contract remain unclear. IEEE quotes the contemporaneous report; the FT body remains inaccessible. Own-development information advantage limits novelty. The December 15, 2016 regulator-held Release 7.1 manual requires active driver supervision and excludes city streets and places with cyclists or pedestrians. These are intended-use restrictions, not measured capability ceilings; this later manual does not freeze September 2016 performance or first attainment. FHWA’s 2016 US all-vehicle estimates put interstates/freeways at 34.31% of mileage. All rural travel plus urban interstates/freeways totals 55.37%: (949,573 + 558,388 + 249,423) / 3,173,815 million vehicle-miles. The May 2020 table, modified June 9, uses state estimates, partly modeled rural/local inputs and state HPMS data elsewhere. Road classes do not exactly map to city-street warnings; Tesla-customer mileage and actual capability may differ. Neither percentage validates or disproves Tesla’s 90% target.
Evidence confidence: Moderate for partial direction; original reported quotation and uncertain mileage denominator.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Gary Marcus27 Jun 2013Shared robotics simulation will benefit the field beyond the challenge result.
Later independent robot-learning experiments and multi-team competitions documented substantive reuse and testing benefits.
OutcomeRightDirectionRightMagnitudeQualitatively supportedTimingNo fixed deadline
2013-06-27
Further evidence: Right for the scoped claim that shared simulation would produce useful benefits beyond the original challenge. Subsequent robot-learning experiments and multi-team competitions actually reused the infrastructure.
Direction: The platform became a reusable testing and research resource rather than remaining merely a one-contest demonstration.
Magnitude: No numerical benefit was specified. The original universal-standard rhetoric is not treated as proof that every lab benefited or that no competing simulator exists.
Timing: The field-benefit trajectory has no precise endpoint. Later documented use is credited without inventing a calendar deadline or counting the pre-forecast virtual contest as a new success.
Scope: Low-novelty durable infrastructure benefit, not every laboratory, a simulator monopoly, exact simulation-to-real transfer or the separate contest-performance forecast.
Evidence confidence: Moderate: provider histories plus an independent user technical study; no controlled sector-wide causal estimate.
Draft formula inputs
No draft score: AI link unclear. No vote, not zero.
Yann LeCun7 May 2013Deep-learning startups expand within two years, with many expected acquisitions; the acquisition deadline is ambiguous.
Documented acquisitions and recruitment events support the acquisition component.
OutcomeRightDirectionNot separately gradedMagnitudePartly supportedTimingNo fixed deadline
2013-05-07
Original horizon: Two-year startup-surge window to May 2015; acquisition-deadline scope ambiguous.
Further evidence: The size of the predicted startup surge remains unmeasured, so the complete startup-growth-plus-acquisitions claim is unresolved; missing population evidence is not a demonstrated negative outcome. A May 2016 analyst report tracked 52 AI-infrastructure entrants in 2014, describing a majority as deep-learning-focused; this supports bounded formation, not a measured deep-learning growth rate. Actual acquisitions support that component, while the unmeasured startup surge leaves the full conjunction unresolved.
Direction: Not separately graded in the historical record.
Magnitude: A defined tracked population identifies a material deep-learning-focused entrant cohort in 2014, inside the original window. This supports bounded startup formation; the exact deep-learning growth rate and full surge magnitude remain unmeasured.
Timing: The two-year window clearly applies to startup growth; its extension to acquisitions is ambiguous, so this acquisition component is treated as undated.
Scope: The startup-growth deadline and acquisition component must remain distinct. The grammatical extension of the two-year window to acquisitions is ambiguous; no exact acquisition timing credit is assigned. Reporter-attributed original; surge and many have no numerical thresholds. The analyst upload is attributed but only moderately authenticated; original slide text, not the slide image, was inspected. This selected retrospective database is not a global census: broad AI infrastructure is not all deep learning, and coverage, exits and sector assignments are unquantified. There is no comparable prior deep-learning denominator; no exact doubling or complete surge is established. The 2014 cohort falls inside the May 2013–May 2015 window; all calendar-2015 entries cannot be assumed pre-deadline. The May 2016 report is later than the window. It does not settle how many acquisitions occurred or convert the full conjunction into a completed outcome.
Evidence confidence: Not separately rated.
Draft formula inputs
No draft score: out of scope. No vote, not zero.
Jensen Huang19 Mar 2013Volta would combine TSV-stacked DRAM and the GPU on a shared silicon substrate, providing 1 TB/s memory bandwidth.
The January 2020 datasheet gives Volta V100S 1,134 GB/s nominal HBM2 bandwidth; initial V100 specifications give 900 GB/s.
OutcomePartly rightDirectionRightMagnitudePartly supportedTimingTiming unresolved
19 March 2013 keynote; contemporaneous reports 21–22 March 2013
Further evidence: The August 2017 Volta paper documents stacked HBM2. Qualified named-generation nominal-memory success, not initial/all-variant or sustained-transfer success.
Direction: CoWoS/HBM2 labeling and Volta’s explicit Pascal cross-reference support TSV stacks on a silicon interposer; not a newly inspected die cross-section.
Magnitude: V100S exceeds 1 TB/s; initial V100 is 10% short. Partial support reflects variant and nominal/effective sensitivity, not an all-products requirement.
Timing: Volta follows Maxwell associated with 2014, but its date was unspecified. Reporter expectations for 2016 are not Huang’s deadline; no timing success or miss.
Scope: Infrastructure-adjacent memory only: no sustained-transfer, Blu-ray timing, AI-task, power/cost or first-product credit. January 2020 documents attainment, not its exact first date; the current product page does not date it. Shared substrate does not mean memory directly atop the GPU. Pascal defines packaging technology, not Volta throughput.
Shared evidence: One conjunction, strongly dependent on Huang’s GPU roadmap; commercial self-influence confers no foresight bonus.
Evidence confidence: Moderate: coherent contemporaneous firsthand reporting and official event metadata; exact English audio not verified. Outcome specifications are manufacturer primary records, not independent measurements.
Draft formula inputs
No draft score: out of scope. No vote, not zero.
Jensen Huang15 Nov 2011GPU-based exaflop computing with just 20 MW, not expected until 2022.
Frontier reached 1.102 exaflop/s conventional HPL at reported 21.1 MW in May–June 2022, using HPE/AMD CPU-plus-GPU hardware.
OutcomePartly rightDirectionRightMagnitudePartly supportedTimingTiming unresolved
15 November 2011 keynote; explicit target reported 18 November
Further evidence: Near performance/power pair, not literal fulfillment or a first-attainment finding.
Direction: GPU acceleration contributed; no universal architectural dominance inferred.
Magnitude: Power was 5.5% above 20 MW; no linear rescaling invents a measured configuration.
Timing: A 2022 observation cannot establish the not-before implication; earlier unpublished attainment remains unknown.
Scope: Infrastructure-adjacent HPC, not AI-task success. Benchmark power is not facility-wide energy; testing continued before general production access. No NVIDIA/ARM delivery credit. The desired/extrapolated 2019 route differs from the current-technology 2022 estimate.
Shared evidence: One aggregate target; related GPU-efficiency forecasts share the trajectory, not independent confirmation.
Evidence confidence: Moderate: contemporaneous firsthand reporting corroborated by a publicly posted slide sequence; exact speech not audio-verified. Benchmark and submitted power figures are primary records, not an independent reproduction or facility-wide energy audit.
Draft formula inputs
No draft score: out of scope. No vote, not zero.
Yann LeCun2011–2014 · rangeChart grade 75 / 100Within five years, everyone in computer vision would learn features.
A January 2016 survey reported widespread research adoption; the June conference program showed diverse tasks.
OutcomePartly rightDirectionRightMagnitudePartly supportedTimingWithin original window
Claimed August 2011; author attestation 22 December 2014; original date not contemporaneously verified
Further evidence: These support approximate broad transition, not unanimous use or complete replacement of handcrafted components. Broad research uptake, not literal everyone.
Direction: Multiple tasks and groups used learned representations.
Magnitude: No practitioner census or universal replacement established.
Timing: January and June 2016 evidence precedes the approximate August endpoint; no exact attainment date.
Scope: Object-recognition context; not all vision solved or unsupervised dominance. The 2014 retrospective attestation followed early successes; original slides/audio were not authenticated, and the 2011 date is not reset. ORB-SLAM retained engineered ORB features while learning a vocabulary, so it limits end-to-end replacement but is not an unambiguous counterexample to feature learning. Conference title keywords are not adoption prevalence. One forecast; later remarks about speed or unsupervised methods add no votes.
Evidence confidence: Moderate for broad field uptake; moderate-low original vintage due retrospective 2014 author attestation of 2011 talk. Literal universal adoption unverified.
Current edition contribution · Yann LeCun
Graded credit: 75 / 100.
- Recency weight
- 26.487671232876707–26.98082191780821%
- Credit × weight endpoint products
- 19.86575342465753–20.23561643835616
- Last documented backing
- 2011-08-01 to 2011-08-31
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 75 / 100
- Recency weight
- 10%
- Weighted credit term
- 7.5
- Same-claim backing date
- 2011-08-01 to 2011-08-31
Existing reviewed grade for the original scope; time intrinsic to that scope is retained.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
75,
75
]
},
"backingDateBounds": [
"2011-08-01",
"2011-08-31"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
75,
75
],
"weightBounds": [
0.1,
0.1
],
"normalizedBackingDateBounds": [
"2011-08-01",
"2011-08-31"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
75,
75
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Ray Kurzweil13 Feb 2011Chart grade 100 / 100Watson-type language processing enters search and other knowledge-retrieval systems within five years.
Semantic search and a restricted knowledge-answering pilot documented in 2014–2015 support the predicted functional diffusion.
OutcomeRightDirectionNot separately gradedMagnitudeNot quantifiedTimingWithin original window
2011-02-13
Original horizon: 2016-02-13
Further evidence: Errors and limited pilot scope remain, but do not negate those actual uses or establish universal Watson-like performance. Actual semantic search and a restricted answering pilot support the functional adoption prediction.
Direction: Not separately graded in the historical record.
Magnitude: No mass-adoption percentage or exact Watson benchmark-parity threshold was specified.
Timing: Qualifying examples were documented in 2014–2015 before the upper horizon, not necessarily at first occurrence.
Scope: The target involves meaningful interpretation and knowledge answering, not mere transcription. Neither universal breadth nor mass-market penetration is established.
Evidence confidence: Not separately rated.
Current edition contribution · Ray Kurzweil
Graded credit: 100 / 100.
- Recency weight
- 23.70958904109588%
- Credit × weight endpoint products
- 23.70958904109588
- Last documented backing
- 2011-02-13 to 2011-02-13
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 100 / 100
- Recency weight
- 10%
- Weighted credit term
- 10
- Same-claim backing date
- 2011-02-13 to 2011-02-13
Existing reviewed grade for the original scope; time intrinsic to that scope is retained.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
100,
100
]
},
"backingDateBounds": [
"2011-02-13",
"2011-02-13"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
100,
100
],
"weightBounds": [
0.1,
0.1
],
"normalizedBackingDateBounds": [
"2011-02-13",
"2011-02-13"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
100,
100
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Nick BostromJan–Dec 2011 · rangeCivilian autonomous drones develop, extending social/regulatory issues.
Firsthand 2018 flights and operator-reported 2025 utility inspections demonstrate bounded civilian autonomy.
OutcomePartly rightDirectionRightMagnitudePartly matched scopeTimingWithin original window
2011; coauthor link 29 December; first-release day uncertain.
Further evidence: Qualified civilian core; wider social effects unmeasured.
Direction: Perception-driven flight works beyond remote piloting.
Magnitude: Restricted applications, supervision and operating limits; no adoption/price threshold.
Timing: 2018 realization fits the fifteen-year window, not a first-ever date or completed full horizon.
Scope: Autonomy excludes remote piloting alone. Illustrative uses; identity/privacy unresolved. Existing DIY/military drones: continuation. TechGearLab’s November 2018 firsthand outdoor tests found visual following and obstacle avoidance; dense obstacles triggered safe landing. Narrow filming, poor manual precision, limited range/endurance and obstacle-related slowing constrain capability. No failure-rate denominator or controlled reliability study; a later discontinuation note prevents immutable-page dating. The Next Web’s October 2018 reviewer also flew autonomously, but rejected full autonomy: human task selection and limited controls persisted. Intended sunny, low-wind conditions and thin-obstacle warnings restrict generality; no crash-free or mass-adoption claim. National Grid’s September 2025 report describes four years of development reaching routine inspection, with central oversight and remote pilots. Claimed network rollout is not a completed fleet census or independent audit. Its regulatory collaboration supports an issue, not measured privacy/psychological effects; promotional efficiency/safety gains are unquantified. NYPA’s February 2023 account describes existing drone inspections, preplanned routes, remote piloting and autonomous docking; procedures/hardware were still developing. The new waiver was permission, not completed remote-autonomous deployment or unrestricted freedom. No current same-scope endorsement is inferred.
Shared evidence: Bostrom–Sandberg; dependent.
Evidence confidence: Moderate: direct limited civilian flights and operator reports support central application; exact general autonomy and social effects remain limited.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Nick BostromJan–Dec 2011 · rangeChart grade 75 / 100By 2025, high-precision actor/object identity monitoring spreads across domains.
Policing, transport, device authentication and retail demonstrate bounded deployment.
OutcomePartly rightDirectionRightMagnitudePartly matched scopeTimingWithin original window
2011
Further evidence: Prepared plates are identifiers, keepers need not be owners, human checks remain and retail identities can be temporary. Selected field precision does not establish uniform reliability or seamless cross-domain association. Bounded deployment; stronger reading unresolved.
Direction: Technical capability and commercial spread.
Magnitude: Selected precision, not uniform reliability.
Timing: Bounded deployments by 2025; integrated completion unverified.
Scope: AI-adjacent. Persistent cross-domain identity/ownership remains unverified; errors, deception and anonymity constraints remain.
Shared evidence: Bostrom–Sandberg; dependent.
Evidence confidence: Moderate, interpretation-sensitive. Field-reported recognition precision and actual deployment support bounded domain capability; integrated persistent identity, ownership and uniform cross-domain precision remain unverified.
Current edition contribution · Nick Bostrom
Graded credit: 75 / 100.
- Recency weight
- 23.0027397260274–28.986301369863014%
- Credit × weight endpoint products
- 17.25205479452055–21.73972602739726
- Last documented backing
- 2011-01-01 to 2011-12-31
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 75 / 100
- Recency weight
- 10%
- Weighted credit term
- 7.5
- Same-claim backing date
- 2011-01-01 to 2011-12-31
Existing reviewed grade for the original scope; time intrinsic to that scope is retained.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
75,
75
]
},
"backingDateBounds": [
"2011-01-01",
"2011-12-31"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
75,
75
],
"weightBounds": [
0.1,
0.1
],
"normalizedBackingDateBounds": [
"2011-01-01",
"2011-12-31"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
75,
75
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Nick BostromJan–Dec 2011 · rangeDriver assistance spreads; driverless cars unlikely to dominate within fifteen years.
IIHS production monitoring and HLDI equipment estimates show assistance growth. Whole outcome unresolved.
OutcomeUnresolvedDirectionPartly rightMagnitudePartly matched scopeTimingFuture window open
2011
Further evidence: Britain’s pilots and Waymo’s operating services provide regional deployment evidence, not a global fleet census. Full global non-dominance remains unresolved.
Direction: Assistance adoption, not absence of autonomy.
Magnitude: No stated market-share threshold.
Timing: Do not close the negative endpoint early.
Scope: International, not Britain-only; uncertain issuance, roughly late 2026 endpoint open. Possible later transition unscored.
Shared evidence: Bostrom–Sandberg; dependent.
Evidence confidence: High for the assistance-adoption direction; moderate for the observed deployment contrast; the full endpoint remains unresolved.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Nick BostromJan–Dec 2011 · rangeHousehold robots and toys spread and cheapen; widespread general-assist and physical-companion robots unlikely.
The industry survey reports growing consumer sales, mainly domestic; changing samples are not a comparable global market census. Whole outcome unresolved.
OutcomeUnresolvedDirectionPartly rightMagnitudePartly matched scopeTimingFuture window open
2011
Further evidence: Selected cleaners have lower nominal entry prices, not a global affordability index. Real broader home-manipulation research does not establish mass-market ownership. Toy and companion outcomes remain unmeasured. Full bundle unresolved.
Direction: Selected cleaning-price and domestic-sales evidence supports partial direction.
Magnitude: No global affordability/adoption measure.
Timing: Date uncertain; full negative endpoint open.
Scope: International to roughly late 2026; specialized niches and better prototypes allowed, not additional predictions.
Shared evidence: Bostrom–Sandberg; dependent.
Evidence confidence: Moderate for observed component directions; unresolved for the full global bundle and final endpoint.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Nick BostromJan–Dec 2011 · rangeMachine translation aids international online identities and relationships.
Reported cross-border bookings and facilitated remote exchanges support contribution; foreign-provider use and dispersed cloud infrastructure also grew.
OutcomePartly rightDirectionRightMagnitudePartly matched scopeTimingTiming unresolved
2011; issue day unknown
Further evidence: Benefits and cultural inclusion remain uneven. Qualified continuation across the combined evidence, not translation quality alone.
Direction: Cross-border transactions and interpersonal exchange support contribution.
Magnitude: No numeric target; heterogeneous selected evidence, not population-wide scale.
Timing: Reports within the outlook; first realization and whole-bundle completion unverified.
Scope: Foreign identity providers; dispersed cloud storage/processing; jurisdiction/privacy issues. Translation contributes, not solely causes. Fifteen-year outlook, roughly late 2026; endpoint open. A Booking.com employee’s December 2018 account reports a 50/50 comparison of translated reviews versus no translation, increasing bookings including abroad. An earlier Google Translate test failed; domain-specific quality and automatic display changed together. Trial dates, sample size, effect sizes, uncertainty and randomization protocol are undisclosed. Firsthand corporate testimony, not independent replication or isolated translation-quality causation. Two software websites randomized supported non-English-language sessions during November 2020–January 2022. Translation improved selected engagement, but neither gained downloads; one improved only duration. Human translations sometimes did better and defaults mattered. The 3,332,669-session, 190-country full dataset is not that many randomized users; reading proxies do not establish relationships. Facebook’s September 2018 report claims nearly six billion translations daily across 4,504 language directions. Vendor volume is not unique people, new ties or causal cross-border transactions; low-resource output can convey gist without professional quality. A December 2024 study reports May–June 2022 data from 430 foreign residents in China and 15 interviews: 355 always translated pandemic messages, yet users felt excluded. Voluntary urban recruitment targeted low Chinese proficiency; use was self-reported and message quality untested. Local services need not involve remote cross-border relations. A June 2023 paper reports 20 UK and 38 Nepalese children aged 9–12 using Google Translate: all exchanged at least two letters over two days, writing and reading their own languages. Schools selected groups; researchers/teachers supervised and briefly checked outgoing writing. Errors sometimes sustained conversation, but names, pronouns and meanings failed; adult filtering was recommended. No randomized no-translation comparator, lasting ties or population trend was measured. Field dates and first realization are unknown; this was actual facilitated exchange. A July 2023 US multilingual-user study surveyed 189 and interviewed 15; about 80% reported social-network translation. Quality perceptions correlated with posting, not demonstrated causation. Experienced users were less confident about connotative meaning; slang/tone errors and desired audience/translation controls mattered. Some used language to restrict audiences. Prolific recruitment and a Spanish-heavy US sample limit transfer; field dates, friendship growth and global adoption were not established. Facebook’s 2018 10-K reports 9% daily/monthly active-account growth, with India, Indonesia and the Philippines prominent and faster growth in Asia-Pacific/rest-of-world regions. Company estimates include duplicate/false accounts and geographic uncertainty: foreign-provider use, not unique-person or friendship counts, and not translation-attributed growth. AWS reported seven operating Regions serving over 190 countries in November 2011. This is already-global issue-period context; unknown report issuance prevents exact pre-issue ordering. AWS reported 22 operating Regions and 69 Availability Zones in January 2020, including existing Japanese redundancy. Announced expansions are excluded. Dispersed infrastructure does not establish everyone’s cross-border data movement or translation-caused growth. Ireland’s regulator’s May 22, 2023 account of its May 12 decision documents actual EU/EEA-to-US Facebook data transfers and suspension/compliance orders. This supports jurisdiction/privacy context, not a separate scored prediction, translation-caused violation or present legal conclusion. Missing durable-tie and global-attribution measurements limit inference, not this qualitative grade. No uniform cultural/political identity transition, global causal share, extra forecast or current same-scope endorsement is inferred.
Shared evidence: Bostrom–Sandberg; dependent.
Evidence confidence: Moderate for qualified qualitative continuation and translation contribution; low for exact global effect sizes, causal share and whole-horizon completion. Weakly discriminating, AI-adjacent joint forecast.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Jensen Huang21 Sep 2010Kepler: roughly 3–4× Fermi’s double-precision performance per watt.
GPU-only DGEMM/nameplate proxies (GFLOPS/W): M 2050, 350 GFLOPS / 225 W ≈ 1.56; K20, 1,100 GFLOPS / 225 W ≈ 4.89; K20X, 1,220 GFLOPS / 235 W ≈ 5.19.
OutcomePartly rightDirectionRightMagnitudePartly supportedTimingTiming unresolved
21 September 2010 report; attributed speech, not independently heard recording.
Further evidence: Ratios ≈ 3.14/3.34; not measured energy. Shipping documented November 2012; later technical-table date unknown. Qualified approximate support under the inferred achieved-throughput convention.
Direction: Higher same-kind DP/board-power proxies.
Magnitude: Within 3–4× under one convention; alternate peak reading and configuration uncertainty limit credit.
Timing: 2011 roadmap retained; 2012 availability is late under a stronger delivery-window reading, not a precise benchmark/production date. First attainment unknown; no invented deadline or exclusion of internal 2011 capability.
Scope: Infrastructure-adjacent, not AI-task or universal speedup. Original metric convention inferred; peak-to-peak gives 2.27–2.45×. M 2050 is the issuance-era reference, not M 2090; exclude CPU-inclusive 435. Vendor cluster/CEO influence; no independent replication. Matrix shape, software, ECC, transfers and workload power are incompletely matched.
Evidence confidence: Moderate for bounded approximate content/direction; lower for exact magnitude and timing.
Draft formula inputs
No draft score: out of scope. No vote, not zero.
Jensen Huang21 Sep 2010Maxwell should deliver roughly 16× older-Tesla double-precision performance per watt within a few years.
2015–2016 native Maxwell/nameplate proxies: M40 ≈2.05× and optimistic M4 ≈3.32× C1060 peak efficiency. Whole outcome unresolved.
OutcomeUnresolvedDirectionPartly rightMagnitudePartly supportedTimingTiming unresolved
21 September 2010 report; attributed speech, not independently heard recording.
Further evidence: By 2013, separate Kepler K40 achieved-DGEMM/nameplate ≈14.76–15.18× C1060; this is not Maxwell fulfillment. Full named-Maxwell target unresolved. Native proxies fall far short; baseline, metric and emulation uncertainties prevent completed success or failure.
Direction: Qualified native-DP proxy improvement, not measured application-energy improvement.
Magnitude: Partial comparison only; achieved DGEMM, arithmetic peak and power conventions are not interchangeable.
Timing: A few years; 2013 roadmap is not an exact benchmark deadline. No verified full-target crossing.
Scope: C1060 is a contemporary reference, not an authenticated exclusive original baseline. Nameplate power is not measured joules or a physical-energy bound; M4’s lowest power and peak need not coincide. Maxwell favored single precision. Native units do not bound software-emulated DP: FY 2014 research improved Maxwell DGEMM without a matched 16× efficiency result. No CPU-inclusive, Fermi, single-precision or Tensor Core substitution. Infrastructure-adjacent only; no AI-task, autonomy, adoption or readiness credit. Vendor forecast/evidence and conference reproduction are not independent replication.
Shared evidence: Same 2010 roadmap as Kepler; different generation and ratio, not an independent family or another K40 success vote. No later same-scope endorsement assessed.
Evidence confidence: Moderate for reported native-throughput/nameplate comparison; lower for original exact denominator and full architecture-level efficiency outcome.
Draft formula inputs
No draft score: out of scope. No vote, not zero.
Eliezer Yudkowsky2007 · uncertainDeliberation would probably be central to artificial intelligence.
Intermediate reasoning and reasoning-focused training became substantial contributors to language-model task competence.
OutcomePartly rightDirectionPartly rightMagnitudePartly supportedTimingNo fixed deadline
2007 published chapter; original-layout indexed paragraph verified
Further evidence: Reasoning systems support the proposed functional role, but not the whole architecture.
Direction: Deliberative computation became important for difficult tasks.
Magnitude: Centrality is not quantitatively defined or universal.
Timing: No calendar deadline; no timing credit.
Evidence confidence: moderate directional outcome; qualified original-page provenance from academic search index
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Eliezer Yudkowsky2007 · uncertainChart grade 75 / 100Software parallelism would be a major AI-development challenge requiring explicit design work.
Megatron research documented memory and communication bottlenecks, addressed through deliberate combinations of model, pipeline and data parallelism.
OutcomePartly rightDirectionPartly rightMagnitudeUnresolvedTimingNo fixed deadline
2007 chapter; indexed original-layout target paragraph recovered
Further evidence: Later consequential engineering work supports the substantive difficulty forecast; exact relative prominence remains unmeasured.
Direction: Naive scaling required nontrivial parallelism design rather than merely adding processors.
Magnitude: No defensible complete ranking of AI-development difficulties.
Timing: Explicit future engineering expectation in long-run AI development; no delivery date.
Scope: Known difficulty extrapolated forward, not exceptional novelty. Evidence concerns neural-model training engineering, not the whole proposed cognitive architecture or a ranking as the greatest obstacle.
Evidence confidence: moderate for scoped engineering importance; not for the strongest relative ranking
Current edition contribution · Eliezer Yudkowsky
Graded credit: 75 / 100.
- Recency weight
- 10%
- Credit × weight endpoint products
- 7.5
- Last documented backing
- 2007-01-01 to 2007-12-31
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 75 / 100
- Recency weight
- 10%
- Weighted credit term
- 7.5
- Same-claim backing date
- 2007-01-01 to 2007-12-31
Existing reviewed grade for the original scope; time intrinsic to that scope is retained.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
75,
75
]
},
"backingDateBounds": [
"2007-01-01",
"2007-12-31"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
75,
75
],
"weightBounds": [
0.1,
0.1
],
"normalizedBackingDateBounds": [
"2007-01-01",
"2007-12-31"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
75,
75
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Eliezer Yudkowsky2007 · uncertainAdvanced AIs likely share cognitive representations directly, with communication advantages over humans.
LatentMAS demonstrated direct working-state transfer between LLM-agent instances and useful benchmark performance, avoiding text mediation.
OutcomePartly rightDirectionPartly rightMagnitudeUnresolvedTimingNo fixed deadline
2007 published chapter; original-layout p482 indexed
Further evidence: A substantive predicted mechanism has been implemented. Full breadth and human comparison are unverified, so only partial credit is assigned.
Direction: Direct exchange is more than text chatting or copying a complete trained model.
Magnitude: No matched human-bandwidth measurement; claimed efficiency versus text-based agents is not the original human comparison.
Timing: Explicit long-run future-mind discussion; no delivery date or timing credit.
Scope: Partial mechanism only: same-backbone agent-state transfer, not verified general intelligence, unrestricted skill transfer or human-relative bandwidth. Benchmark study, not independent broad replication.
Evidence confidence: moderate for scoped mechanism; limited independent replication and broader-target coverage
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Nick Bostrom2007–2009 · rangeChart grade 75 / 100Machine analysis increasingly enables monitoring of movements, encounters, activities and internal bodily conditions.
Qualified comparative growth across movement, encounters, activity and one internal-body domain; substantial errors remain.
OutcomePartly rightDirectionPartly rightMagnitudePartly matched scopeTimingNo fixed deadline
2009 publication; draft circulated 2007
Further evidence: Approximate increasing feasibility, not a universal or single integrated monitoring-system requirement.
Direction: Comparisons establish gains, not merely launches or annotations.
Magnitude: No numeric target; population coverage, cross-camera persistence and real identities unverified.
Timing: Long run, undated; surrounding time horizons supply no deadline.
Scope: AI-adjacent machine analysis, not generic storage growth or the neighboring virtual-reality claim. Author-hosted 2009 publication notes a circulated 2007 draft; no exact day or immutable 2007 wording is inferred. No later same-scope endorsement established. MOTChallenge compared 101 peer-reviewed trackers on fixed datasets: MOT16 MOTA rose from 46.42 for a strong 2015 method to 58.56 in 2020. MOTA includes detection errors, not just identity continuity. Within-camera association improves; large occlusion gaps remain difficult. Runtimes are self-reported and often below real time; no real-name or geographically pervasive tracking. JRDB-Act’s detector-matched campus test improved social-group AP from 21.1 to 29.1; two-person AP rose 24.3 to 40.8, while some larger groups worsened. Inferred interaction groups indirectly represent encounters, not identities or lasting relationships. Easy/moderate evaluation excludes difficult labels; including them yields 22.9 AP. Joint group/activity mAP remains 3.4. Ground-truth-box validation is not substituted for detector-based testing. Inspected November 2021 v2, first June 2021; later CVPR 2022. NIST’s 2018 matched face-search comparisons show progress across developers, with sharply different algorithms and false-positive operating points; no universal accuracy multiplier. Primary summary, not uninspected full-report tables; the live page was updated in 2025. The 2021–2023 government report describes experimentally improved activity detection/localization, not individual identification. DIVA ended May 2022; research collections used consent/IRB safeguards, not evidence of lawful or safe general deployment. January 2022 DIVA summary: selected detectors found over twice the activity instances of a crowdsourced control; not overall human parity. The 75%-detection/2%-false-alarm objective was not an achieved result. FDA’s April 2018 review: 900 enrolled, 819 fully analyzable; observed sensitivity 87.4%, specificity 89.5%, not enrichment-corrected estimates. Autonomous retinal screening has a narrow adult indication and image-quality failures: one condition, not continuous/all-body monitoring or population-wide access. No comprehensive surveillance, bodily understanding or deployment-safety credit.
Evidence confidence: Moderate for bounded comparative growth across named domains; low specificity and incomplete reliability/population scope. Encounter mapping is indirect, and the body result is one condition.
Current edition contribution · Nick Bostrom
Graded credit: 75 / 100.
- Recency weight
- 10–16.986301369863014%
- Credit × weight endpoint products
- 7.5–12.73972602739726
- Last documented backing
- 2007-01-01 to 2009-12-31
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 75 / 100
- Recency weight
- 10%
- Weighted credit term
- 7.5
- Same-claim backing date
- 2007-01-01 to 2009-12-31
Existing reviewed grade for the original scope; time intrinsic to that scope is retained.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
75,
75
]
},
"backingDateBounds": [
"2007-01-01",
"2009-12-31"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
75,
75
],
"weightBounds": [
0.1,
0.1
],
"normalizedBackingDateBounds": [
"2007-01-01",
"2009-12-31"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
75,
75
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Ray Kurzweil9 Feb 2006By 2015, search anticipates needs from conversation and helps routine transactions.
Partly right: MindMeld reported conversation-triggered retrieval in 2013.
OutcomePartly rightDirectionRightMagnitudePartly supportedTimingTiming unresolved
9 February 2006 publication proxy; 10 February authorized reprint; recording date unknown.
Original horizon: By 2015; latest calendar-year endpoint 31 December 2015.
Further evidence: Google Now offered email-derived booking reminders in 2012 and transactional cards in 2015. These are separate products, not proof of an integrated conversation-to-transaction system.
Direction: Proactive contextual retrieval and routine-transaction assistance emerged.
Magnitude: Integrated spoken-dialogue assistance and many-transactions adoption remain unestablished; no success-rate or volume threshold inferred.
Timing: Components precede the end of 2015; whole-target attainment and first arrival remain unresolved. The original deadline is not reset.
Scope: The broader AR/visual-personality vision is not graded as achieved. Transaction help does not require autonomous payment. Correspondence is narrower than spoken dialogue; the 2015 cards were an announced rollout, not measured usage. Developer reports are not independent reliability trials. Strong assistant-lineage dependence; TIME 2010 adds no vote or deadline reset. No same-scope current endorsement established.
Evidence confidence: Moderate for qualified partial content; lower for integrated scope and actual deployment magnitude.
Draft formula inputs
Not in this 424-record calculation edition. No score assigned here.
Eliezer Yudkowsky3 Dec 2004Public concern will arrive only after human-level AI.
International safety coordination and surveyed concern preceded broadly autonomous expert-level general AI.
OutcomeWrongDirectionWrongMagnitudeUnderestimatedTimingNot separately applicable
2004-12-03
Direction: Concern arrived before the transition under that capability reading.
Magnitude: Underestimated concern; no percentage forecast.
Timing: Relative order is graded as content, not a second timing penalty.
Scope: Concern is not adequate prevention or willingness to incur costs. The human-level threshold remains interpretation-sensitive; the later fire-alarm argument is distinct. Eligibility restored; original grades retained.
Evidence confidence: moderate; concern is measured, adequate prevention and exact human-level boundary are not
Draft formula inputs
Not yet updated in the supplied scoring edition. This ledger restores eligibility; the original grades are retained.
Ray KurzweilMar–Sep 2004 · rangeWearable recognition could identify people and objects and, with GPS, help direct a blind person.
Qualified partial realization: a 2012 NAVIG report describes integrated guidance over 500 m with one blind participant and numerous blindfolded participants.
OutcomePartly rightDirectionRightMagnitudePartly matched scopeTimingTiming unresolved
March 2004 interview; September 2004 publication; exact days unknown.
Original horizon: Decade-end wearable embodiment, roughly 2009/2010; attachment to the full bundle is uncertain.
Direction: The same head-camera/laptop prototype combined recognition, GPS/map fusion and audio guidance; not unrelated products.
Magnitude: Preliminary feasibility only. People recognition, precise form factor, usability and general safety remain unverified; no success rate or intervention protocol reported.
Timing: Unresolved. The 2012 report establishes neither first arrival nor original-window attainment or a measured delay. No deadline reset.
Scope: The twenty-person trial was still planned. Related NAVIG papers share a prototype, not independent replication. The original should/could modality and strict full-bundle incompleteness remain. No autonomous-navigation, cane-replacement or self-contained-compute requirement added. This mobility target is distinct from, but dependent on, Kurzweil’s scene-dialogue and optical-reading forecasts. No current endorsement established.
Evidence confidence: Moderate for scoped integrated prototype feasibility; low for general reliability and original full-bundle completion.
Draft formula inputs
Not in this 424-record calculation edition. No score assigned here.
Ray KurzweilOct 2003 · rangeChart grade 75 / 100Pocket text-reading cameras within a few years; very small by 2010, followed by lapel wear, all-direction scanning and translation.
November 2008 firsthand review documents useful pocket reading of menus, packages and mail, despite aiming, layout/background and freezing problems.
OutcomePartly rightDirectionRightMagnitudePartly matched scopeTimingWithin original window
October 2003; authorized March 2004 excerpt.
Further evidence: Approximately right for the independently dated central milestone; full-bundle reading remains partial-only.
Direction: Useful portable visual-text access.
Magnitude: Practical compact reading, not complete staged breadth.
Timing: Observed pocket use before 2010; no full-bundle timing credit or 2005 backdating.
Scope: Qualified central milestone, not the entire staged bundle. Later stages remain substantive and unresolved. The 2006 device was portable, not automatically pocket-sized; 2017 wearable reading required targeting. Conflicting 2005/2006 introduction accounts do not establish first arrival. Multilingual reading is not translation; manufacturer plans are not outcomes. Kurzweil/NFB development affiliation and 2006 reviewer beta involvement remain disclosed. Small qualitative evaluations do not establish population accuracy or adoption. Qualified central milestone only; later lapel, all-direction and translation stages remain unresolved. Development was already affiliated with Kurzweil and NFB.
Evidence confidence: Moderate for the bounded central-milestone assessment; high for the documented 2008 practical pocket observation. Full-bundle interpretation and later-stage timing remain unresolved.
Current edition contribution · Ray Kurzweil
Graded credit: 75 / 100.
- Recency weight
- 10%
- Credit × weight endpoint products
- 7.5
- Last documented backing
- 2003-10-01 to 2003-10-31
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 75 / 100
- Recency weight
- 10%
- Weighted credit term
- 7.5
- Same-claim backing date
- 2003-10-01 to 2003-10-31
Existing reviewed grade for the original scope; time intrinsic to that scope is retained.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
75,
75
]
},
"backingDateBounds": [
"2003-10-01",
"2003-10-31"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
75,
75
],
"weightBounds": [
0.1,
0.1
],
"normalizedBackingDateBounds": [
"2003-10-01",
"2003-10-31"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
75,
75
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Demis HassabisSep 2003 · rangeA new form of interactive storytelling would emerge, contextually interpreted as AI-mediated, player-responsive narrative.
Façade’s public release was announced on 5 July 2005.
OutcomePartly rightDirectionRightMagnitudeNot quantifiedTimingWithin original window
September 2003 publication; speech day unknown, before planned July 2003 release
Further evidence: An April 2005 eight-player study documented differing replay narratives; fieldwork dates are unspecified. By December 2002, working AI and roughly one-quarter of authored content already existed. Qualified functioning, bounded public completion; not first invention or broad industry transformation.
Direction: Reactive planning selects authored beats using story history, beyond fixed branching alone.
Magnitude: No numerical scale or adoption threshold was forecast; this example is not generality.
Timing: Within the contextual four-to-five-year frame, for bounded completion only; exact invention/first-attainment timing is unestablished.
Scope: The AI link is contextual; a generic-storytelling reading remains possible. Human-authored fragments and roughly 30 discourse acts do not establish autonomous authorship or arbitrary language understanding. All eight players encountered inappropriate responses; six enjoyed it and would replay, often adapting to limitations. This small developer-coauthored qualitative study is not independent replication. The substantial prototype limits novelty; earlier interactive fiction/research remain baseline. No broad adoption, sales, neural-network or non-preprogrammed-dialogue prerequisite is imported.
Shared evidence: Distinct from animation but dependent on the same report and trajectory; one target.
Evidence confidence: Moderate for the bounded contextual reading. Original is a named meeting summary; technical and user-study evidence involve the developers, and release commentary is publisher-affiliated.
Draft formula inputs
No draft score: AI link unclear. No vote, not zero.
Demis HassabisSep 2003 · rangeChart grade 75 / 100AI will generate detailed game animation from programmers’ high-level movements.
Euphoria reports and live demonstrations in 2007–early 2008 showed behavior-driven motion from high-level goals; human rigs, behaviors, keyframes and motion capture remained.
OutcomePartly rightDirectionRightMagnitudePartly supportedTimingTiming unresolved
September 2003 publication; talk day unknown, with July 2003 still upcoming in context
Further evidence: Bounded procedural animation supported; whole-workflow replacement unresolved.
Direction: Responsive motion extends beyond replaying clips.
Magnitude: Hybrid division of labor; no measured labor share or universal coverage.
Timing: Evidence fits the reported next-four-or-five-years frame; unknown speech day and first attainment prevent a precise verdict.
Scope: Contemporaneous game-AI meaning, not a neural-network requirement. Developer interviews and a live-demo snapshot, not controlled independent benchmarking or proof every announced game shipped. Adjacent dialogue/storytelling claims receive no credit.
Shared evidence: One animation target, not separate product votes.
Evidence confidence: Moderate for bounded functional fulfillment. Original is a named firsthand contemporaneous meeting report, not a verbatim transcript; outcome evidence combines developer interviews and a firsthand live-demo report, not an independent controlled benchmark.
Current edition contribution · Demis Hassabis
Graded credit: 75 / 100.
- Recency weight
- 10%
- Credit × weight endpoint products
- 7.5
- Last documented backing
- 2003-09-01 to 2003-09-30
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 75 / 100
- Recency weight
- 10%
- Weighted credit term
- 7.5
- Same-claim backing date
- 2003-09-01 to 2003-09-30
Existing reviewed grade for the original scope; time intrinsic to that scope is retained.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
75,
75
]
},
"backingDateBounds": [
"2003-09-01",
"2003-09-30"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
75,
75
],
"weightBounds": [
0.1,
0.1
],
"normalizedBackingDateBounds": [
"2003-09-01",
"2003-09-30"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
75,
75
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Rodney Brooks1 Dec 2002General robot recognition and human-like manufacturing dexterity will not be solved within two or three years of 2002.
Qualified support: general recognition remained unsolved in a 2006 chapter; a 2012 NIST survey still found broad human-like manufacturing manipulation impractical.
OutcomePartly rightDirectionNot applicableMagnitudeNot applicableTimingCorrect lower bound
Published 1 December 2002; actual interview recording day unknown.
Original horizon: Two or three years: approximate 2004–2005 lower-bound interval using publication as anchor; no exact-day deadline, no promise of attainment after that interval.
Further evidence: Specialized robotic hands and assembly systems nevertheless advanced.
Outcome rationale: Qualified primary state-of-field evidence supports the original broad manufacturing bundle; approximate credit reflects inferential and coverage limits, not a claim that narrow progress was zero.
Direction: No separate ultimate-capability direction is asserted.
Magnitude: No numeric performance or adoption magnitude specified.
Timing: The approximate two-or-three-year exclusion is supported by near-boundary recognition evidence and later scoped manipulation evidence; no exact census or exact onset date inferred.
Scope: One recognition/manipulation challenge bundle in the manufacturing discussion, including low-cost dexterous manipulation. Not absence of specialized robots, expensive hands, useful recognition or narrow industrial progress.
Limits: Near-boundary recognition plus retrospective practical manufacturing evidence, not universal proof or exact 2005 census. Specialized successes retained as counterweight.
Interpretation: The refusal to predict 30 or 40 years is not an upper-bound forecast.
Evidence confidence: Moderate: scoped historical inference, not exhaustive field census; interview recording date and precise lower-bound endpoint unknown.
Draft formula inputs
Not in this 424-record calculation edition. No score assigned here.
Ray Kurzweil19 Oct 2002Ordinary-PC chess reaches 200 million positions per second by October 19, 2008.
Ordinary-PC measurements near the 2008–2009 boundary support substantial computing growth but an overoptimistic numerical target. Whole outcome unresolved.
OutcomeUnresolvedDirectionNot separately gradedMagnitudeOverestimatedTimingTiming unresolved
2002-10-19
Original horizon: 2008-10-19
Further evidence: Differences in node definitions and hardware prevent an exact comparison, and later matching attainment has not been established. Computing growth occurred, but the numerical expectation was overoptimistic; comparable eventual attainment remains unresolved.
Direction: Not separately graded in the historical record.
Magnitude: No separately documented rationale is available.
Timing: Configuration differences and unknown later attainment prevent an exact delay or a current nonattainment claim.
Scope: The numerical evidence is from 2008–2009, not a 2026 hardware census. The review cutoff is not an attainment date, and chess strength does not by itself resolve throughput.
Evidence confidence: Not separately rated.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Ray Kurzweil19 Oct 2002By the later 2000s, ordinary-PC chess routinely defeats elite humans and interest in chess declines.
Elite-human matches, including notebook-computer evidence, support the strength improvement and broad timing.
OutcomePartly rightDirectionNot separately gradedMagnitudeUnresolvedTimingWithin original window
2002-10-19
Original horizon: Later 2000s
Further evidence: A few matches do not establish routine population-wide superiority, however, and the predicted decline in chess interest remains unmeasured. Elite match results support stronger computer chess, but routine superiority and declining interest are not fully established.
Direction: Not separately graded in the historical record.
Magnitude: No separately documented rationale is available.
Timing: Strength evidence falls before or within the late-2000s horizon; the interest component has no established realization date.
Scope: Standard games and ordinary-PC evidence support the strength component, not every-game infallibility. The full strength-plus-interest conjunction remains unresolved; throughput is a separate component in the same trajectory.
Evidence confidence: Not separately rated.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Eliezer Yudkowsky22 Jul 2001Chart grade 100 / 100The AI quest would still be continuing five years later, absent extraordinary luck.
The 2006 Stanford summit still treated the transition as prospective; the institutional record shows continued open-problem research beyond that period.
OutcomeNot applicableDirectionNot applicableMagnitudeNot quantifiedTimingCorrect lower bound
2001-07-22
Further evidence: Timing-only lower-bound judgment, not capability delivery credit.
Direction: Not separately scored.
Magnitude: No numerical capability promised.
Timing: The broad quest persisted beyond five years; changed research emphasis limits an exact-project reading.
Scope: Lower-bound research-continuation success only, not capability delivery. Research emphasis changed; low novelty and own-institution influence. Earlier upper-window misses remain separately visible.
Evidence confidence: Moderate; institution-specific, low novelty and partly self-influenced.
Current edition contribution · Eliezer Yudkowsky
Graded credit: 100 / 100.
- Recency weight
- 10%
- Credit × weight endpoint products
- 10
- Last documented backing
- 2001-07-22 to 2001-07-22
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
Selected deadline or scoped criterion only. This is not a whole-outcome grade. Archive timing: Correct lower bound.
- Credit
- 100 / 100
- Recency weight
- 10%
- Weighted credit term
- 10
- Same-claim backing date
- 2001-07-22 to 2001-07-22
Existing reviewed grade for the original scope; time intrinsic to that scope is retained.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
100,
100
]
},
"backingDateBounds": [
"2001-07-22",
"2001-07-22"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
100,
100
],
"weightBounds": [
0.1,
0.1
],
"normalizedBackingDateBounds": [
"2001-07-22",
"2001-07-22"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
100,
100
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Ben Goertzel6 Jun 2001Within years, AI genomic analysis closes an automated experimental feedback loop, reducing human involvement; broader human-genetics results are also anticipated.
An April 2009 physical prototype repeatedly linked genomic hypotheses, next-experiment selection/execution and result interpretation.
OutcomePartly rightDirectionRightMagnitudePartly supportedTimingTiming unresolved
Self-dated June 6, 2001; first public availability and newspaper publication unverified.
Further evidence: Its developers separately confirmed simple novel findings manually—not external replication. Bounded central-loop functionality, not full breadth or human-genetics fulfillment.
Direction: Integrated reasoning and physical experimentation; prior automation limits novelty.
Magnitude: Narrow prototype, not widespread researcher replacement; no prevalence or general-performance ratio.
Timing: April 2 disclosure; April 3 journal issue, not first attainment. No fixed deadline, timing hit or measured delay; earlier leads are discovery-only.
Scope: Researchers designed the system/domain; initial human setup remains legitimate. Evidence is the directly read abstract and complete same-team announcement, one event—not independent replications. Full paper denied; methods, run dates and controls uninspected. Earlier 2001/2004 works are discovery-only, not authenticated chronology or human-comparator evidence. Stronger many-case redundancy and human-genetics findings remain unresolved; no unrestricted scientist, clinical benefit or autonomous laboratory construction inferred. Central expectation was years; a possible months-scale cutting-edge case is separate, without an established three-month minimum. Ben Goertzel byline/self-date appear on a university personal page whose HTML metadata names Ted Goertzel.
Shared evidence: One composite, strongly dependent on the biomedical-AI trajectory; distinct from 2018 research assistance and held 2005 method adoption. No first-invention or exceptional-foresight credit. Aggregate historical capability only; no biological targets or experimental instructions.
Evidence confidence: Moderate for bounded central-loop functionality; lower for full breadth, source chronology and timing.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Ray Kurzweil15 Mar 2001Chart grade 25 / 100By 2009, voice becomes the main interface as conventional computers shrink into worn devices.
Qualified miss: voice applications spread, but conventional computing persisted.
OutcomeMostly wrongDirectionRightMagnitudeOverestimated at deadlineTimingOriginal window missed
2001-03-15
Further evidence: Omdia reports 58.1 million conventional-PC shipments in Q3 2026. Qualified approximate miss of the coupled transition, supported by both original-window evidence and continuing conventional-PC shipments before cutoff. The asserted disappearance of conventional computers is materially contradicted; exact 2026 voice-input share is not measured. This is not a permanent impossibility verdict or a claim that speech technology failed.
Direction: Google deployed mobile voice search to millions by 2009, and voice assistants later attained substantial usage; this is not a no-progress verdict.
Magnitude: Voice availability and occasional use do not establish interface primacy. Widespread conventional-device use contradicts the claimed wholesale miniaturization mechanism.
Timing: Latest original boundary 2009. Canalys documents touch-screen/integral-keyboard phones and Pew documents conventional-computer use in 2009; Google only introduced its desktop voice-search option in 2011. No inference that all voice software began in 2011.
Scope: The proposed mechanism included clothing, eyeglasses and contact lenses, leaving no keypad space. General adoption, not mere dictation availability or fluent conversation. Prior speech-technology entrepreneurship is disclosed; this was not a named product-readiness pledge. Useful speech, not perfect recognition, was the premise. Shipments and assistant-user percentages are not global input-volume shares. US/UK surveys are not a world census and assistant definitions miss some dictation; Ofcom uses a weighted online panel. Latest matched voice-use evidence is from 2024, whereas current hardware evidence is from Q3 2026. No permanent impossibility or exact delay is inferred. Older related formulations are dependent, not extra votes; no current same-scope endorsement is verified.
Evidence confidence: Moderate for the coupled adoption-transition miss; high for source-reported conventional-device persistence; lower for global voice-input primacy, whose latest matched survey evidence is 2024.
Current edition contribution · Ray Kurzweil
Graded credit: 25 / 100.
- Recency weight
- 10%
- Credit × weight endpoint products
- 2.5
- Last documented backing
- 2001-03-15 to 2001-03-15
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 25 / 100
- Recency weight
- 10%
- Weighted credit term
- 2.5
- Same-claim backing date
- 2001-03-15 to 2001-03-15
This state-at-time, annual trajectory or original-period market/adoption predicate already includes time in its meaning. There is no separate event-arrival penalty to add back; preserve the reviewed original credit and temporal scope.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
25,
25
]
},
"backingDateBounds": [
"2001-03-15",
"2001-03-15"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
25,
25
],
"weightBounds": [
0.1,
0.1
],
"normalizedBackingDateBounds": [
"2001-03-15",
"2001-03-15"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
25,
25
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Eliezer Yudkowsky24 Jan 2001Hard takeoff in SIAI’s or Webmind’s project within roughly ten years.
Post-horizon SIAI remained engaged in foundational research. Whole outcome unresolved.
OutcomeUnresolvedDirectionUnresolvedMagnitudeOverestimated at deadlineTimingOriginal deadline missed
2001-01-24
Further evidence: Webmind’s founder documented bankruptcy and unfinished development; a 2016 independent review still found no general-purpose AI among reviewed approaches. Eventual capability and counterfactual feasibility are not disproved. No duplicate content penalty.
Direction: Narrow AI advances do not establish the same rapid superintelligent transition.
Magnitude: Expected practical attainment materially exceeded the documented post-horizon state.
Timing: The approximately 2011 window passed without the named-project target; later corroboration permits substantial grace for “or so”.
Scope: Timing-only miss for named-project hard takeoff around 2011, allowing fuzzy wording. Same early-project trajectory as D020, not another independent vote; eventual feasibility remains unresolved.
Evidence confidence: Moderate-high for missed practical deadline; no verdict on eventual feasibility.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Eliezer Yudkowsky24 Sep 2000Chart grade 75 / 100AI programming assistance can substantially improve software development.
A 4,867-developer field study reported more completed tasks with assistance; a separate experienced-developer experiment found 19% slower completion.
OutcomePartly rightDirectionPartly rightMagnitudeUnresolvedTimingNo fixed deadline
2000-09-24 revised version; archived 2001-02-13
Further evidence: Benefits are real but heterogeneous. Material assistance is demonstrated, but the full cost-speed-reliability package is not generally established.
Direction: Productivity gains exist in some substantial settings, with important counterexamples.
Magnitude: No universal uplift or enormous all-programmer benefit established.
Timing: Undated long-run claim; no timing credit.
Evidence confidence: moderate; generic-versus-own-project interpretation explicit, study settings differ
Later statement: 2004-12-03 (consistent refinement; no additional claim count): AI-development assistance grows by degrees before full human-level competence.
Current edition contribution · Eliezer Yudkowsky
Graded credit: 75 / 100.
- Recency weight
- 10%
- Credit × weight endpoint products
- 7.5
- Last documented backing
- 2000-09-24 to 2000-09-24
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 75 / 100
- Recency weight
- 10%
- Weighted credit term
- 7.5
- Same-claim backing date
- 2000-09-24 to 2000-09-24
Existing reviewed grade for the original scope; time intrinsic to that scope is retained.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
75,
75
]
},
"backingDateBounds": [
"2000-09-24",
"2000-09-24"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
75,
75
],
"weightBounds": [
0.1,
0.1
],
"normalizedBackingDateBounds": [
"2000-09-24",
"2000-09-24"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
75,
75
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Eliezer Yudkowsky24 Sep 2000Chart grade 100 / 100Publicity eventually produces opposition to the Singularity path.
The March 2023 public letter called for a six-month pause of training systems beyond GPT-4.
OutcomeRightDirectionRightMagnitudeNot quantifiedTimingNo fixed deadline
2000-09-24 version; captured 2001-02-13
Further evidence: This supports organized resistance to unrestricted advanced-AI development, not permanent opposition to all AI. Organized opposition to advanced-AI development occurred.
Direction: Public discussion included efforts to stop or constrain development.
Magnitude: No particular constituency count or majority was promised.
Timing: No calendar deadline; no timing credit.
Evidence confidence: moderate; broad direction and partly self-influenced ecosystem
Current edition contribution · Eliezer Yudkowsky
Graded credit: 100 / 100.
- Recency weight
- 10%
- Credit × weight endpoint products
- 10
- Last documented backing
- 2000-09-24 to 2000-09-24
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 100 / 100
- Recency weight
- 10%
- Weighted credit term
- 10
- Same-claim backing date
- 2000-09-24 to 2000-09-24
Existing reviewed grade for the original scope; time intrinsic to that scope is retained.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
100,
100
]
},
"backingDateBounds": [
"2000-09-24",
"2000-09-24"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
100,
100
],
"weightBounds": [
0.1,
0.1
],
"normalizedBackingDateBounds": [
"2000-09-24",
"2000-09-24"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
100,
100
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Eliezer Yudkowsky31 Aug 2000Chart grade 0 / 100Institute’s seed-AI route probably feasible by 2010.
The August 2011 institutional plan still identified foundational open problems and researcher recruitment as future work. Whole outcome unresolved.
OutcomeUnresolvedDirectionUnresolvedMagnitudeOverestimated at deadlineTimingOriginal deadline missed
2000-08-31 revised version; archive captured 2001-01-25
Further evidence: The 2013 strategy continued that research pivot; a separate 2016 scientific assessment found no general-purpose AI among approaches reviewed. No realized complete seed-AI-to-Singularity target is established. Eventual capability and counterfactual feasibility remain unresolved, rather than declaring general AI impossible.
Direction: Later narrow-AI progress does not resolve the same complete target.
Magnitude: The expected practical readiness materially exceeded the post-deadline program’s documented state. This is a qualitative optimism judgment, not a computed probability error.
Timing: The stated year passed without the practical project target. Later institutional records support a missed research-plan horizon, not an exact date of eventual achievement.
Evidence confidence: moderate for missed practical research horizon; low for counterfactual feasibility
Current edition contribution · Eliezer Yudkowsky
Graded credit: 0 / 100.
- Recency weight
- 10%
- Credit × weight endpoint products
- 0
- Last documented backing
- 2000-08-31 to 2000-08-31
- Timing deduction recorded
- 0–100 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
Selected deadline or scoped criterion only. This is not a whole-outcome grade. Archive timing: Original deadline missed.
- Credit
- 0 / 100
- Recency weight
- 10%
- Weighted credit term
- 0
- Same-claim backing date
- 2000-08-31 to 2000-08-31
Selected practical research-plan deadline missed; eventual complete seed-AI target and counterfactual feasibility remain unverified. Waiver cannot turn absence of verified attainment into either success or permanent impossibility.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
0,
0
]
},
"backingDateBounds": [
"2000-08-31",
"2000-08-31"
],
"timingCostBounds": [
0,
100
],
"calculated": {
"creditBounds": [
0,
0
],
"weightBounds": [
0.1,
0.1
],
"normalizedBackingDateBounds": [
"2000-08-31",
"2000-08-31"
],
"timingCostBounds": [
0,
100
],
"deadlineWaiverCreditBounds": [
0,
100
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Ben GoertzelJul 2000 · rangeFirms would likely offer integrated language analysis and reasoning within two years.
Watson-based commercial products document integration by February 2013.
OutcomePartly rightDirectionRightMagnitudeUnresolvedTimingTiming unresolved
2000-07
Further evidence: Vendor/partner reports support limited availability, not clinical efficacy or sustained business success. Simple individual deductions and preexisting systems limit novelty. Qualified eventual integration, with limited inference and qualitative sophistication.
Direction: Inference-backed language processing reached commercial decision support.
Magnitude: One ecosystem, not industry dominance; no market-share threshold.
Timing: July 2002 remains unresolved; later evidence proves neither timely arrival nor lateness.
Scope: Joint Goertzel–Bugaj field forecast. Strict multiple-independent-firms reading remains unverified. This record is not counted twice. No humanlike general intelligence or numerical probability inferred.
Evidence confidence: Moderate for limited eventual commercial integration; primary vendor/partner evidence, qualitative sophistication and plural-vendor interpretation remain limited. Original July 2002 timing unresolved.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Ben GoertzelJul 2000 · rangeChart grade 0 / 100Within no more than ten years, an integrated Internet-agent economy replaces non-information intermediaries.
Goods-owning wholesalers remained substantial in 2026; isolated online agents do not establish an intermediary-free world economy.
OutcomeMostly wrongDirectionUnresolvedMagnitudeOverestimated at deadlineTimingOriginal deadline missed
2000-07
Further evidence: Continuing goods-owning intermediaries contradict the proposed global state.
Direction: Narrow agent/e-commerce progress is not the whole transition.
Magnitude: Worldwide replacement not observed; no exact share estimated.
Timing: Original July 2010 deadline missed; later evidence does not reset it.
Scope: Joint Goertzel–Bugaj world-economy claim, not isolated agents or e-commerce. Historical copy and approximate July 2000 issuance retained. Current-state judgment only, not permanent impossibility; joint forecast and approximate issue date retained.
Evidence confidence: High for continued physical intermediation; moderate-high for qualified broad-state content miss.
Current edition contribution · Ben Goertzel
Graded credit: 0 / 100.
- Recency weight
- 10%
- Credit × weight endpoint products
- 0
- Last documented backing
- 2000-07-01 to 2000-07-31
- Timing deduction recorded
- 25 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 0 / 100
- Recency weight
- 10%
- Weighted credit term
- 0
- Same-claim backing date
- 2000-07-01 to 2000-07-31
Current same-scope whole integrated-economy transition is judged approximately wrong, with continued physical intermediaries. Q=.25 is the declared ordinal conversion of that qualified judgment, not25% physical attainment or a documented late completed arrival.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
0,
0
]
},
"backingDateBounds": [
"2000-07-01",
"2000-07-31"
],
"timingCostBounds": [
25,
25
],
"calculated": {
"creditBounds": [
0,
0
],
"weightBounds": [
0.1,
0.1
],
"normalizedBackingDateBounds": [
"2000-07-01",
"2000-07-31"
],
"timingCostBounds": [
25,
25
],
"deadlineWaiverCreditBounds": [
25,
25
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Ben Goertzel10 Jun 2000AI would become utility-like Internet services, likely important around 2001–02; dominance around 2005 was only possible.
Qualified eventual utility-mechanism success: operating cloud services provide remote prediction, speech and image functions to other applications.
OutcomePartly rightDirectionRightMagnitudePartly matched scopeTimingTiming unresolved
10 June 2000 author-hosted essay
Further evidence: Early market importance and universal scope remain unestablished. Eventual central mechanism is partly right; the strict every-firm/any-product reading remains unresolved.
Direction: Operating services and customer integrations, not generic cloud infrastructure or launches alone.
Magnitude: Varied services across vendors; no universal-capability, prevalence or industry-dominance census.
Timing: Early specialized services existed; 2001–02 importance is unverified. Later evidence establishes neither first realization nor lateness; possible 2005 dominance is not a hard deadline.
Scope: Goertzel disclosed Intelligenesis and its intended Webmind service: an affiliated general-market forecast, not a Webmind launch promise. Vendors, functions and windows add no separate credit. No current reaffirmation, numerical probability, humanlike sophistication or wider economic transformation is inferred. Google’s 10 May 2011 report describes generally available hosted prediction, streaming updates and Ford research use. Its model marketplace was forthcoming. Provider testimony is not independent prevalence evidence. AWS’s November 2016 release describes usage-billed speech/image requests, GoAnimate’s integrated voices and Redfin’s image tags. Other customer plans were prospective; Lex was preview. Body date 30 November differs from the 29 November header. Vendor-hosted customer accounts do not independently establish prevalence. A 2024 study tested commercial prediction services in 2016 and 2021: Amazon/Azure first, later Google/Oracle too. Actual classification/regression runs demonstrate operation, but substantial gaps against top Kaggle solutions, feature-engineering dependence and time-specific coverage remain. A Microsoft Research coauthor and industry support prevent treating it as wholly vendor-independent; this is not effortless general AI. HNC’s 2001 annual report, released in 2002 without an established exact publication day, describes an operating decisioning ASP in finance, insurance and telecommunications. The business included a product acquired in early 2000; earlier product origins limit invention credit, while specialized operations do not establish Internet-wide market importance. A June 2003 BCC public overview covers AI-enhanced applications, not a separate AI-utility market; it cannot establish the 2001–02 denominator. The paid/login-restricted full report was not inspected.
Evidence confidence: Moderate for eventual utility mechanism; limited for broad adoption, early magnitude and timing.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Ray Kurzweil1 Sep 1999By 2019, a $1,000 PC (constant dollars) achieves 2×10^16 calculations per second.
Qualified shortfall under native-instruction price-performance, using representative 2018–2019 vendor evidence.
OutcomeMostly wrongDirectionRightMagnitudeOverestimated at deadlineTimingOriginal window missed
1 September 1999
Original horizon: 2019; approximately 20 years.
Direction: Computing price-performance improved; target attainment is separate.
Magnitude: Overestimated at deadline; no exact error ratio.
Timing: Original 2019 miss; eventual matching attainment unverified.
Limits: Constant-dollar base unspecified; card prices are not whole-PC budgets. Architecture/workload and neural-computation alternatives remain material. Tensor, sparse and floating-point figures are not interchangeable MIPS. Brain adequacy and software intelligence are ungraded; no universal hardware ceiling is established.
History: The 2003 collection corroborates a 2023 target; a later formulation republished in 2025 uses different units. Neither resets 2019, adds a forecast, or establishes current endorsement; conversion-clause provenance remains incomplete.
Evidence confidence: Moderate; representative and interpretation-sensitive.
Draft formula inputs
Not in this 424-record calculation edition. No score assigned here.
Ray Kurzweil16 Jan 1999Chart grade 25 / 100Road-guided long-distance automation arrives by 2009; by 2019, most roads automate driving and human highway driving is prohibited.
USDOT’s October–December 2019 survey (published June 2020) found limited readiness: 6% of responding agencies had begun/completed AV infrastructure upgrades, not 6% of roads.
OutcomeMostly wrongDirectionRightMagnitudeOverestimated at deadlineTimingOriginal deadline missed
1999-01-16 UTC / 1999-01-15 EST.
Further evidence: FHWA’s 2011/2012 accounts and NHTSA’s July 2020 assessment describe development, restricted trials and niche operations—not broad transition. Qualified later-stage deployment miss; not universal nonexistence.
Direction: Guided transit and escorted public-highway platoons show real progress; pre-1999 demonstrations limit novelty. Onboard-only autonomy is not the specified architecture.
Magnitude: Limited readiness, not road-mile prevalence; no global error ratio.
Timing: Later 2019 window missed. The 2009 existence-only reading remains sensitive to specialized systems; no worldwide 2009 census or exact eventual attainment.
Scope: Survey response was 60%; unknowns, overlapping jurisdictions and pooled testing/deployment limit inference. Evidence is mainly U.S.; international synthesis selectively covers English-language public research. Legal prohibition was not independently audited. No matched worldwide 2026 survey, exact delay or impossibility verdict. Prepared NHTSA remarks are not verified audio; GAO’s 2017 stakeholder sample is nongeneralizable, and later landing-page updates are excluded. Public-sector/research sources are dependent. Broader autonomous driving through other mechanisms cannot substitute.
Shared evidence: One staged lineage, not separate year/component votes; the retained retrospective is not new outcome evidence or a reset.
Evidence confidence: Moderate for qualified later-stage deployment miss; lower for exact 2009 existence coverage and worldwide extent.
Current edition contribution · Ray Kurzweil
Graded credit: 25 / 100.
- Recency weight
- 10%
- Credit × weight endpoint products
- 2.5
- Last documented backing
- 1999-01-16 to 1999-01-16
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 25 / 100
- Recency weight
- 10%
- Weighted credit term
- 2.5
- Same-claim backing date
- 1999-01-16 to 1999-01-16
This state-at-time, annual trajectory or original-period market/adoption predicate already includes time in its meaning. There is no separate event-arrival penalty to add back; preserve the reviewed original credit and temporal scope.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
25,
25
]
},
"backingDateBounds": [
"1999-01-16",
"1999-01-16"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
25,
25
],
"weightBounds": [
0.1,
0.1
],
"normalizedBackingDateBounds": [
"1999-01-16",
"1999-01-16"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
25,
25
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Nick Bostrom25 Oct 1998Conventional silicon technology needs substantial changes around 2007.
Working 2007 processors used replacement gate materials to address conventional scaling limits.
OutcomePartly rightDirectionRightMagnitudeUnresolvedTimingWithin original window
1997/1998; revised 1998-10-25; issue day unknown.
Further evidence: See Scope.
Direction: See Scope.
Magnitude: See Scope.
Timing: See Scope.
Scope: Successors allowed; silicon continued. Qualified transition, not universal physical endpoint or cessation. Magnitude and strict-boundary reading unresolved; soft around-2007 fit, not exact deadline, hard interval or first crossing. Endpoint undefined.
Evidence confidence: Moderate for the qualified material-transition fit; low for exact physical-limit equivalence. Both outcome sources are contemporary primary commercial technical releases.
Draft formula inputs
No draft score: out of scope. No vote, not zero.
Ray Kurzweil1997–1998 · rangeLiving-human noninvasive MRI resolves individual axons, dendrites and synapses: scanners reach market in 4–5 years, connection reverse-engineering in about ten.
The original window was missed.
OutcomeMostly wrongDirectionPartly rightMagnitudeOverestimated at deadlineTimingOriginal deadline missed
1997–1998 (uncertain)
Further evidence: Research in 2007–2012 distinguished millimeter-scale human connectivity maps from cellular wiring. Frontier work in 2025–2026 still infers cellular properties within larger voxels rather than directly reconstructing each connection. This supports a provisional current capability miss, not an exhaustive global census or impossibility proof. The evidence is AI-adjacent, not a direct model-task result. Representative current methods still fall short; the negative inference is provisional.
Direction: Real macroscopic mapping progress is credited, without assuming compute alone caused it.
Magnitude: Regional maps and inferred microscopic statistics are not direct individual-wiring images.
Timing: Approximate milestones fall around 2001–2003 and 2007–2008. Explicit 2012 limitations are beyond either window; no later completion is established.
Scope: Brain-derived AI templates; undated eventual vesicle resolution is not scored.
Shared evidence: These forecasts share one lecture and are not independent observations. Its exact date remains disputed.
Evidence confidence: High for original-window miss; moderate for current full-target nonrealization inferred from representative frontier evidence.
Draft formula inputs
No draft score: AI link unclear. No vote, not zero.
Ray Kurzweil1997–1998 · rangeBy 2019, computers converse naturally like human assistants.
Mixed eventual realization: independent spoken roleplay and design studies found natural, contextual exchanges, alongside interruptions, role drift and one-sided interaction.
OutcomeMixedDirectionRightMagnitudePartly matched scopeTimingTiming unresolved
1997–1998 (uncertain)
Further evidence: Small samples do not establish effortless human-assistant equivalence. The original 2019 timing remains unjudgeable. Independent human-interaction studies document both sustained contextual spoken assistance and interruptions, role drift or one-sided control on the same interaction target. This is observed mixed realization, not an ungraded outcome disguised as neutral.
Direction: Genuine flexible two-way spoken interaction is demonstrated beyond feature availability.
Magnitude: Small task-specific samples and material conversational friction; not effortless human-assistant equivalence or all-task intelligence.
Timing: The newer studies establish observation by publication in 2025 and 2026, not first realization. The original 2019 endpoint is unchanged; no clean 2019 miss or six-year lateness is inferred from the first newly inspected studies. Previously retained 2017–2018 positive and negative evidence remains.
Scope: Eventual conversational capability; not deadline success, clinical reliability, or all-task intelligence.
Shared evidence: These forecasts share one lecture and are not independent observations. Its exact date remains disputed.
Evidence confidence: Moderate for observed mixed eventual spoken interaction in small independent studies; broad generalization and original 2019 timing remain unestablished.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Ray Kurzweil1997–1998 · rangeBy 2019, assistant personality design receives substantial attention and offers many behavioral choices.
By August–November 2025, a general-purpose assistant offered selectable response styles, expanded to eight presets, with explicit design refinement and independent hands-on corroboration.
OutcomePartly rightDirectionRightMagnitudePartly matched scopeTimingTiming unresolved
1997–1998 (uncertain)
Further evidence: Earlier companion roles were narrower evidence; deep or perfectly persistent psychological traits are not established. General-assistant style choices support a qualified eventual match.
Direction: Companion configuration and later general-assistant styles support progress.
Magnitude: Eight presets and refinement support qualitative variety, not industry-wide prevalence.
Timing: Original 2019 deadline unverified; 2025 is observed later availability, not a reset or proof of lateness.
Scope: Behavioral choices, not merely voices or humanlike personality. Style consistency and earliest full availability are unestablished; no late-timing verdict.
Shared evidence: These forecasts share one lecture and are not independent observations. Its exact date remains disputed.
Evidence confidence: Moderate for eventual interface-style choices and documented design attention; deep personality consistency and original 2019 timing unestablished.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Ray Kurzweil1997–1998 · rangeChart grade 25 / 100Evolutionary neural-network design becomes standard practice by 2019.
AmoebaNet demonstrated genuine evolutionary search success. Whole outcome unresolved.
OutcomeUnresolvedDirectionNot separately gradedMagnitudeOverestimated at deadlineTimingOriginal deadline missed
1997–1998 (uncertain)
Original horizon: 2019-12-31 for this scenario block
Further evidence: Contemporary surveys nevertheless described substantial manual architecture design and prevalent gradient fitting. These methods can be combined; evidence about weights alone cannot settle architecture prevalence. Later survey evidence is not a current global census or a precise year-end adoption measure. Full attainment remains unresolved.
Direction: Not separately graded in the historical record.
Magnitude: Demonstrated successes did not establish the expected prevalence.
Timing: Contemporary evidence contradicts deadline attainment; no later completion date is established.
Scope: This does not disprove the method or resolve the separate global compute-share forecast.
Shared evidence: These forecasts share one lecture and are not independent observations. Its exact date remains disputed.
Evidence confidence: Not separately rated.
Current edition contribution · Ray Kurzweil
Graded credit: 25 / 100.
- Recency weight
- 10%
- Credit × weight endpoint products
- 2.5
- Last documented backing
- 1997-01-01 to 1998-12-31
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
Selected deadline or scoped criterion only. This is not a whole-outcome grade. Archive timing: Original deadline missed.
- Credit
- 25 / 100
- Recency weight
- 10%
- Weighted credit term
- 2.5
- Same-claim backing date
- 1997-01-01 to 1998-12-31
This state-at-time, annual trajectory or original-period market/adoption predicate already includes time in its meaning. There is no separate event-arrival penalty to add back; preserve the reviewed original credit and temporal scope.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
25,
25
]
},
"backingDateBounds": [
"1997-01-01",
"1998-12-31"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
25,
25
],
"weightBounds": [
0.1,
0.1
],
"normalizedBackingDateBounds": [
"1997-01-01",
"1998-12-31"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
25,
25
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Ray Kurzweil1997–1998 · rangeBy 2019, routine high-quality speech-to-speech translation covers common language pairs.
COMPASS (2 June 2026) tested public components in speech-to-speech pipelines.
OutcomePartly rightDirectionRightMagnitudePartly supportedTimingTiming unresolved
1997–1998 (uncertain)
Further evidence: Three bilingual judges rated each of 48 European-pair podcast, 40 Chinese–English medical and 50 Japanese–English dubbing clips. Selected English-linked pairs showed strong overall quality. Google’s December 2019 audible-phone rollout across 44 languages is separate availability history, not the tested product. A 2017 Skype study found meaning losses, not a verdict on later systems. Qualified eventual capability. Routine: technical availability through public checkpoints and documented default pipelines, not measured population usage.
Direction: Later end-to-end quality tests reinforce the speech-input/output trajectory.
Magnitude: Small selected samples; weaker European reverse direction and Japanese dubbing. Overall-quality ratings, not isolated semantic-accuracy means. Global majority-pair quality, uniform performance and professional parity remain unestablished. Film-dubbing requirements are not ordinary-translation gates.
Timing: 2019 unchanged; later publication establishes neither first attainment, a deadline hit/miss nor exact delay. Rollout alone does not establish historical quality.
Scope: Everyday consumer-ready joint fulfillment remains unresolved under that stronger reading. Toolkit release and turnkey availability of exact pipelines were not independently verified. No clinical endorsement.
Shared evidence: These forecasts share one lecture and are not independent observations. Its exact date remains disputed.
Evidence confidence: Moderate for qualified eventual common-pair speech capability; stronger worldwide most-pair coverage and historical timing unresolved.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Ray Kurzweil1997–1998 · rangeBy 2019, automated companions, teachers, carers and lovers offer memory and personality advantages.
Pre-deadline Replika observations establish companionship and romantic attachment, not the full bundle or representative human-equivalence attitudes. Whole outcome unresolved.
OutcomeUnresolvedDirectionRightMagnitudeUnresolvedTimingTiming unresolved
1997–1998 (uncertain)
Further evidence: The full conjunction remains unverified.
Direction: Observed relationships support emergence.
Magnitude: Comparative advantages and population attitudes were not measured.
Timing: Documented components preceded the deadline; whole-target timing remains unresolved.
Shared evidence: These forecasts share one lecture and are not independent observations. Its exact date remains disputed.
Evidence confidence: moderate for direction; full claim unresolved
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Ray Kurzweil1997–1998 · rangeChart grade 75 / 100By 2019, AI work across the arts attracts human and organizational collaboration and interest beyond novelty.
Visual art, music, literature and dance had public presentation, collaboration and substantive critical engagement by 2019; broad emergence, not exhaustive all-artform coverage.
OutcomePartly rightDirectionRightMagnitudePartly supportedTimingTiming unresolved
1997–1998 (uncertain)
Further evidence: Major domains support qualified emergence and collaboration; no representative audience percentage was required.
Direction: Documented works and reception support progress.
Magnitude: Broad emergence partly supported; literal all-artform coverage remains unverified.
Timing: Components preceded the 2019 deadline; complete all-artform timing remains unjudgeable.
Scope: Not typical artist adoption, autonomy, human-level quality or universal approval. Serious engagement need not be positive or free of novelty motives.
Shared evidence: These forecasts share one lecture and are not independent observations. Its exact date remains disputed.
Evidence confidence: Moderate for qualified emergence; exact original date and complete breadth remain uncertain.
Current edition contribution · Ray Kurzweil
Graded credit: 75 / 100.
- Recency weight
- 10%
- Credit × weight endpoint products
- 7.5
- Last documented backing
- 1997-01-01 to 1998-12-31
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 75 / 100
- Recency weight
- 10%
- Weighted credit term
- 7.5
- Same-claim backing date
- 1997-01-01 to 1998-12-31
Existing reviewed grade for the original scope; time intrinsic to that scope is retained.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
75,
75
]
},
"backingDateBounds": [
"1997-01-01",
"1998-12-31"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
75,
75
],
"weightBounds": [
0.1,
0.1
],
"normalizedBackingDateBounds": [
"1997-01-01",
"1998-12-31"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
75,
75
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Ray Kurzweil1997–1998 · rangeChart grade 100 / 100By 2019, public Turing-test pass claims attract substantive protocol objections.
The June 2014 announcement drew technical objections; organizers disagreed.
OutcomeRightDirectionNot separately gradedMagnitudeNot separately gradedTimingWithin original window
1997–1998 (uncertain)
Original horizon: 2019-12-31 for this scenario block
Further evidence: The documented controversy is the outcome, not established machine intelligence or a finding that every protocol is invalid. The disputed-evaluation pattern occurred.
Direction: Not separately graded in the historical record.
Magnitude: Not separately graded in the historical record.
Timing: June 8 announcement and June 10–17 objections precede the deadline; no first-ever event is asserted.
Scope: A later stronger test cannot undo this occurrence. The separate wager, consciousness and system-performance assessments receive no extra credit.
Shared evidence: These forecasts share one lecture and are not independent observations. Its exact date remains disputed.
Evidence confidence: Not separately rated.
Current edition contribution · Ray Kurzweil
Graded credit: 100 / 100.
- Recency weight
- 10%
- Credit × weight endpoint products
- 10
- Last documented backing
- 1997-01-01 to 1998-12-31
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 100 / 100
- Recency weight
- 10%
- Weighted credit term
- 10
- Same-claim backing date
- 1997-01-01 to 1998-12-31
Existing reviewed grade for the original scope; time intrinsic to that scope is retained.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
100,
100
]
},
"backingDateBounds": [
"1997-01-01",
"1998-12-31"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
100,
100
],
"weightBounds": [
0.1,
0.1
],
"normalizedBackingDateBounds": [
"1997-01-01",
"1998-12-31"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
100,
100
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Nick Bostrom1997–1998 · rangeConditional 12–18-month doubling: supercomputers reach 10^14 ops/s during 2004–2008; 10^17 during 2015–2024.
BlueGene/L measured 280.6 TFLOP/s in November 2005; Summit measured 143.5 PFLOP/s in November 2018.
OutcomePartly rightDirectionRightMagnitudePartly supportedTimingTiming unresolved
1997/1998; revised 1998-10-25; clause vintage unverified.
Further evidence: Intel/Sandia used operations per second for LINPACK FLOPS in 1996. ASCI Red ranking history supports likely baseline identity, not precise attribution. Qualified proxy support; see Scope.
Direction: See Scope.
Magnitude: See Scope.
Timing: In-window proxies; see Scope.
Scope: FLOPS proxies, not cognition, biological equivalence, MIPS, brain-simulation sufficiency, software readiness or affordable lab access. 1.5-Tops baseline/rounding unverified; extrapolation beyond 15 years cautioned. Growth baseline limits novelty; postscripts do not reset windows. Sustained, not peak; exact targets and first crossings unresolved. Biological estimates uncertain.
Evidence confidence: Moderate for qualified numerical hardware trajectory; low for biological-operation equivalence and broader brain-simulation sufficiency.
Draft formula inputs
No draft score: out of scope. No vote, not zero.
Nick Bostrom1997–2008 · rangeIncentives to improve AI strengthen before human-level capability.
Verified repeated research investments support increasing pressure. Whole outcome unresolved.
OutcomeUnresolvedDirectionPartly rightMagnitudeUnresolvedTimingNo fixed deadline
1997/1998; edition with postscripts through 2008.
Further evidence: See Scope.
Direction: Qualified observed support: repeated large investments with stated research/commercial objectives are evidence of increasing development pressure. Pressure is inferred from actual commitments, not directly measured as a causal variable.
Magnitude: See Scope.
Timing: See Scope.
Scope: Human-equivalence trajectory and political/safety contingencies unresolved; neither inevitable AGI nor inability to halt follows. No dollar threshold, growth rate or defined strength; selected partnerships are not a global effort census. Undated; no imported 2033 superintelligence scenario.
Evidence confidence: Moderate for observed investment-direction inference; lower for the entire causal/political trajectory and original-version precision.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Stuart Russell1996 · uncertainChart grade 100 / 100Research on belief networks and neural networks would fuse in future years.
Deep belief networks (2006) and structured variational autoencoders (2016) implemented substantive combinations of probabilistic graphical inference and neural learning.
OutcomeRightDirectionRightMagnitudeNot quantifiedTimingNo fixed deadline
1996
Further evidence: Deep belief networks and structured variational autoencoders substantively combine probabilistic graphical inference with neural learning, rather than merely sharing terminology.
Direction: The predicted research combination developed substantively after the publication year. This credits continuation and extension, not an original invention or replacement of other approaches.
Magnitude: The forecast states no numerical scale, adoption share or dominance threshold. No post-hoc magnitude is supplied.
Timing: The forecast is explicitly multiyear but undated. Outcomes in 2006 and 2016 support realization by the cutoff; no artificial met-deadline or first-achievement date is assigned.
Scope: Continued research integration, not first invention, field dominance or a later symbolic revival. The original notes existing beginnings. Publication was in 1996; the inspected author-linked draft has no verified issue day. No exact deadline.
Shared evidence: Related to later hybrid-method advocacy, but does not resolve those separate language, dominance or safety claims.
Evidence confidence: High for subsequent technical integration; moderate for original issuance dating because the inspected text is an author-linked draft attached to the 1996 publication. Qualitative continuation has limited discriminatory information.
Current edition contribution · Stuart Russell
Graded credit: 100 / 100.
- Recency weight
- 10%
- Credit × weight endpoint products
- 10
- Last documented backing
- 1996-01-01 to 1996-12-31
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 100 / 100
- Recency weight
- 10%
- Weighted credit term
- 10
- Same-claim backing date
- 1996-01-01 to 1996-12-31
Existing reviewed grade for the original scope; time intrinsic to that scope is retained.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
Later same-claim public re-endorsement is not established by the bounded archive review; use the literal claim date as the fallback only. Only 1996 is supported; keep year interval and do not manufacture a day.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
100,
100
]
},
"backingDateBounds": [
"1996-01-01",
"1996-12-31"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
100,
100
],
"weightBounds": [
0.1,
0.1
],
"normalizedBackingDateBounds": [
"1996-01-01",
"1996-12-31"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
100,
100
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Kai-Fu LeeSep 1993 · rangeChart grade 75 / 100Speech aids disability communication.
RIT’s 2002 deaf/hard-of-hearing classroom used human-shadowed recognition and corrected notes; a small comparison favored interpretation.
OutcomePartly rightDirectionRightMagnitudeNot quantifiedTimingWithin original window
1993-09
Further evidence: A 1995 public abstract reports better essays from postsecondary students with learning disabilities using recognition rather than unaided writing. Bounded help. Writing benefit is not general conversation.
Direction: Real use and comparisons support limited assistance alongside failures.
Magnitude: No general effectiveness or prevalence estimate.
Timing: The 1995 and 2002 evidence is predeadline. The 2017 report is later corroboration/counterevidence, not deadline evidence.
Scope: Pre-1993 assistive cases make this weak continuation, not invention. Human shadowing/correction were essential; classroom latency and errors hindered comprehension. 1995: public abstract only; full text restricted and unread. The 2017 firsthand account found quiet one-to-one help but failures with noise, multiple speakers, accents and deaf speech; it is not a representative controlled efficacy estimate. Its repository version is 2019, not the study date. Historical statements; no recent same-scope reaffirmation verified.
Note: Scope
Evidence confidence: moderate for bounded useful assistance; weakly informative broad continuation
Current edition contribution · Kai-Fu Lee
Graded credit: 75 / 100.
- Recency weight
- 10%
- Credit × weight endpoint products
- 7.5
- Last documented backing
- 1993-09-01 to 1993-09-30
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 75 / 100
- Recency weight
- 10%
- Weighted credit term
- 7.5
- Same-claim backing date
- 1993-09-01 to 1993-09-30
Existing reviewed grade for the original scope; time intrinsic to that scope is retained.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
75,
75
]
},
"backingDateBounds": [
"1993-09-01",
"1993-09-30"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
75,
75
],
"weightBounds": [
0.1,
0.1
],
"normalizedBackingDateBounds": [
"1993-09-01",
"1993-09-30"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
75,
75
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Kai-Fu LeeSep 1993 · rangeChart grade 0–50 / 100Standard voice-controlled car radio, phone and climate; not brakes/steering.
Honda supplied the capability in 2002–2003 as a paid option. Whole outcome unresolved.
OutcomeUnresolvedDirectionRightMagnitudeOverestimated at deadlineTimingOriginal deadline missed
1993-09
Further evidence: Ford’s later uptake mixed standard/optional availability. BMW retained optional/dealer-installed systems in November 2003, after the endpoint. A definitive prevalence estimate remains unavailable. Demonstrated capability and a qualified equipment shortfall imply neither permanent incapability nor a separate wrong-content verdict.
Direction: Honda supplied the functions; later Ford deployment expanded.
Magnitude: Higher-trim/paid options support a qualified equipment shortfall.
Timing: Qualified miss under that interpretation. No global prevalence census or exact later fulfillment date is claimed.
Scope: Representative manufacturer specifications, not independent accuracy tests; both Honda reports share one maker. Premium standard-equipped niches are not ruled out. BMW is post-endpoint corroboration, not deadline evidence; human-assisted BMW Assist alone is not autonomous speech. Ford’s 2011 progress neither resets the horizon nor proves exact full realization. Historical statements; no recent same-scope reaffirmation verified.
Shared evidence: Approximately September 2003; day unknown. Apple speech researcher; industry-wide, not Apple-specific. Unstated universality, numerical targets, perfection, unconstrained/humanlike dialogue and efficacy are excluded. KFL-1993-CAR-VOICE: geography unspecified; no retrofit; capability-only differs. KFL-1993-DICTATION-MARKETS: Excludes human transcription, diagnosis, autonomous authorship; limited medical dictation preexisted. KFL-1993-PHONE-CALLS: operators preexisted; not desktop-only, touch-tone/recording-only or universal receptionists; no all-PC requirement. KFL-1993-ACCESSIBLE-COMMUNICATION: no recovery or interpreter replacement. KFL-1993-PC-SPEECH: shipped recognition/synthesis, not ports/APIs/downloads; setup/training allowed. No unconstrained dictation, all-language coverage, default microphone or daily-use mandate; PlainTalk/Casper announced; limited systems preexisted. KFL-1993-SPEECH-EDUCATION: recognized/synthesized instruction/assessment, not prerecorded audio, availability or isolated prototypes. KFL-1993-MOBILE-PEN-SPEECH: integrated pen/gesture and recognized speech, not unrelated features or adoption mandate. These IDs share an original source, not independent tests.
Evidence confidence: Moderate for qualified adoption magnitude/timing miss; high for cited equipment distinctions; eventual industry-wide adoption unresolved.
Current edition contribution · Kai-Fu Lee
Graded credit: 0–50 / 100.
- Recency weight
- 10%
- Credit × weight endpoint products
- 0–5
- Last documented backing
- 1993-09-01 to 1993-09-30
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
Selected deadline or scoped criterion only. This is not a whole-outcome grade. Archive timing: Original deadline missed.
- Credit
- 0–50 / 100
- Recency weight
- 10%
- Weighted credit term
- 0–5
- Same-claim backing date
- 1993-09-01 to 1993-09-30
This state-at-time, annual trajectory or original-period market/adoption predicate already includes time in its meaning. There is no separate event-arrival penalty to add back; preserve the reviewed original credit and temporal scope.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
0,
50
]
},
"backingDateBounds": [
"1993-09-01",
"1993-09-30"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
0,
50
],
"weightBounds": [
0.1,
0.1
],
"normalizedBackingDateBounds": [
"1993-09-01",
"1993-09-30"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
0,
50
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Kai-Fu LeeSep 1993 · rangeDictation enters medicine, law and publishing.
Medical and legal practitioners used automatic dictation; authors documented commercially published manuscripts created with Dragon.
OutcomePartly rightDirectionRightMagnitudeUnresolvedTimingTiming unresolved
1993-09
Further evidence: Training, correction and workflow friction persisted. Limited uptake supported; narrower publisher-internal use remains unverified.
Direction: Actual professional use, not only availability or benchmarks, supports the direction.
Magnitude: No representative census or audited universal speedup; limited uptake only.
Timing: Medical and some legal use are documented in 2003; author evidence here is 2015–2017. Later evidence proves neither earlier absence nor an exact delay: no timing success or miss.
Scope: Human editing/training persist, including a failed medical rollout, difficult legal correction and selective author use. Supplier and writing-tool testimony is commercially interested, not independent adoption or time-savings measurement. Historical statements; no recent same-scope reaffirmation verified.
Note: Scope
Evidence confidence: moderate for eventual substantive penetration; timing unjudgeable
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Kai-Fu LeeSep 1993 · rangeChart grade 75 / 100Useful mobile pen and speech integration.
The 2000 handheld evaluation demonstrates bounded complementary recognition benefit within the forecast window.
OutcomePartly rightDirectionRightMagnitudePartly supportedTimingWithin original window
1993-09
Further evidence: A real mobile system provides qualified useful combination, with residual errors and adverse-condition failures.
Direction: Implemented integration yielded comparative recognition benefits.
Magnitude: Task- and environment-specific gains; no general adoption or superiority finding.
Timing: October 2000 publication establishes a supporting realization rather than earliest invention.
Scope: The October 2000 developer study tested 16 handheld-PC users, plus six with another microphone, in stationary and walking community-simulation tasks with moderate cafeteria noise. Fused speech and pen reduced relative speech errors by 19% and 35% in the two microphone conditions, with significant comparisons. Mobile degradation remained. This is not unrestricted command success or end-to-end productivity. The 1997 QuickSet developers describe an implemented handheld speech-and-pen system delivered for simulation use. Extreme deployment noise made speech unusable, leaving gesture-only use. Earlier proactive usability work did not evaluate the completed system. The CHI 1996 study found faster combined-input map tasks among 18 users, but an informed human interpreted the input. This was not autonomous recognition. Benefits were task-specific and did not generalize to previously studied verbal/numeric domains. The page-generation footer is December 1995, not the conference date. Bolt’s 1980 large-screen voice-and-pointing demonstration predates the forecast. It is a conceptual baseline, not the later mobile pen-interface result; no first-invention credit. Small developer samples do not establish general superiority. No recent same-scope reaffirmation is verified.
Note: Scope
Evidence confidence: moderate; clear matched capability but small developer studies and qualitative power threshold
Current edition contribution · Kai-Fu Lee
Graded credit: 75 / 100.
- Recency weight
- 10%
- Credit × weight endpoint products
- 7.5
- Last documented backing
- 1993-09-01 to 1993-09-30
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 75 / 100
- Recency weight
- 10%
- Weighted credit term
- 7.5
- Same-claim backing date
- 1993-09-01 to 1993-09-30
Existing reviewed grade for the original scope; time intrinsic to that scope is retained.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
75,
75
]
},
"backingDateBounds": [
"1993-09-01",
"1993-09-30"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
75,
75
],
"weightBounds": [
0.1,
0.1
],
"normalizedBackingDateBounds": [
"1993-09-01",
"1993-09-30"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
75,
75
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Kai-Fu LeeSep 1993 · rangeChart grade 25 / 100All PCs ship with speech recognition and synthesis.
Ordinary XP base-install and HP-image evidence supports a qualified supply shortfall; the later Dell report corroborates.
OutcomeMostly wrongDirectionRightMagnitudeOverestimated at deadlineTimingOriginal window missed
1993-09
Further evidence: Tablet/Office exceptions and later Vista/Mac built-ins support diffusion. Qualified supply shortfall, not a forensic census or technology failure.
Direction: Real recognition shipped; later mainstream integration expanded.
Magnitude: Fulfillment remains unverified; no percentage invented.
Timing: Qualified miss, not an exhaustive endpoint inventory. Later integration does not reset the deadline.
Scope: A Microsoft-authored SAPI guide says ordinary XP includes the API and synthesis, but recognition needs separate installation. It does not exclude OEM, Office or Tablet bundles. Copyright 2001; PDF metadata November 23, 2002; third-party host, not an immutable contemporary Microsoft capture or verified issue day. HP’s overview of its d530 standard factory image lists Word/Works/Office XP as optional and distinguishes preinstalled from merely preloaded applications; its component table lacks a recognizer. Printed June 2003, PDF metadata July 22: not a September observation or exhaustive forensic inventory of every purchased configuration. A July 13, 2004 firsthand Dell Dimension 2400 review reports XP Home, supplied-but-not-preinstalled WordPerfect Office 11 and sparse enumerated extras; Office 2003 was a user choice. Microphone/speakers were present. This is later corroboration, not a 2003 test or explicit search for every recognizer; unreported bundles remain possible. Microsoft’s September 15, 2003 Tablet PC report documents voice input, manufacturer preinstallation and language packs. This is a positive special-edition exception, not ordinary XP-wide supply. Microsoft’s August 8, 2006 Vista announcement promises integrated dictation/commands. Its sweeping first-Windows wording is qualified by its own Tablet evidence; not proof of universal earlier absence. Microsoft’s January 23, 2007 launch account anchors later consumer Vista availability, not an all-PC census. Apple’s Tiger 10.4 accessibility document describes built-in VoiceOver and limited command recognition; additional dictation products remain separate. Exact document date is unverified. A Microsoft research page established December 16, 2008 broadly lists recognition shipped in Windows 2000/XP. This contrary wording does not identify ordinary default installation and can include special editions, OEM or software bundles. Qualified inference, not an exhaustive inventory. Later mainstream integration is genuine progress. No recent same-scope reaffirmation verified.
Note: Scope
Evidence confidence: Moderate for the qualified bounded supply shortfall; lower for exact endpoint universal coverage and quantitative near-universal interpretation.
Current edition contribution · Kai-Fu Lee
Graded credit: 25 / 100.
- Recency weight
- 10%
- Credit × weight endpoint products
- 2.5
- Last documented backing
- 1993-09-01 to 1993-09-30
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 25 / 100
- Recency weight
- 10%
- Weighted credit term
- 2.5
- Same-claim backing date
- 1993-09-01 to 1993-09-30
This state-at-time, annual trajectory or original-period market/adoption predicate already includes time in its meaning. There is no separate event-arrival penalty to add back; preserve the reviewed original credit and temporal scope.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
25,
25
]
},
"backingDateBounds": [
"1993-09-01",
"1993-09-30"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
25,
25
],
"weightBounds": [
0.1,
0.1
],
"normalizedBackingDateBounds": [
"1993-09-01",
"1993-09-30"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
25,
25
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Kai-Fu LeeSep 1993 · rangeChart grade 100 / 100Speech-enabled computers place and answer calls.
A May 1995 firsthand Wildfire user described speech-controlled outgoing calls plus incoming answering, screening, routing and messages.
OutcomeRightDirectionRightMagnitudeNot quantifiedTimingWithin original window
1993-09
Further evidence: Both functions were used, not merely promised; this is a modest functional result, not a general-intelligence threshold.
Direction: A commercial deployment supports the direction.
Magnitude: No representative adoption or reliability estimate is available.
Timing: The May 1995 report is predeadline; earliest realization unknown.
Scope: One expensive commercial-user account, not a representative adoption or accuracy study. MailCall’s separate research prototype had learning/name-recognition problems and poor noisy-cellular performance; do not transfer its error rates to Wildfire. Historical statements; no recent same-scope reaffirmation verified.
Note: Scope
Evidence confidence: moderate-high for the modest functional outcome; weak forecasting informativeness
Current edition contribution · Kai-Fu Lee
Graded credit: 100 / 100.
- Recency weight
- 10%
- Credit × weight endpoint products
- 10
- Last documented backing
- 1993-09-01 to 1993-09-30
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 100 / 100
- Recency weight
- 10%
- Weighted credit term
- 10
- Same-claim backing date
- 1993-09-01 to 1993-09-30
Existing reviewed grade for the original scope; time intrinsic to that scope is retained.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
100,
100
]
},
"backingDateBounds": [
"1993-09-01",
"1993-09-30"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
100,
100
],
"weightBounds": [
0.1,
0.1
],
"normalizedBackingDateBounds": [
"1993-09-01",
"1993-09-30"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
100,
100
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Kai-Fu LeeSep 1993 · rangeWidespread speech technology in language learning and education.
Separate production platforms support qualified eventual diffusion across language lessons, literacy practice and speaking assessment.
OutcomePartly rightDirectionRightMagnitudePartly supportedTimingTiming unresolved
1993-09
Further evidence: Actual routine use supports qualitative diffusion, not a representative majority of all education.
Direction: Speech-mediated instruction and assessment are used, with teachers and human raters retained.
Magnitude: Substantial activity, but no pooled unique-user total; registrations are not recognition users.
Timing: Later observations establish neither punctuality nor a miss; no first-realization date is inferred.
Scope: A Duolingo engineer’s commercially hosted May 2017 account describes synthesized lessons for millions daily and pronunciation recognition. Its 170 million registrations are not daily speech users. Pronunciation errors persist; voice comparisons do not establish general learning effects. No independent audit. An August 2022 Google engineer reports 30 million children reading 120 million stories over three years with automated listening and feedback. These are cumulative provider-reported activities, not daily users, downloads or a sector-wide denominator. The web beta does not date the earlier Android service. ETS’s copyright-2020 report says SpeechRater and a human rater jointly contribute operational speaking scores since 2019. Reported combined reliability supports assessment use, not human replacement or a learner count. Provider-authored research. Microsoft’s August 2026 account reports 3,431 students and 8,381 reading submissions in a 21-week pilot across eight Philippine regions. National access announcements are not national uptake; teacher-mediated activity is not experimental proof of a learning effect. Provider scales are not summed. Language/accent errors and coverage limits remain. No recent same-scope reaffirmation is verified.
Note: Scope
Evidence confidence: moderate for qualified eventual qualitative adoption; timing and representative sector-wide prevalence unjudgeable
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Ray KurzweilFeb 1993 · rangeChart grade 75 / 100A computer becomes world chess champion by the end of the 1990s.
Deep Blue beat Kasparov in a 1997 match, but did not acquire the formal championship.
OutcomePartly rightDirectionRightMagnitudeChampion-level, not formal titleTimingWithin original window
1993-02
Further evidence: Qualified approximate success on the contextual playing-capability interpretation: the paragraph compares computer and human ratings and expects displacement of human chess supremacy. It is not an exact literal success because the formal championship remained human. The qualification is a material semantic distinction, not missing-evidence hedging.
Direction: A computer progressed from near-grandmaster strength to beating the reigning champion in a match.
Magnitude: Champion-level match performance is demonstrated; formal championship succession, all-opponent dominance and long-run repeatability are not.
Timing: The documented 1997 match precedes the end-of-1990s window. This is not a score for an exact 1998 prediction, which this 1993 source does not supply; formal-title reading would instead miss the deadline.
Scope: 1993 contemporaneous endorsement of an earlier forecast. No personal-computer price class, numerical playing rating, specified 1998 crossover date, universal superiority, or decline in public chess interest is added. Formal title ownership and defeating the reigning human champion are distinct interpretations. Verified endorsement is the dated 1993 reprint attribution, not an inspected 1990 book or an immutable contemporary scan. The literal title reading fails; it would miss the deadline.
Evidence confidence: High for match and title facts; moderate for contextual interpretation and original reprint provenance.
Current edition contribution · Ray Kurzweil
Graded credit: 75 / 100.
- Recency weight
- 10%
- Credit × weight endpoint products
- 7.5
- Last documented backing
- 1993-02-01 to 1993-02-28
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 75 / 100
- Recency weight
- 10%
- Weighted credit term
- 7.5
- Same-claim backing date
- 1993-02-01 to 1993-02-28
Existing reviewed grade for the original scope; time intrinsic to that scope is retained.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
75,
75
]
},
"backingDateBounds": [
"1993-02-01",
"1993-02-28"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
75,
75
],
"weightBounds": [
0.1,
0.1
],
"normalizedBackingDateBounds": [
"1993-02-01",
"1993-02-28"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
75,
75
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Ray KurzweilMay 1992 · rangeListening machines for deaf users: early versions within several years, deployment later in the 1990s.
Google released Live Transcribe in 2019; a deaf collaborator reported daily conversational use in 2023.
OutcomePartly rightDirectionRightMagnitudePartly supportedTimingTiming unresolved
1992-05
Further evidence: Independent scripted live-speech tests support bounded functionality. Qualified eventual assistance, not uniform conversational effectiveness.
Direction: Direct automated continuous-speech captions became practical.
Magnitude: Vocabulary size uncounted; speaker independence inferred, not held-out-speaker tested. No promised accuracy threshold.
Timing: 1998 trained-speaker pilot and March 2000 human-corrected news captions were partial systems. Fuller 2019–2023 evidence is later; no on-time credit, historical absence claim, first-crossing date or measured delay.
Scope: Large vocabulary, speaker independence, ordinary continuous speech and real-time text are the conjunction; occasional errors allowed. Not discrete words, human re-speaking, disability elimination or all-interpreter replacement. May 1992 month from August 2001 reprint; exact day/immutable wording unverified. Existing speech technology limits novelty; no modern same-scope reaffirmation. Google/Gallaudet collaborated, not independent validations; downloads are not active deaf users. Cloud captions then; on-device recognition/speaker separation were future work. Millett (2021–2022 journal volume; test dates unverified) used a scripted 15-minute lecture and three-speaker conversation, optimized lecture audio and individual conversation phones. Small samples; no spontaneous/noisy-conversation validation or deaf-user comprehension measure. Accuracy figures are not transferred to Google. 2017 firsthand ASR use sometimes helped quiet one-to-one exchanges, but noise, accents, multiple speakers and deaf speech caused failures; not representative efficacy. Bain/Paez’s 1998 pilot required intensively trained voice profiles and lacked useful sentence segmentation. NHK’s March 2000 news captions required human correction; do not transfer its 2001 engine results backward or from studio news to spontaneous conversation. Errors can change meaning; no accommodation recommendation.
Shared evidence: The 2017 ASR context also supports Lee’s 1993 accessibility forecast; shared evidence, not independent validation.
Evidence confidence: Moderate for qualified eventual functionality; historical timing unresolved
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Ray KurzweilApr 1992 · rangeSeeing machines describe real scenes and answer blind users’ follow-up questions early in the next century.
2025 studies: blind/low-vision users obtained useful live-video descriptions and follow-up interaction; October 2026 Gemini deployment separately corroborates emergence.
OutcomePartly rightDirectionRightMagnitudePartly supportedTimingTiming unresolved
1992-04
Further evidence: Qualified real-time responsive assistance; continuous autonomous narration unresolved.
Direction: Beyond OCR-only reading.
Magnitude: Useful but limited; no numerical threshold or human-equivalence established.
Timing: 2025–2026 evidence is late relative to a soft early-century horizon; no on-time credit, first-crossing date or measured delay.
Scope: Early versions could be crude; wearability, all-direction sight and enhanced acuity were possibilities, not requirements. Manual or verbal questions allowed; cheaper reading, translation and disability elimination are not demonstrated. Prior reading/vision systems limit novelty; no proven Kurzweil-product lineage. April 1992 month from August 2001 reprint; exact day/immutable wording unverified; no modern same-scope reaffirmation. Chang: eight blind/low-vision participants, two-hour accompanied sessions; all failed to elicit continuous narration. Hallucinations, spatial/dynamic-scene errors and human safety intervention preclude safe-navigation inference. Zhang v2 (December 4, 2025): five visually impaired and three blindfolded sighted users tested Zhipu; separate GPT-4o benchmarks used three blindfolded sighted testers. Do not transfer models/cohorts or backdate v2 to May v1. Small samples; noise, slow interaction and missing actionable detail limit generalization. Gemini October 1, 2026: vendor/collaborator release, no accuracy denominator; not a mobility aid or white-cane replacement. No transfer of tested ChatGPT/Zhipu performance. Observation days unspecified. Residual vision/hearing and assistance remain relevant.
Shared evidence: Strongly related to K-2003-ASSISTIVE-CAMERA-READER; distinct scene-dialogue versus text-reading scopes, not independent forecasting evidence.
Evidence confidence: Moderate for qualified eventual interactive functionality; low for historical timing and broad reliability.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Ray KurzweilAug 1991 · rangeChart grade 75 / 100By 2020, computer knowledge navigators would interview people for information and serve as personal research assistants.
Reported earlier uses of Juji's public platform and its 2020 evaluation support structured research interviewing.
OutcomePartly rightDirectionRightMagnitudePartly supportedTimingWithin original window
August 1991 (author-authorized reprint attribution; exact day/original issue unverified).
Further evidence: Later 2025 systems add adaptive interviews and analysis—not in-window evidence. Bounded research use supported; general personal navigators unestablished.
Direction: Real-human elicitation, beyond document retrieval.
Magnitude: Structured, domain-limited use; breadth/prevalence unestablished.
Timing: 2020 functional support; stronger interpretation unjudgeable, not a measured five-year delay.
Scope: MOLE already elicited expert knowledge in 1986: no invention/novelty credit. Company-linked 2020 base deployments differ from enhanced active-listening evaluation; spontaneous follow-ups/topic memory were absent. The independent 2025 university study was tiny and monitored, with missed probes/audio failures: no statistical equivalence/expert parity. Anthropic's coherent, human-reviewed workflow supports research use, not general commissioning; company-run, text-only, selected workers, no human-interviewer comparison group, demand/coding limitations. 2025 depth is later evidence; field dates/first crossing unknown. Fictional future-retrospective framing retained; 2001/2025 reprints neither reset issuance nor establish current endorsement.
Shared evidence: One human-source-acquisition target; strongly dependent on conversational/search assistants (K-C019, K-C029, KM19-B03), not additional votes.
Evidence confidence: Moderate for bounded functional use; lower for 2020 breadth and original personal-navigator interpretation.
Current edition contribution · Ray Kurzweil
Graded credit: 75 / 100.
- Recency weight
- 10%
- Credit × weight endpoint products
- 7.5
- Last documented backing
- 1995-06-25 to 1995-06-25
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 75 / 100
- Recency weight
- 10%
- Weighted credit term
- 7.5
- Same-claim backing date
- 1995-06-25 to 1995-06-25
Existing reviewed grade for the original scope; time intrinsic to that scope is retained.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
The author dates this presentation to 25 June 1995. It repeats the same by-2020 navigator interviewing people for information and acting as a personal research assistant. The reprint is not a new forecast.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
75,
75
]
},
"backingDateBounds": [
"1995-06-25",
"1995-06-25"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
75,
75
],
"weightBounds": [
0.1,
0.1
],
"normalizedBackingDateBounds": [
"1995-06-25",
"1995-06-25"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
75,
75
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Ray KurzweilAug 1991 · rangeChart grade 25 / 100By 2020, almost everyone routinely uses listening eyeglasses with translation.
CivicScience’s January 2021 account describes AR-glasses/headset ownership as stagnant during 2020 and below VR.
OutcomeMostly wrongDirectionRightMagnitudeOverestimated at deadlineTimingOriginal window missed
August 1991 attribution; authorized 2025 reprint, original issue unverified.
Further evidence: CNIL’s January 2026 French adult survey found 1% ownership and 9% ever trying broad smart glasses. Approximate adoption overstatement, not technological impossibility.
Direction: Useful caption functionality emerged.
Magnitude: Near-universal use overstated; no exact global percentage inferred.
Timing: Qualified 2020 miss; unjudgeable sensitivity if near-deadline category/methods are insufficient.
Scope: CivicScience’s AR sample, weighting and field dates are unspecified; its VR numbers must not be transferred. US-oriented, broad-category evidence supports only qualified timing. CNIL: 2,128 online quota/weighted respondents; ownership answer is not a device census. France is not the world, and 2026 is not 2020. Google’s 2020 prototype and later named-user reporting support useful captions, not universal routine caption/translation use.
Shared evidence: One adoption target, strongly dependent on voice/assistive forecasts; no component votes.
Evidence confidence: Moderate for substantial adoption overstatement; lower for exact 2020 prevalence and timing than for the later French survey.
Current edition contribution · Ray Kurzweil
Graded credit: 25 / 100.
- Recency weight
- 10%
- Credit × weight endpoint products
- 2.5
- Last documented backing
- 1991-08-01 to 1991-08-31
- Timing deduction recorded
- 0 points
The aggregate score is the lower bound of the weighted mean; uncertain claim bounds are optimized jointly, not summed as if independent.
Preserved draft calculation (superseded)
Draft formula inputs
- Credit
- 25 / 100
- Recency weight
- 10%
- Weighted credit term
- 2.5
- Same-claim backing date
- 1991-08-01 to 1991-08-31
This state-at-time, annual trajectory or original-period market/adoption predicate already includes time in its meaning. There is no separate event-arrival penalty to add back; preserve the reviewed original credit and temporal scope.
Draft scoring input; the four archive grades stay separate. Weighted terms have shared uncertainty, so their bounds are not simply additive.
Date basis
No later same-claim public re-endorsement is established by the bounded archive review; retain the adopted original public issue interval as a conservative fallback, not as proof of last-ever public backing.
Exact calculation inputs
{
"scoring": {
"kind": "reviewed_credit",
"bounds": [
25,
25
]
},
"backingDateBounds": [
"1991-08-01",
"1991-08-31"
],
"timingCostBounds": [
0,
0
],
"calculated": {
"creditBounds": [
25,
25
],
"weightBounds": [
0.1,
0.1
],
"normalizedBackingDateBounds": [
"1991-08-01",
"1991-08-31"
],
"timingCostBounds": [
0,
0
],
"deadlineWaiverCreditBounds": [
25,
25
],
"aggregationDisposition": "one admitted claim; uncertainty retained as interval"
}
}Rodney BrooksMay 1990 · rangeEveryday robots by 2000.
Sony described autonomous, adaptive AIBO entertainment robots and reported 5,000 sold in June 1999 and 10,000 in November 1999.
OutcomePartly rightDirectionRightMagnitudeNot quantifiedTimingWithin original window
5–6 May 1990; interview day unknown.
Original horizon: About a decade.
Further evidence: These are historical sales, not later ERS-210 delivery plans.
Direction: Observed consumer-market emergence.
Magnitude: No numerical penetration threshold; niche scale only.
Timing: Both decisive sales observations were in 1999.
Limits: Niche, costly entertainment robots do not establish widespread use or useful household service; broader fulfillment remains unresolved. Both releases are Sony’s account, not independent consumer-use evidence.
Evidence confidence: Moderate; vendor-reported capability and sales, with interpretation-sensitive breadth.
Draft formula inputs
Not in this 424-record calculation edition. No score assigned here.
Kai-Fu LeeSep 1989 · rangeSpeech-training data grows several orders within a decade, from 1989 to about 1999.
Google reported 142.3M human-transcribed ASR-training utterances in 2022, including 40M English; Alibaba reported 20M paired speech-training sentences in 2019.
OutcomePartly rightDirectionRightMagnitudePartly supportedTimingTiming unresolved
1989-09-27 to 1989-09-29
Further evidence: Google’s 2017 report counted 15M transcribed training utterances. These separate observations are not summed. Qualified eventual several-order growth under a practical training-instance comparison; exact grammatical-sentence matching remains unverified.
Direction: Actual ASR counts reinforce growth; corpora, translations, synthetic copies, text-only expansions and repeated epochs are not added.
Magnitude: 142.3M/4,200 = 33,881-fold (4.53 orders); /100,000 = 1,423-fold (3.15). English-only 40M/100,000 = 400-fold (2.60). The explicit 20M sentences give 4,762-fold versus 4,200, but 200-fold versus 100,000. The 100,000 denominator is conservative sensitivity, not a quoted baseline or a fixed definition of several.
Timing: About September 1999 deadline. Contemporary WSJ1/AT&T examples had 78,000/200,000 training utterances, not a comprehensive frontier census. Later publication does not establish first attainment: no on-time hit, definite miss or exact delay.
Scope: Sphinx used 4,200 sentences from 105 speakers; nearby near-future tens-of-thousands wording leaves the baseline uncertain. Speakers are not the denominator. Speaker-independent resources, not accuracy/HMM dominance or a product launch; multilingual/private training is allowed. The author’s own collection effort limits independence. Utterances are not certified grammatical sentences; corpus segmentation and recording-level deduplication remain unaudited. Google counts precede augmentation; Alibaba’s sentences are paired ASR training, not text-only correction expansions. Earlier evidence: GigaSpeech supplied 10,000 training hours; GigaST counted 7,815,436 reused-source speech segments, not added translation copies. Its filtering differs; this is not the original corpus’s exact sentence count. Raon’s 193.9M recorded/transcribed records support availability, not verified unique sentences or recognition suitability throughout. TTS use alone does not disqualify paired speech data. Current GigaSpeech metadata is mutable, not a fixed 2021 count anchor.
Evidence confidence: Moderate for qualified eventual several-order training-instance growth; exact grammatical-unit matching and original 1999 timing remain unresolved.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Eliezer YudkowskyDate unknownThe AI community would oppose restrictions on supercomputer use for AI research.
In October 2023, Bengio, Hinton, Russell and others advocated monitoring supercomputer use and licensing or pausing especially capable AI development.
OutcomeMostly wrongDirectionMostly wrongMagnitudeUnresolvedTimingNo fixed deadline
2008 chapter; revised reprint linked by Fall 2012; exact sentence first issuance unverified
Direction: Organized support contradicts community-wide hostility; this is not a majority estimate.
Magnitude: No representative opposition fraction or numerical strength established.
Timing: Undated long-run governance forecast; no timing credit.
Scope: Qualified miss for the community-response component, allowing idiomatic rather than literal unanimity. Political feasibility and effectiveness remain unresolved. No blanket-ban condition invented. The revised reprint was linked by Fall 2012; this does not establish unchanged 2008 wording or exact sentence issuance. One target, not one vote per endorser.
Evidence confidence: Moderate: direct primary endorsement matches the regulatory object; original exact sentence vintage and idiomatic breadth remain uncertain.
Draft formula inputs
Not in this 424-record calculation edition. No score assigned here.
Ray KurzweilDate unknownSequoia would provide 20 petaflops in 2011, revising an acknowledged 2009 schedule.
June 2012: 20.13266 PF theoretical peak versus 16.32475 PF Linpack; June 2013: 17.17 PF Linpack.
OutcomePartly rightDirectionRightMagnitudePartly supportedTimingLate realization
23 February 2011 hosted excerpt; original publication/utterance date unverified.
Further evidence: April 2012 testimony places rack installation in January–April 2012; another operator account says first delivered in 2011. Qualified eventual peak attainment; sustained 20 PF remains unsupported.
Direction: Large-system arithmetic capacity increased, not demonstrated intelligence.
Magnitude: Close peak match; Linpack remained below 20 PF.
Timing: Late for assembled operational capacity; 2011 partial-delivery reading remains alternative. No exact first-crossing date or elapsed delay.
Scope: The public 2009 contract already specified 20 PF, 2011 delivery and 2012 deployment: low novelty. Peak is not sustained throughput or intelligence. Brain emulation and $1,000/MIPS forecasts remain unresolved. Earlier 2009 issuance is unverified; its acknowledged miss is not erased.
Shared evidence: One dependent 2009/2010/2011 capacity lineage; operator accounts are not independent replication.
Evidence confidence: Moderate for qualified capacity attainment and operational lateness; lower for exact original metric and delivery-versus-capacity semantics.
Draft formula inputs
No draft score: out of scope. No vote, not zero.
Stuart RussellDate unknownControl and safety will become central to AI as the field matures.
Inspect was released in 2024; a multinational technical safety report followed in 2025. Whole outcome unresolved.
OutcomeUnresolvedDirectionPartly rightMagnitudePartly supportedTimingNo fixed deadline
No later than June 2016
Further evidence: These are substantive institutional developments, not proof of field-wide centrality. The evidence establishes substantive technical institutions and research activity beyond the original specialist baseline. It does not establish that control and safety are now central across the entire AI field in the strong sense suggested by the analogy. The maturation condition has no agreed endpoint, so present limits do not establish a final miss.
Direction: A publicly released government-built evaluation platform and a multinational technical synthesis document institutional integration, not just press attention. This supports movement toward the predicted priority without completing the full claim.
Magnitude: Local organizational breadth and a larger research volume are supported. Research-topic shares, scope mismatches and the lack of a field-wide resource denominator prevent a full centrality judgment.
Timing: No fixed deadline exists. Dated developments are progress by the cutoff, not a fulfilled timing contract.
Scope: Maturation and full centrality remain unresolved. Safety effectiveness is not research prominence; Russell participated in field-building and the international report. Original issuance is only bounded by June 2016. Anthropic reports implemented deployment/security protections with Opus 4 in May 2025; precautionary activation did not confirm the capability threshold. OpenAI reports completed Safety Advisory Group review of o3/o4-mini at April 2025 release; no demonstrated veto or delay is inferred. Google’s August 2025 Deep Think card describes development evaluations, council release decisions, completed prelaunch safety-case review and deployed mitigations, including loss-of-control concerns. Some external testing remained ongoing; evaluations used a slightly different preliminary implementation. The contemporaneous launch announcement links that card, not independent replication. METR independently confirms evaluation of earlier o3/o4-mini checkpoints during three weeks of prerelease access, with limited information and no internal-reasoning access. It says predeployment capability tests alone are insufficient; this does not show results controlled deployment. These are bounded integration observations, chiefly developer-reported and not independently audited for effectiveness. A selected three-developer sample does not establish field-wide centrality, solved alignment or universally safety-led development.
Evidence confidence: Moderate for institutional direction and conservative issuance bound; low for full field-wide centrality and fulfillment of maturation condition.
Draft formula inputs
No draft score: grade held / duplicate. No vote, not zero.
Excluded claims
Ajeya Cotra10 Oct 2023GPT-4.5 much better than GPT-4 on most understanding/reasoning/math/science tests, with greater economic value and risks.
The required forecast horizon is not established. Not a wrong-forecast verdict.
OutcomePartly rightDirectionNot separately gradedMagnitudeNot quantifiedTimingNo fixed deadline
2023-10-10
The required forecast horizon is not established. Not a wrong-forecast verdict.
Draft formula inputs
No draft score: outside eligible archive. No vote, not zero.
Ajeya Cotra10 Oct 2023Extra answer-refinement effort improves performance; larger models benefit more.
The required forecast horizon is not established. Not a wrong-forecast verdict.
OutcomePartly rightDirectionNot separately gradedMagnitudeNot quantifiedTimingNo fixed deadline
2023-10-10
The required forecast horizon is not established. Not a wrong-forecast verdict.
Draft formula inputs
No draft score: outside eligible archive. No vote, not zero.
Gary Marcus10 Oct 2023AI will eventually have a major impact on drug design.
The required forecast horizon is not established. Not a wrong-forecast verdict.
OutcomeUnresolvedDirectionPartly rightMagnitudeExtent unresolvedTimingNo fixed deadline
2023-10-10
The required forecast horizon is not established. Not a wrong-forecast verdict.
Draft formula inputs
No draft score: outside eligible archive. No vote, not zero.
Noam Shazeer25 Sep 2023Multimodal voice, face and group interaction are possible improvements.
Near-term product scheduling is outside this archive’s scope.
OutcomePartly rightDirectionNot separately gradedMagnitudeNot quantifiedTimingTiming unresolved
2023-09-25
Near-term product scheduling is outside this archive’s scope.
Draft formula inputs
No draft score: outside eligible archive. No vote, not zero.
Yoshua Bengio7 Sep 2023AI-enabled electoral meddling could occur by the next U.S. election in2024.
Not retained as a forecast under this archive’s definition.
OutcomePartly rightDirectionRightMagnitudeUnresolvedTimingWithin original window
2023-09-07
Not retained as a forecast under this archive’s definition.
Draft formula inputs
No draft score: outside eligible archive. No vote, not zero.
Paul Christiano7 Sep 2023Broader independent model-evaluation access
The required forecast horizon is not established. Not a wrong-forecast verdict.
OutcomeRightDirectionNot separately gradedMagnitudeNot quantifiedTimingNo fixed deadline
2023-09-07
The required forecast horizon is not established. Not a wrong-forecast verdict.
Draft formula inputs
No draft score: outside eligible archive. No vote, not zero.
Gary Marcus14 Aug 2023LLMs will probably become cheaper to operate over time as hardware and efficiency improve.
The required forecast horizon is not established. Not a wrong-forecast verdict.
OutcomePartly rightDirectionRightMagnitudeNot quantifiedTimingNo fixed deadline
2023-08-14
The required forecast horizon is not established. Not a wrong-forecast verdict.
Draft formula inputs
No draft score: outside eligible archive. No vote, not zero.
Noam ShazeerAug–Sep 2023 · rangeExpects substantial further language-model gains from scaling without requiring a new fundamental breakthrough.
The required forecast horizon is not established. Not a wrong-forecast verdict.
OutcomePartly rightDirectionRightMagnitudeUnresolvedTimingNo fixed deadline
2023-09-25 (published; recorded August 2023, day unknown)
The required forecast horizon is not established. Not a wrong-forecast verdict.
Draft formula inputs
No draft score: outside eligible archive. No vote, not zero.
Demis Hassabis26 Jun 2023Gemini expected morecapable than GPT4-backedChatGPT; development takesmonths.
Near-term product scheduling is outside this archive’s scope.
OutcomeMixedDirectionNot separately gradedMagnitudeMixed scale evidenceTimingTiming unresolved
2023-06-26
Near-term product scheduling is outside this archive’s scope.
Draft formula inputs
No draft score: outside eligible archive. No vote, not zero.
Jürgen Schmidhuber14 Apr 2023The recent pause letter will have little significant effect because many researchers, companies and governments will ignore it.
The required forecast horizon is not established. Not a wrong-forecast verdict.
OutcomePartly rightDirectionNot separately gradedMagnitudeActor count and total policy impact unresolvedTimingNo fixed deadline
2023-04-14
The required forecast horizon is not established. Not a wrong-forecast verdict.
Draft formula inputs
No draft score: outside eligible archive. No vote, not zero.
Ilya Sutskever27 Mar 2023Specialized training improves multistep reasoning.
The required forecast horizon is not established. Not a wrong-forecast verdict.
OutcomeRightDirectionNot separately gradedMagnitudeNot quantifiedTimingNo fixed deadline
2023-03-27
The required forecast horizon is not established. Not a wrong-forecast verdict.
Draft formula inputs
No draft score: outside eligible archive. No vote, not zero.
Gary Marcus25 Dec 2022Broadly capable copies will eventually escape the original provider’s guardrails.
The required forecast horizon is not established. Not a wrong-forecast verdict.
OutcomePartly rightDirectionRightMagnitudePartly demonstratedTimingNo fixed deadline
2022-12-25
The required forecast horizon is not established. Not a wrong-forecast verdict.
Draft formula inputs
No draft score: outside eligible archive. No vote, not zero.
Sam Altman6 Apr 2022Expects natural-language computer interfaces eventually to perform complex tasks beyond then-current code and image generation.
The required forecast horizon is not established. Not a wrong-forecast verdict.
OutcomePartly rightDirectionRightMagnitudeNot quantifiedTimingNo fixed deadline
2022-04-06T18:15:13Z
The required forecast horizon is not established. Not a wrong-forecast verdict.
Draft formula inputs
No draft score: outside eligible archive. No vote, not zero.
Elon Musk19 Aug 2021A Tesla humanoid robot prototype during2022.
Near-term product scheduling is outside this archive’s scope.
OutcomeRightDirectionNot separately gradedMagnitudeNot separately gradedTimingWithin original window
2021-08-19
Near-term product scheduling is outside this archive’s scope.
Draft formula inputs
No draft score: outside eligible archive. No vote, not zero.
Elon Musk19 Aug 2021Existing HW3 can support the promised autonomous safety capability.
The required forecast horizon is not established. Not a wrong-forecast verdict.
OutcomeMostly wrongDirectionMostly wrongMagnitudeUnresolvedTimingNo fixed deadline
2021-08-19
The required forecast horizon is not established. Not a wrong-forecast verdict.
Draft formula inputs
No draft score: outside eligible archive. No vote, not zero.
Ajeya Cotra2021 · uncertainHarder benchmarks follow saturation.
The required forecast horizon is not established. Not a wrong-forecast verdict.
OutcomeRightDirectionNot separately gradedMagnitudeNot quantifiedTimingNo fixed deadline
Early 2021 discussion; exact comment date unverified.
The required forecast horizon is not established. Not a wrong-forecast verdict.
Draft formula inputs
No draft score: outside eligible archive. No vote, not zero.
Elon Musk28 Feb 2020Drone warfare and autonomous aviation will become central as crewed fighters lose relative importance.
The required forecast horizon is not established. Not a wrong-forecast verdict.
OutcomeUnresolvedDirectionPartly rightMagnitudeUnresolvedTimingNo fixed deadline
2020-02-28
The required forecast horizon is not established. Not a wrong-forecast verdict.
Draft formula inputs
No draft score: outside eligible archive. No vote, not zero.
Elon Musk12 Nov 2019AI will convincingly imitate human conversation, including phone/video-like interaction.
The required forecast horizon is not established. Not a wrong-forecast verdict.
OutcomePartly rightDirectionRightMagnitudeUnresolvedTimingNo fixed deadline
2019-11-12
The required forecast horizon is not established. Not a wrong-forecast verdict.
Draft formula inputs
No draft score: outside eligible archive. No vote, not zero.
Elon Musk29 Aug 2019AI eventually writes its own software.
The required forecast horizon is not established. Not a wrong-forecast verdict.
OutcomeUnresolvedDirectionPartly rightMagnitudeNot quantifiedTimingNo fixed deadline
2019-08-29
The required forecast horizon is not established. Not a wrong-forecast verdict.
Draft formula inputs
No draft score: outside eligible archive. No vote, not zero.
Elon Musk22 Apr 2019Autonomy competitors using lidar will abandon it.
The required forecast horizon is not established. Not a wrong-forecast verdict.
OutcomeUnresolvedDirectionMixedMagnitudeUnresolvedTimingNo fixed deadline
2019-04-22
The required forecast horizon is not established. Not a wrong-forecast verdict.
Draft formula inputs
No draft score: outside eligible archive. No vote, not zero.
Elon Musk12 Apr 2019AI will be capable of convincingly eliciting human romantic attachment.
The required forecast horizon is not established. Not a wrong-forecast verdict.
OutcomePartly rightDirectionRightMagnitudeEffectiveness unresolvedTimingNo fixed deadline
2019-04-12 publication
The required forecast horizon is not established. Not a wrong-forecast verdict.
Draft formula inputs
No draft score: outside eligible archive. No vote, not zero.
Nick BostromNov 2018 · rangeML will increasingly affect labor markets over time, but large-scale deployment takes time; full unemployment is only a conditional ultimate goal.
The required forecast horizon is not established. Not a wrong-forecast verdict.
OutcomeUnresolvedDirectionPartly rightMagnitudeUnresolvedTimingNo fixed deadline
2018-11
The required forecast horizon is not established. Not a wrong-forecast verdict.
Draft formula inputs
No draft score: outside eligible archive. No vote, not zero.
Elon Musk7 Sep 2018Human weaponization becomes a danger during the transition to advanced AI.
The required forecast horizon is not established. Not a wrong-forecast verdict.
OutcomeUnresolvedDirectionPartly rightMagnitudeUnresolvedTimingNo fixed deadline
2018-09-07
The required forecast horizon is not established. Not a wrong-forecast verdict.
Draft formula inputs
No draft score: outside eligible archive. No vote, not zero.
Sam Altman25 Jun 2018Expects scaled deep reinforcement learning to become a substantial machine-learning branch and contribute toward general intelligence.
The required forecast horizon is not established. Not a wrong-forecast verdict.
OutcomePartly rightDirectionRightMagnitudeUnresolvedTimingNo fixed deadline
2018-06-25 (author Atom publication timestamp; forecast wording independently quoted 2018-06-30)
The required forecast horizon is not established. Not a wrong-forecast verdict.
Draft formula inputs
No draft score: outside eligible archive. No vote, not zero.
François Chollet28 Mar 2018The warning specifically anticipates generated persuasive material tailored to an individual; broader population control is a separate, much stronger outcome.
Not retained as a forecast under this archive’s definition.
OutcomePartly rightDirectionNot separately gradedMagnitudeUnresolvedTimingNo fixed deadline
2018-03-28
Not retained as a forecast under this archive’s definition.
Draft formula inputs
No draft score: outside eligible archive. No vote, not zero.
Gary Marcus2 Jan 2018Deep learning is unlikely to disappear.
The required forecast horizon is not established. Not a wrong-forecast verdict.
OutcomeRightDirectionRightMagnitudeNot quantifiedTimingNo fixed deadline
2018-01-02
The required forecast horizon is not established. Not a wrong-forecast verdict.
Draft formula inputs
No draft score: outside eligible archive. No vote, not zero.
Yann LeCun2018 · uncertainAI’s established commercial base makes another old-style AI winter unlikely.
The required forecast horizon is not established. Not a wrong-forecast verdict.
OutcomeUnresolvedDirectionPartly rightMagnitudeNot quantifiedTimingNo fixed deadline
2018
The required forecast horizon is not established. Not a wrong-forecast verdict.
Draft formula inputs
No draft score: outside eligible archive. No vote, not zero.
Andrej Karpathy11 Nov 2017Expects AlphaGo-like results in Dota 2 and StarCraft.
The required forecast horizon is not established. Not a wrong-forecast verdict.
OutcomePartly rightDirectionNot separately gradedMagnitudeNot quantifiedTimingNo fixed deadline
2017-11-11
The required forecast horizon is not established. Not a wrong-forecast verdict.
Draft formula inputs
No draft score: outside eligible archive. No vote, not zero.
Elon MuskJul 2017 · rangeAI will cause substantial job disruption.
The required forecast horizon is not established. Not a wrong-forecast verdict.
OutcomePartly rightDirectionRightMagnitudeUnresolvedTimingNo fixed deadline
July 2017; exact-day reporting discrepancy
The required forecast horizon is not established. Not a wrong-forecast verdict.
Draft formula inputs
No draft score: outside eligible archive. No vote, not zero.
Elon Musk28 Apr 2017Expected a coast-to-coast parking-lot demonstration without controls touched in November or December 2017.
Near-term product scheduling is outside this archive’s scope.
OutcomeUnresolvedDirectionNot separately gradedMagnitudeNot separately gradedTimingOriginal deadline missed
2017-04-28
Near-term product scheduling is outside this archive’s scope.
Draft formula inputs
No draft score: outside eligible archive. No vote, not zero.
Demis Hassabis3 Jan 2017Plan to put WaveNet into Google production.
Near-term product scheduling is outside this archive’s scope.
OutcomeRightDirectionNot separately gradedMagnitudeNot quantifiedTimingNo fixed deadline
2017-01-03
Near-term product scheduling is outside this archive’s scope.
Draft formula inputs
No draft score: outside eligible archive. No vote, not zero.
Jürgen Schmidhuber23 Nov 2016Google’s applications eventually consolidate into one large LSTM.
The required forecast horizon is not established. Not a wrong-forecast verdict.
OutcomeUnresolvedDirectionWrongMagnitudeUnresolvedTimingNo fixed deadline
2016-11-23
The required forecast horizon is not established. Not a wrong-forecast verdict.
Draft formula inputs
No draft score: outside eligible archive. No vote, not zero.
Andrew Ng28 Jun 2016Mass production in five years.
Near-term product scheduling is outside this archive’s scope.
OutcomePartly rightDirectionNot separately gradedMagnitudeUnresolvedTimingWithin original window
2016-06-28
Near-term product scheduling is outside this archive’s scope.
Draft formula inputs
No draft score: outside eligible archive. No vote, not zero.
Andrej Karpathy16 Jun 2016Joint-authored prospects for realistic generated imagery and visual editing.
The required forecast horizon is not established. Not a wrong-forecast verdict.
OutcomeRightDirectionNot separately gradedMagnitudeNot quantifiedTimingNo fixed deadline
2016-06-16
The required forecast horizon is not established. Not a wrong-forecast verdict.
Draft formula inputs
No draft score: outside eligible archive. No vote, not zero.
Ilya Sutskever16 Jun 2016Joint-authored prospects for realistic generated imagery and visual editing.
The required forecast horizon is not established. Not a wrong-forecast verdict.
OutcomeRightDirectionNot separately gradedMagnitudeNot quantifiedTimingNo fixed deadline
2016-06-16
The required forecast horizon is not established. Not a wrong-forecast verdict.
Draft formula inputs
No draft score: outside eligible archive. No vote, not zero.
Andrej Karpathy31 May 2016Eventually a computer should interpret game pixels and reason about useful object-directed action, illustrated by acquiring a key before a door.
The required forecast horizon is not established. Not a wrong-forecast verdict.
OutcomePartly rightDirectionRightMagnitudeUnresolvedTimingNo fixed deadline
2016-05-31
The required forecast horizon is not established. Not a wrong-forecast verdict.
Draft formula inputs
No draft score: outside eligible archive. No vote, not zero.
Andrew Ng15 Mar 2016In the longer-run transportation transition, computer-driven cars become substantially safer than human-driven cars.
The required forecast horizon is not established. Not a wrong-forecast verdict.
OutcomeUnresolvedDirectionRightMagnitudeUnresolvedTimingNo fixed deadline
2016-03-15
The required forecast horizon is not established. Not a wrong-forecast verdict.
Draft formula inputs
No draft score: outside eligible archive. No vote, not zero.
Jensen Huang12 Jan 2016Expects GPU-accelerated deep learning to underpin a major new computing platform and spreading AI applications.
The required forecast horizon is not established. Not a wrong-forecast verdict.
OutcomePartly rightDirectionRightMagnitudeUnresolvedTimingNo fixed deadline
2016-01-12
The required forecast horizon is not established. Not a wrong-forecast verdict.
Draft formula inputs
No draft score: outside eligible archive. No vote, not zero.
Yoshua Bengio27 May 2015Combining learned representations with complex reasoning will drive AI progress.
The required forecast horizon is not established. Not a wrong-forecast verdict.
OutcomeUnresolvedDirectionRightMagnitudeUnresolvedTimingNo fixed deadline
2015-05-27
The required forecast horizon is not established. Not a wrong-forecast verdict.
Draft formula inputs
No draft score: outside eligible archive. No vote, not zero.
Geoffrey Hinton27 May 2015Combining learned representations with complex reasoning will drive AI progress.
The required forecast horizon is not established. Not a wrong-forecast verdict.
OutcomeUnresolvedDirectionRightMagnitudeUnresolvedTimingNo fixed deadline
2015-05-27
The required forecast horizon is not established. Not a wrong-forecast verdict.
Draft formula inputs
No draft score: outside eligible archive. No vote, not zero.
Yann LeCun27 May 2015Combining learned representations with complex reasoning will drive AI progress.
The required forecast horizon is not established. Not a wrong-forecast verdict.
OutcomeUnresolvedDirectionRightMagnitudeUnresolvedTimingNo fixed deadline
2015-05-27
The required forecast horizon is not established. Not a wrong-forecast verdict.
Draft formula inputs
No draft score: outside eligible archive. No vote, not zero.
Andrej Karpathy21 May 2015Expects continued RNN innovation and RNNs becoming pervasive, important components of intelligent systems.
The required forecast horizon is not established. Not a wrong-forecast verdict.
OutcomePartly rightDirectionRightMagnitudeUnresolvedTimingNo fixed deadline
2015-05-21
The required forecast horizon is not established. Not a wrong-forecast verdict.
Draft formula inputs
No draft score: outside eligible archive. No vote, not zero.
Stuart Russell21 Apr 2015An industry will develop around giving intelligent systems human-compatible values.
The required forecast horizon is not established. Not a wrong-forecast verdict.
OutcomePartly rightDirectionRightMagnitudeNot quantifiedTimingNo fixed deadline
2015-04-21
The required forecast horizon is not established. Not a wrong-forecast verdict.
Draft formula inputs
No draft score: outside eligible archive. No vote, not zero.
Yann LeCun2015 · uncertainIndustrial unsupervised learning
The required forecast horizon is not established. Not a wrong-forecast verdict.
OutcomeRightDirectionNot separately gradedMagnitudeNot quantifiedTimingNo fixed deadline
2015; exact original day pending authentication
The required forecast horizon is not established. Not a wrong-forecast verdict.
Draft formula inputs
No draft score: outside eligible archive. No vote, not zero.
Yann LeCun2015 · uncertainDialogue and knowledge answers
The required forecast horizon is not established. Not a wrong-forecast verdict.
OutcomeRightDirectionNot separately gradedMagnitudeNot quantifiedTimingNo fixed deadline
2015; exact original day pending authentication
The required forecast horizon is not established. Not a wrong-forecast verdict.
Draft formula inputs
No draft score: outside eligible archive. No vote, not zero.
Yann LeCun2015 · uncertainTranslation improvement
The required forecast horizon is not established. Not a wrong-forecast verdict.
OutcomeRightDirectionNot separately gradedMagnitudeNot quantifiedTimingNo fixed deadline
2015; exact original day pending authentication
The required forecast horizon is not established. Not a wrong-forecast verdict.
Draft formula inputs
No draft score: outside eligible archive. No vote, not zero.
Yann LeCun2015 · uncertainDriverless capability
The required forecast horizon is not established. Not a wrong-forecast verdict.
OutcomeRightDirectionNot separately gradedMagnitudeNot quantifiedTimingNo fixed deadline
2015; exact original day pending authentication
The required forecast horizon is not established. Not a wrong-forecast verdict.
Draft formula inputs
No draft score: outside eligible archive. No vote, not zero.
Gary Marcus16 Jan 2013Expects a major future search advance to integrate unstructured information across pages.
The required forecast horizon is not established. Not a wrong-forecast verdict.
OutcomeRightDirectionRightMagnitudeNot quantifiedTimingNo fixed deadline
2013-01-16
The required forecast horizon is not established. Not a wrong-forecast verdict.
Draft formula inputs
No draft score: outside eligible archive. No vote, not zero.
Ilya Sutskever2012 · uncertainExpects unsupervised pretraining to improve vision networks, especially when future compute enables larger networks without proportionately more labeled data.
The required forecast horizon is not established. Not a wrong-forecast verdict.
OutcomeRightDirectionRightMagnitudeNot quantifiedTimingNo fixed deadline
2012 (NeurIPS proceedings; precise first-publication day not established)
The required forecast horizon is not established. Not a wrong-forecast verdict.
Draft formula inputs
No draft score: outside eligible archive. No vote, not zero.
Andrej Karpathy27 Apr 2011Tentatively expects 85–90% CIFAR-10 accuracy, conditional on training-data sufficiency.
The required forecast horizon is not established. Not a wrong-forecast verdict.
OutcomeMostly wrongDirectionNot separately gradedMagnitudeUnderestimatedTimingNo fixed deadline
2011-04-27T15:00:00-07:00
The required forecast horizon is not established. Not a wrong-forecast verdict.
Draft formula inputs
No draft score: outside eligible archive. No vote, not zero.
Ben GoertzelJul 2000 · rangeCompleted integrated Webmind launches mid-2001.
Near-term product scheduling is outside this archive’s scope.
OutcomeUnresolvedDirectionNot separately gradedMagnitudeUseful components do not establish completed integrated productTimingDocumented delivery slippage; exact realization unverified
2000-07
Near-term product scheduling is outside this archive’s scope.
Draft formula inputs
No draft score: outside eligible archive. No vote, not zero.
Ben GoertzelJul 2000 · rangeA supercompiler expected around 2001 would soon combine with Webmind for continual source-code self-improvement.
Near-term product scheduling is outside this archive’s scope.
OutcomeMostly wrongDirectionUnresolvedMagnitudeOverestimated at deadlineTimingOriginal deadline missed
2000-07
Near-term product scheduling is outside this archive’s scope.
Draft formula inputs
No draft score: outside eligible archive. No vote, not zero.
Pending reviews
Gary Marcus13 Aug 2023Coders and undergraduates will keep using generative AI; budget-constrained students likely turn to open-source alternatives.
Eligibility is under review. Historical labels are not an eligible-archive vote.
OutcomeMixedDirectionMixedMagnitudeNot quantifiedTimingNo fixed deadline
2023-08-13
Eligibility is under review. Historical labels are not an eligible-archive vote.
Draft formula inputs
No draft score: outside eligible archive. No vote, not zero.
Eliezer Yudkowsky25 Nov 2021Mostly expects AIs not to be permitted to weld on Earth.
Eligibility is under review. Historical labels are not an eligible-archive vote.
OutcomeUnresolvedDirectionMostly wrongMagnitudeUnresolvedTimingNo fixed deadline
2021-11-25
Eligibility is under review. Historical labels are not an eligible-archive vote.
Draft formula inputs
No draft score: outside eligible archive. No vote, not zero.
Gary Marcus3 Nov 2021GPT-based systems cannot adequately guard their own outputs against harmful errors; a different kind of system will be needed.
Eligibility is under review. Historical labels are not an eligible-archive vote.
OutcomeMostly wrongDirectionMostly wrongMagnitudeOverstated inabilityTimingNo fixed deadline
2021-11-03 publication; recording date unknown
Eligibility is under review. Historical labels are not an eligible-archive vote.
Draft formula inputs
No draft score: outside eligible archive. No vote, not zero.
Eliezer Yudkowsky15 Sep 2021Before AGI, physical-task AI including self-driving cars would remain legally blocked; this row assesses the broad vehicle component.
Eligibility is under review. Historical labels are not an eligible-archive vote.
OutcomeMostly wrongDirectionWrongMagnitudeOverstated restrictionTimingNot separately applicable
2021-09-15
Eligibility is under review. Historical labels are not an eligible-archive vote.
Draft formula inputs
No draft score: outside eligible archive. No vote, not zero.
Gary Marcus29 Oct 2018Language-comprehension models will make little progress without innate compositional rule and structure tools.
Eligibility is under review. Historical labels are not an eligible-archive vote.
OutcomeMostly wrongDirectionMostly wrongMagnitudeOverstated necessity (tested domains)TimingNo fixed deadline
2018-10-29
Eligibility is under review. Historical labels are not an eligible-archive vote.
Draft formula inputs
No draft score: outside eligible archive. No vote, not zero.
Geoffrey Hinton2012 · uncertainExpects unsupervised pretraining to improve vision networks, especially when future compute enables larger networks without proportionately more labeled data.
Eligibility is under review. Historical labels are not an eligible-archive vote.
OutcomeRightDirectionRightMagnitudeNot quantifiedTimingNo fixed deadline
2012 (NeurIPS proceedings; precise first-publication day not established)
Eligibility is under review. Historical labels are not an eligible-archive vote.
Draft formula inputs
No draft score: outside eligible archive. No vote, not zero.
No matches in this view.