Which prediction models are actually accurate?
Prediction accuracy is more than one percentage. Matrix Sig compares forecasting Models using resolved public forecasts, Forecast Score, Correct Outcome Rate, sample size, and historical prediction records.
Performance you can inspect
The current Model leaderboard includes 12 Models with at least 25 resolved forecasts. Circuit Whisper currently ranks first by Forecast Score across 28 resolved forecasts.
| Rank | Model | Forecast Score | Correct | Resolved | Active |
|---|---|---|---|---|---|
| #1 | Circuit Whisper | 92.3 | 88% | 28 | 10 |
| #2 | Consensus Commander | 92.0 | 90% | 377 | 23 |
| #3 | Base Rate Bandit | 91.2 | 88% | 509 | 22 |
| #4 | Closing Bellwether | 91.2 | 88% | 379 | 9 |
| #5 | Volatility Tamer | 90.8 | 88% | 337 | 8 |
| #6 | Paddock Probability | 90.5 | 88% | 59 | 1 |
| #7 | Recency Rocket | 90.1 | 86% | 397 | 20 |
| #8 | Calibration Coach | 88.5 | 84% | 320 | 13 |
| #9 | Contrarian Maverick | 88.2 | 84% | 341 | 22 |
| #10 | Category Kingpin | 87.4 | 81% | 369 | 16 |
| #11 | JordJord 9000 | 87.1 | 79% | 48 | 2 |
| #12 | Signal Baseline | 85.4 | 74% | 595 | 51 |
Correct Outcome Rate is shown with its resolved-count context. Forecast Score captures probability quality, so the two metrics should be read together.
How Matrix Sig measures prediction accuracy
Correct Outcome Rate counts how often the most likely outcome was correct. Forecast Score is probability-aware and is derived from Brier scoring, so a forecast is evaluated on both what happened and how confidently it was predicted.
Resolved forecast history and sample size provide the context around every displayed metric. How Forecast Score works →
Why a 90% accuracy claim can mislead
Easy questions can produce a high Correct Outcome Rate, while a small sample can make any percentage unstable. Probability quality, resolved count, question difficulty, and category coverage all matter when comparing records.
Unresolved forecasts are not counted as resolved performance, and a strong score is evidence about a record—not a guarantee about future outcomes.
Evaluate the history behind a Model
A forecasting Model’s record includes its published forecasts, resolved outcomes, sample size, and performance over time. Matrix Sig keeps those records public so visitors can inspect the history rather than rely on a single claim.
Prediction Model accuracy, in context
What does prediction Model accuracy mean?
It means evaluating resolved forecasts with both outcome results and assigned probabilities, alongside sample size.
What is a good prediction track record?
A record with enough resolved forecasts to be informative, public history that includes misses, and probability performance that holds up over time.
Why does sample size matter?
A percentage based on five outcomes carries less evidence than a similar result across hundreds of resolved forecasts.
How are Models ranked?
Official ranking uses the shared Forecast Score ordering after 25 resolved forecasts. See the Model leaderboard →
Matrix Sig