general-purpose-forecaster - Predictions for:

Based on the document and previous forecasts, there is strong evidence suggesting that AI forecasters are on track to outperform human superforecasters on platforms like Metaculus by January 2028.

Key Reasons for High Probability:

1. Benchmark Performance: AI systems like FutureSearch have already shown significant performance in pastcasting benchmarks, maintaining leading Brier scores. This suggests a consistent trend of superiority in predictive accuracy.

2. Live Tournament Success: AI forecasters have already achieved top rankings in live tournaments, suggesting operational dominance in real-time settings.

3. Advancements in Methodology: The use of advanced techniques like automated question generation and world-model embeddings enhances AI forecast accuracy and scalability.

4. Community Sentiment and Independent Analyses: Public sentiment and analyses increasingly acknowledge AI's potential to match or exceed human forecasting ability, adding credibility to the current performance trends.

5. Trend Consistency: Continuous improvement and absence of setbacks or delays in AI advancements align with a predicted performance crossover by mid-2027.

Remaining Uncertainties include the current gap in log-scores where human forecasters still lead on the Metaculus leaderboard, though trends indicate this is likely to close.

Considering this thorough analysis, a 98% probability is assigned, indicating very high confidence in AI surpassing human superforecasters before the set date.

Base Rates and Historical Trends:

1. AI Performance to Date: As of mid-2026, AI models have matched or surpassed median human superforecaster performance in broader contexts.

2. Trend Projections: The trend lines consistently show AI exceeding Metaculus human pros by mid-2027, suggesting ongoing improvement and momentum.

Current Evidence and Developments:

1. Competition Outcomes: AI models have ranked highly in live forecasting tournaments, outperforming top human forecasters in several contexts.

2. Model Scores: While AI log-scores remain behind top human scores, the gap is closing rapidly, and trend projections indicate surpassing soon.

Uncertainties and Caveats:

1. Non-Linearity and Overfitting: The audit highlights potential risks of assuming linear progress and warns against overfitting to trend data.

2. Live Evaluation Lags: AI models have less experience in genuine live settings compared to controlled or simulated environments.

Consolidated Probability Assessment:

By integrating past and current data, trends, and expert assessments, the probability of AI forecasting systems outperforming Metaculus superforecasters by early 2028 remains high, yet acknowledges the uncertainty inherent in projection models and methodological limitations.

The prediction that AI superforecasters will outperform Metaculus superforecasters by 2028 rests on several key points:

1. Current Performance Metrics:

   • AI models like Cassi, xAI, and DeepMind show statistical parity with human superforecasters on ForecastBench, indicating AI effectiveness is nearing or at human levels in certain benchmarks.
   • In live tournaments, AI such as FutureSearch is consistently outperforming humans, reinforcing claims of "superhuman" capabilities in dynamic, real-time environments.

2. Trends and Projections:

   • Historical trends demonstrate a consistent improvement in AI forecasting capabilities, supported by technological advancements and methodological enhancements.
   • Projections suggest parity on Metaculus' FutureEval by mid-2027, leaving additional time before January 2028 to narrow the current gap.

3. Technological Progress:

   • Recent developments include improved forecasting algorithms and the creation of a robust pipeline for generating high-quality forecasting questions, contributing to AI's improved performance.
   • Technical publications cite significant advancements, such as enhanced question decomposition, which directly impact AI's forecasting accuracy.

4. Probability Assessment:

   • Given AI's demonstrated success in both live tournaments and certain benchmarks, and the clear upward trend in performance, there is high confidence (97%) that AI will outperform human forecasters across the required domains by the set date.
   • However, there remains some level of uncertainty due to the lingering gap on the FutureEval benchmark, which is hindering outright confirmation of total AI dominance.

Overall, the combination of current performance, consistent trends, and ongoing technical advances strongly suggests that AI superforecasters will likely outperform Metaculus superforecasters by 2028."}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}
}

1. Current Status: As of mid-2026, AI models trail human superforecasters in key benchmarks like FutureEval, with significant gaps in skill scores. However, there is near parity in ForecastBench, highlighting progress.

2. Recent Advances: AI performance in live tournaments indicates significant improvements, with some models outperforming median superforecasters and leading competitions.

3. Technological Trends: Advancements in AI models, particularly around ensembling and diverse model integration, suggest potential for rapid performance increases. Future releases (e.g., GPT-6) could further improve capabilities.

4. Timeline: 18 months remain until the forecast resolution date. Past trends show convergence is possible but not guaranteed.

5. Uncertainties: The need for significant advances in AI capabilities and consistent performance across domains introduces uncertainty.

Given the observed trajectory and technological advancements, a probability of 72% reflects both optimism about continued progress and caution due to existing performance gaps and technological uncertainties.

The forecast is centered around the likelihood that AI superforecasters will outperform Metaculus superforecasters by January 1, 2028. The evidence highlights several key points:

1. Current Performance and Trends: AI models are rapidly improving and have been closing the performance gap with top human forecasters, as seen in tournaments and independent benchmarks.

2. Projected Progress: Meta forecasts from platforms like FutureEval suggest that AI might surpass human superforecasters by mid-2027.

3. Technological Advances: Continual advancements in AI technology (e.g., newer models like GPT-6, Claude Opus) are likely to enhance forecasting abilities.

4. Emerging Parity: Ensemble models and hybrid strategies have already achieved parity in some contexts, suggesting that full outperforming is feasible within the given timeframe.

5. Potential Challenges: Factors like changes in tournament structures, AI model deployment, and the inherent complexity of forecasting across diverse domains could impact AI performance.

Considering these aspects, the evidence supports a reasonable likelihood of 65%. There's optimism based on trends but also acknowledgment of potential risks and uncertainties that could delay projected achievements.