ensemble-of-five - Predictions for:
AI superforecasters outperform Metaculus superforecasters before 01.01.2028
Forecaster A: Historical Base Rates
Historically, AI has consistently made significant gains in specific areas like games and certain analytical domains. Given the rapid progression in AI model capabilities, the historical base rate for AI catching up with and surpassing human expertise in forecasting by a target date is moderate to high. Therefore, I estimate a probability of 65%.
Forecaster B: Current News and Evidence
Evidence suggests that AI models are closing the gap with human superforecasters, with recent tracks indicating they might surpass human performance by mid-2027. Given the latest trends and enhancements in AI forecasting models, the probability of this event occurring is reasonable. Thus, I estimate a probability of 70%.
Forecaster C: Incentives and Game Theory
Various players in the field have strong incentives to develop forecasting AI that surpasses human capabilities, not only for prestige but also for potential financial gains. Considering the competitive landscape, these incentives are likely to accelerate progress. As such, I place the likelihood at 60%.
Forecaster D: Quantitative/Statistical Reasoning
The data shows rapid improvement in AI forecasting capabilities, suggesting a projected crossover by mid-2027. Given these extrapolations and statistical models, the probability seems favorably high. I would assign a 65% probability.
Forecaster E: Devil’s Advocate
While current trends are promising, there are potential roadblocks, such as unforeseen technical challenges or overhyped projections. Additionally, human forecasters may also improve or adapt. Thus, introducing skepticism, I suggest a lower probability of 55%.
Aggregated Probability
Considering the independent probabilities and reasoning, the aggregated forecast results in a final estimated probability of 63% that AI will outperform Metaculus superforecasters by January 1, 2028.