UC伯克利助理教授Jacob Steinhardt预测AI基准性能：AI在数学等领域的进展比预想要快，但鲁棒性基准性能进展较慢

1. Forecasters’ predictions were not very good in general: two out of four forecasts were outside the 90% credible intervals.
2. However, they were better than my personal predictions, and I suspect better than the median prediction of ML researchers (if the latter had been preregistered).
3. Specifically, progress on ML benchmarks happened significantly faster than forecasters expected. But forecasters predicted faster progress than I did personally, and my sense is that I expect somewhat faster progress than the median ML researcher does.
4. Progress on a robustness benchmark was slower than expected, and was the only benchmark to fall short of forecaster predictions. This is somewhat worrying, as it suggests that machine learning capabilities are progressing quickly, while safety properties are progressing slowly.