当前位置:网站首页>Jacob Steinhardt, assistant professor of UC Berkeley, predicts AI benchmark performance: AI has made faster progress in fields such as mathematics than expected, but the progress of robustness benchma
Jacob Steinhardt, assistant professor of UC Berkeley, predicts AI benchmark performance: AI has made faster progress in fields such as mathematics than expected, but the progress of robustness benchma
2022-07-07 02:06:00 【Zhiyuan community】
- Forecasters’ predictions were not very good in general: two out of four forecasts were outside the 90% credible intervals.
- However, they were better than my personal predictions, and I suspect better than the median prediction of ML researchers (if the latter had been preregistered).
- Specifically, progress on ML benchmarks happened significantly faster than forecasters expected. But forecasters predicted faster progress than I did personally, and my sense is that I expect somewhat faster progress than the median ML researcher does.
- Progress on a robustness benchmark was slower than expected, and was the only benchmark to fall short of forecaster predictions. This is somewhat worrying, as it suggests that machine learning capabilities are progressing quickly, while safety properties are progressing slowly.
边栏推荐
- ROS learning (XIX) robot slam function package cartographer
- Threadlocalutils (tool class IV)
- JVM memory model
- 3D激光SLAM:Livox激光雷达硬件时间同步
- 传感器:DS1302时钟芯片及驱动代码
- 【唯一】的“万字配图“ | 讲透【链式存储结构】是什么?
- The use of video in the wiper component causes full screen dislocation
- BigDecimal 的正确使用方式
- Shortcut keys commonly used in idea
- Time synchronization of livox lidar hardware -- PPS method
猜你喜欢
Flir Blackfly S工业相机:颜色校正讲解及配置与代码设置方法
ROS learning (26) dynamic parameter configuration
张平安:加快云上数字创新,共建产业智慧生态
百度飞将BMN时序动作定位框架 | 数据准备与训练指南 (上)
MySQL execution process and sequence
FLIR blackfly s industrial camera: synchronous shooting of multiple cameras through external trigger
Flir Blackfly S 工业相机:配置多个摄像头进行同步拍摄
Shell script quickly counts the number of lines of project code
The cradle of eternity
Recognition of C language array
随机推荐
Can't you understand the code of linked list in C language? An article allows you to grasp the secondary pointer and deeply understand the various forms of parameter passing in the function parameter
LeetCode. Sword finger offer 62 The last remaining number in the circle
The GPG keys listed for the "MySQL 8.0 community server" repository are already ins
Batch delete data in SQL - set in entity
Vingt - trois mille feuilles? "Yang mou" derrière l'explosion de la consommation végétale
Flir Blackfly S USB3 工业相机:计数器和定时器的使用方法
Treadpoolconfig thread pool configuration in real projects
The cradle of eternity
Reptile practice (VI): novel of climbing pen interesting Pavilion
制作带照明的DIY焊接排烟器
Flir Blackfly S 工业相机:通过外部触发实现多摄像头同步拍摄
FLIR blackfly s industrial camera: explanation and configuration of color correction and code setting method
Public key \ private SSH avoid password login
初识MySQL
FLIR blackfly s usb3 industrial camera: white balance setting method
How did partydao turn a tweet into a $200million product Dao in one year
机器人队伍学习方法,实现8.8倍的人力回报
C语言关于链表的代码看不懂?一篇文章让你拿捏二级指针并深入理解函数参数列表中传参的多种形式
UC伯克利助理教授Jacob Steinhardt预测AI基准性能:AI在数学等领域的进展比预想要快,但鲁棒性基准性能进展较慢
JS how to quickly create an array with length n