00:00AI systems become more capable and more autonomous.
00:03They could move faster than our institutions,
00:05concentrate power in too few hands,
00:08or make decisions that people no longer understand or control.
00:13That concern becomes especially important
00:15as we approach systems that can improve themselves
00:18and future versions of themselves,
00:20often called recursive self-improvement.
00:22As the process of building AI becomes more automated,
00:25the pace of AI progress could accelerate rapidly.
00:28This moment calls for extreme care.
