00:00Once that cycle starts, we're going to create something called superintelligence, a system
00:04smarter than all of us at everything or capable of learning to be in any new domain.
00:09We will become secondary species on this planet, we will not be in charge, we will not decide
00:15what happens to us.
00:17Superintelligence doesn't hate you, it just doesn't care about you, we didn't learn how
00:21to make it care about us, and if it decides to, I don't know, cool the planet to make
00:25compute more efficient, it will freeze us.
00:27If it wants to convert this planet to fuel, to fly to Mars, so be it.
00:32We have not learned how to control those systems.
00:35The capabilities are getting exponentially better.
00:39Our ability to control those systems is non-existent.
00:42We have filters, and we have bands, we put guardrails of don't say that word, don't talk
00:47about this topic, and that happens after the fact, after the model already made the decision,
00:52sometimes you see it scraping the result.
00:54but things are more efficient.
00:54That means that it is fall