This is the most dangerous thing that humans have ever gone near...part of the reason I’m speaking so loudly — as loud as I can — is that you can’t rely on the industry to self-regulate here.
The size of the brain is limited by the birth canal — it’s why humans, at first, are very limited...But the silicon intelligence doesn’t have these limitations.
OK, whatever goes on here, it can’t just be driven by profit maximization.
A.I. has crossed the threshold that its ability to empower a bioterrorist to kill hundreds of millions — that exists today. The ability to do a cyberattack that scrambles all of the bank accounts, shuts down the electric grid — that exists today...there could be a control problem where the A.I., on its own, through an unintentional interpretation of what it’s optimizing, could go off and do bad things...These models, the ability to separate out making molecules for good and making them for evil — that is so hard to distinguish.
[AI is] finding bugs in code that humans have looked over for over 20 years and said: Boy, we see there’s no problem here.
And in a few minutes, the A.I. says: No, no, I can inject this over here and this over here — at a level of complexity where, when you see it, you go: Wait. Oh, yeah, you’re right.
we don’t have a supervisory layer that has some absolutes, like: You’re not supposed to take over other computers. You’re not supposed to break out into the internet.
[How to maintain social security?] You define a unit of labor and say, independent of whether that’s delivered by a human or robot, you are paying the same FICA tax that a human worker would pay.
In low-income countries, the A.I. will overwhelmingly be a good thing, and it should be pushed forward as quickly as it can...The one application that’s going full speed ahead...is the agricultural one, because they’re getting better weather data to these farmers in Africa. We have over one million farmers in India already using the system. So it tells them what crop disease they have, what fertilizer to use, what varieties to plant.
