🔍👁 AI doesn’t have to hate us to end us: AI pioneer Geoffrey Hinton AI is “very different” from nuclear weapons in that the latter “can only be used for doing bad things,” but that doesn’t mean there aren’t risks of the technology wiping us out even if it doesn’t ‘consciously’ want to, Hinton, a veteran AI engineer whose work goes back to the 70s, says. 🔴“Suppose I said to a very intelligent AI agent, ‘do whatever you can to reduce the amount of carbon dioxide in the atmosphere. Well, a moderately intelligent agent would figure out that the best thing to do is just get rid of people, and then they’ll stop burning carbon,🔴he explained in an interview. A “really smart AI” would probably realize what we mean, “but the worry is they’ll do” other “things that we didn’t want and, in particular, things to do with their own survival, because they’ll have a strong subgoal of surviving, and we’ve seen that already.” 👉 The problem is balancing today’s AIs -whose overriding objective is to “accomplish tasks” with creating a “highly intelligent AI” that actually cares “for our welfare more than it did for its own welfare.” That’s complicated by the fact that AI companies are run by billionaires obsessed with their wealth and the fear of ‘falling behind China’, which ramps up tolerance for risk, Hinton says. 👍 Substack | Chat | @geopolitics_prime