I know I've got a hard-earned cynical streak, but I am more worried about the mass sociological cascade. I absolutely don't worry about some ultra smart AI having malignant intent or even being enslaved by someone with malignant intent. Instead, it's the weird Tulip Mania or Salem Witch Trial risks that I do not know how to quantify.
How severely can the mass delusions and magical thinking around AI mix with other regressive social trends? I do not relish the mass effect of people deferring their decision making to glorified Magic 8 Ball devices, treating them as oracles rather than syntactic lava lamps. Will it lay waste to a generation of education, thinking, science, and policy so that society itself acts out some kind of Therac 25 or Bhopal incident at scale?
How severely can the mass delusions and magical thinking around AI mix with other regressive social trends? I do not relish the mass effect of people deferring their decision making to glorified Magic 8 Ball devices, treating them as oracles rather than syntactic lava lamps. Will it lay waste to a generation of education, thinking, science, and policy so that society itself acts out some kind of Therac 25 or Bhopal incident at scale?