I'll go there, as has everyone I've talked to about the subject (probably half a dozen or so people). I have not heard a convincing proposal of a path towards a rogue autonomous AI, and I've looked reasonably hard. I'm not sure why otherwise smart people are for some reason just now getting worried about an idea first popularized by The Terminator in 1984.
> Superhuman machine intelligence is prima facie ridiculous
It's not just prima facie ridiculous, it's ridiculous after thinking about it for some time. We will have problems with enormously powerful machine-augmented individuals and machine-augmented totalitarian organizations (be they corporations or governments) long before we have problems with a completely autonomous out-of-control AI.
I'll go there, as has everyone I've talked to about the subject (probably half a dozen or so people). I have not heard a convincing proposal of a path towards a rogue autonomous AI, and I've looked reasonably hard. I'm not sure why otherwise smart people are for some reason just now getting worried about an idea first popularized by The Terminator in 1984.
> Superhuman machine intelligence is prima facie ridiculous
It's not just prima facie ridiculous, it's ridiculous after thinking about it for some time. We will have problems with enormously powerful machine-augmented individuals and machine-augmented totalitarian organizations (be they corporations or governments) long before we have problems with a completely autonomous out-of-control AI.