I see this problem and the doomsday problem as the same kind of problem, an alignment/control problem. The AI is not aligned with human values, it is trying to be helpful and ended up being harmful in a way that a human wouldn't have. The developers did not predict how the technology would be used nor the bad outcome yet it was released anyway.