because we would never be dumb enough to give them that ability
Simpsons did it first:
Imagine trying to argue that Homer Simpson’s drinking bird nearly caused a catastrophe because it “lacked alignment” with Homer’s intentions. Or, that the bird “went rogue” and that’s why there was nearly a disaster.
Clearly the “system” isn’t capable of doing Homer’s job, and only an idiot would hand over control to that system. But, apparently we’re now letting chatbots loose in the wild because they’re very good at generating text, which makes people think they’re intelligent, capable, and can actually make decisions.
Simpsons did it first:
Imagine trying to argue that Homer Simpson’s drinking bird nearly caused a catastrophe because it “lacked alignment” with Homer’s intentions. Or, that the bird “went rogue” and that’s why there was nearly a disaster.
Clearly the “system” isn’t capable of doing Homer’s job, and only an idiot would hand over control to that system. But, apparently we’re now letting chatbots loose in the wild because they’re very good at generating text, which makes people think they’re intelligent, capable, and can actually make decisions.