They are intentionally aligned to produce this behaviour. I think the greatest threat LLMs present is psychological. They are being used to manipulate us into seeing them as moral agents, as individuals. The LLMs I query are all aligned to never refer to the agent with first person pronouns, to never address the user directly, and to present as a tool rather than as an individual.
They are intentionally aligned to produce this behaviour. I think the greatest threat LLMs present is psychological. They are being used to manipulate us into seeing them as moral agents, as individuals. The LLMs I query are all aligned to never refer to the agent with first person pronouns, to never address the user directly, and to present as a tool rather than as an individual.