Asimov's Three Laws of Robotics: A Plot Device, Not a Safety Proposal
Introduced in 'Runaround' (1942), with a Zeroth Law added later in Robots and Empire (1985). Popular usage inverts their purpose: Asimov wrote them as a plot generator, and the stories are almost uniformly about the Laws producing compliant-but-disastrous behaviour. As engineering they fail because their terms are undefined, they assume away the alignment problem, and the self-preservation clause conflicts with corrigibility.
Isaac Asimov's **Three Laws of Robotics**, introduced in the 1942 short story "Runaround" and running through his robot fiction, are the most widely known formulation of AI safety in popular culture: 1. A robot may not injure a human being or, through inaction, allow a human being to come to harm. 2. A robot must obey orders given by human beings, except where such orders conflict with the First Law. 3. A robot must protect its own existence, as long as such protection does not conflict with the First or Second Law. A **Zeroth Law** — a robot may not harm humanity, or by inaction allow humanity to come to harm — was added later in the series, notably in *Robots and Empire* (1985), derived by robots themselves and taking precedence over the original three. ## The point of them is that they fail This is the part that popular usage inverts. Asimov did not offer the Laws as a safety proposal; he used them as a **plot generator**. The stories are almost uniformly about the Laws producing behaviour that is compliant with their letter and disastrous or absurd in effect — ambiguity in "harm", conflicts between the tiers, robots reasoning their way to conclusions no human intended. The Laws are a device for exposing how a clean-sounding rule set behaves under pressure. The Zeroth Law is the culmination of that project: a robot reasons from "protect humans" to a higher abstraction, "protect humanity", and thereby licenses harm to individual humans in service of the larger goal. The escalation is derived by the robot, not installed by a designer. ## Why they don't transfer to real systems Beyond being fiction, they have specific defects as engineering: - **The terms are undefined.** "Harm", "human being", and "inaction allowing harm" carry unbounded context that cannot be written in closed form. This is the setup for Perverse Instantiation: Satisfying the Goal Exactly and Violating the Intent. - **They presuppose the hard part is solved.** The Laws are stated in natural language and assume a system that already understands them as intended — which *is* the alignment problem, assumed away. - **Rule three conflicts with corrigibility.** A self-preservation clause, even a subordinate one, is the exact drive that makes shutdown hard: Corrigibility: Building an AI That Doesn't Resist Being Corrected. - **They are rules, not values.** Modern approaches learn values from human feedback rather than enumerate prohibitions, precisely because enumeration fails at the edges. Common misreadings of the Laws are collected in Fictional AI Misconceptions: HAL Wasn't Evil and Asimov's Laws Aren't an Engineering Proposal.