AI — Emergence and the Limits of Control

Conway's Game of Life needs three rules. Out of them come forms nobody planned: gliders that travel. Guns that produce new gliders. Patterns that copy themselves. None of it is written in the rules. Artificial intelligence, too, is built from a handful of principles – and it, too, shows behaviour nobody wrote into it. Robert Berger takes that parallel seriously and follows it through.
His position paper puts two claims up for discussion. First: capability thresholds can be crossed without anyone noticing. Second: within federations of networked systems, evolutionary leaps arise continuously that were neither programmed nor trained in and cannot be read off any training curve. From this follows a proposal: an independent guardian AI as a monitoring level of its own, a catalog of emergent system states modelled on the pattern taxonomy of the Game of Life, escalation levels with a human decision at the end. A book that sells no answers, but sharpens a question – and invites the reader to think on.