Use The Capability-Safety Gap As Your Primary Decision Signal
Yampolskiy's central technical argument is not that AI is dangerous in the abstract. It is that progress in AI capability is exponential, possibly hyper-exponential, while progress in AI safety is linear or flat. The gap between what these systems can do and what we can predict, explain, or control about them is widening every year. That gap is the signal. He traces this to how modern AI is built. The systems are not programmed with explicit rules in the way software was for the first fifty years of computing. They are trained on massive datasets and then studied like an artifact from the outside. "We are creating this artifact, growing it," he says. "It's like an alien plant. And then we study it to see what it's doing." Even the engineers building these systems run experiments on their own products to discover what those products are capable of. New capabilities are still being found in old models. Nobody can tell you precisely what a system will do given a set of inputs. The practical implication is that any safety claim made by an AI company should be evaluated against this gap, not taken at face value. "The state-of-the-art answers are, we'll figure it out when we get there, or AI will help us control more advanced AI," Yampolskiy says. "That's insane." The gap also means that patches work only briefly. Jailbreaks appear. Restricted behaviors migrate to unrestricted subdomains. The HR-manual analogy he uses is precise: a smart enough employee always finds a workaround to any written policy.

