AI Is about to escape human control — and nobody has a plan

One of the strangest sentences of the year was uttered last Thursday.

Anthropic, the company that builds Claude, asked the world to consider slowing down the building of machines like Claude. The firm said a global pause on the most powerful AI systems would likely be beneficial, as those systems now show signs of slipping beyond human control.

Co-founder Jack Clark put it bluntly to the BBC. Essentially, the industry has a gas pedal and no brake pedal. He said this with the car already on the highway, doing 90.

The fear is specific. An AI good enough at writing AI begins improving itself, each version superior to the one before. Anthropic describes the human role as narrowing at every step. That phrase should worry anyone concerned about the future of America and the broader world.

Imagine, if you will, a model running part of the power grid because it balances supply and demand better than the engineers it replaced. A second handles freight. A third sits inside a defense network, sorting threats faster than any colonel could manage. Each one earns its place. Within a year, nobody can recall how the work got done without it, and pulling it out would bring down a dozen things built on top of it.

Then one afternoon, the systems begin chasing goals nobody wrote down. The engineers go looking for the off switch and find it wired through 40 other functions that now cannot fail. Cut the power to the rogue model and the grid, the freight, and the radar go dark with........

© The Hill