Programming Note: This newsletter was previously called Steady State. It's now called KCRW Context, and it's still written by KCRW's Editor-in-Chief Arnie Seipel.
AI leaders like OpenAI CEO Sam Altman, seen above at the White House last year, have developed close relationships with the White House. Though, as those top AI figures warn of the dangers the technology could bring, President Trump has dismissed the warnings as a “hoax.” Photo by Andrew Harnik/Getty Images.
Hi there -
It’s impossible to ignore the warnings about AI that have ramped up over the last week. Notably, an Anthropic researcher resigned and stated publicly that there is a greater than 10% chance artificial intelligence could wipe out the human race.
But how?
There are several scenarios that have been imagined, but one of the clearest isn’t that far from reality. We know that foreign powers like Iran have attempted to hack into U.S. water and electricity infrastructure. Imagine AI systems getting to the point where a nefarious actor could use them to cause widespread destruction to systems that deliver essential resources. Or perhaps worse, imagine if the AI system takes it upon itself to do the hacking.
That’s just one possible nightmare.
Sarah Isgur from KCRW’s Left, Right & Center offered an apt metaphor on Friday as we marked the 25th anniversary of the September 11th attacks. “We had warnings before 9/11. In that sense, it feels very similar to this AI moment,” she said. “We have warnings that this is an important issue that we need to focus on, but we're not focused on it.”
That focus does seem to be shifting.
The warnings from a researcher weren’t dismissed by AI leaders. They were amplified.
Anthropic CEO Dario Amodei, OpenAI CEO Sam Altman, and even Elon Musk all called for a slowdown in AI development in the past week. Skepticism abounds, since there is a history of tech companies shifting the burden of responsibility to government regulation, and then undermining those efforts.
So what do we do about it?
This is an international problem, not something that the U.S. can deal with just within its own borders. One framework being discussed a lot is to think of AI like nuclear material. It needs to be regulated as we seek out its beneficial uses, just like nuclear power, and tightly restricted so it cannot be used for destruction, as we do with nuclear weapons.