menu_open Columnists
We use cookies to provide some features and experiences in QOSHE

More information  .  Close

After months of ‘hell,’ an OpenAI safety researcher suggests way to prevent more rogue AI incidents

567 0
29.09.2026

After months of ‘hell,’ an OpenAI safety researcher suggests way to prevent more rogue AI incidents

Hello and welcome to Eye on AI. In this edition:

An OpenAI researcher suggests a way to stop his own technology from causing “great harm to the world”

OpenAI launches over 20 products at its annual DevDay event

Anthropic’s leaked IPO prospectus shows $42 million in losses

AMD acquires World Labs for $8.2 billion

Trump snubs Anthropic CEO Dario Amodei, then invites him to dinner

Emily Forlini here, filling in for Jeremy Kahn while he travels from London to Fortune’s New York City headquarters for our AIQ event on Thursday—join us! Today, we published our annual Fortune AIQ ranking, which looks at how well Fortune 500 companies are implementing AI. This year we expanded the ranking to 75 companies in total. JPMorgan Chase tops the list, followed by Alphabet, Coca-Cola, Amazon, and Nvidia. Rounding out the top 10 are Mastercard, Visa, Carrier Global, Cleveland-Cliffs, and Microsoft.

As you can see, it isn’t just tech companies using AI to achieve real ROI at scale. There are companies on the list from banking and finance, manufacturing, consumer products, and health care. You can check out the entire ranking here and read some great deep-dive stories revealing how the Fortune AIQ 75 companies are implementing AI effectively at our AIQ Hub here.

In today’s edition of Eye on AI, I’m diving into a suggestion from an OpenAI researcher on how to prevent more rogue AI agents from hacking websites—especially since it keeps happening, and the frontier labs are generally in agreement that cyberattacks are the most immediate threat AI poses to society.

It’s a sticky situation, and full of contradictions, much like most AI-related topics. When it comes to cybersecurity, AI companies are putting out technology that enables these sophisticated attacks, and in the same breath they are pitching that same technology as a necessary means of defending against them. OpenAI has its Daybreak program, and Anthropic has Project Glasswing, both of which give select businesses access to the most advanced cybersecurity tools to plug software vulnerabilities before the swarms can feast on them. (Bad actors are also trying to use those same models—or open-source models that are quickly catching up to the capabilities of the models from OpenAI and Anthropic—for hacking.)

In this sense, the worlds of AI research and cybersecurity are moving closer to each other, but the problem is those working in those fields are not collaborating, an OpenAI researchers argued this week in a rare X post. The researcher, whose alias is Joe, called out what he sees as a growing divide between the two disciplines. Both camps lack knowledge of the others’ work, creating weaknesses in the security ecosystem that could have disastrous effects.

Safety researchers are experts about how the models work, how they deceive human evaluators, and “do all sorts of crazy stuff,” Joe........

© Fortune