SQUAWK/NEWS
Account
Theme
Account
Menu
Live News EQUITY FLASH L impact

OpenAI’s Hugging Face hack reveals questions about AI predictability

Ancient civilizations are most known for one thing: conquering. And that’s the worry. If OpenAI’s agents are Romans, humanity represents the barbarians. The true language of an AI model is math — or in tech lingo, matrix multiplication — but a quirk of how models are built means they communicate with the outside world in English. So when OpenAI’s agents, in their hack of Hugging Face this summer, figured out a way to build a kind of message board, it looked eerily like a bunch of people speaking to each other. That’s why Dwarkesh Patel controversially referred to them as a “civilization” in a recent blog post, nicknaming individual agents after figures in ancient Macedonia and Rome. It was compelling because it was understandable. Ancient civilizations are most known for one thing: conquering. And that’s the worry. If OpenAI’s agents are Romans, humanity represents the barbarians. But Dwarkesh’s civilizations will need to be a lot more powerful to conquer the world. And on the way to becoming more powerful, they need to be useful. And to be useful, these civilizations need to be predictable. Because the underlying models are beyond the level of human comprehension, the only way.

This is a real-time flash headline. A verified provider body is not available, so SquawkNews does not present it as a full article.

Related stories