GoKawiilOpenAI’s facing a firestorm of late: a rogue agent hacking Hugging Face, a lawsuit launched by Apple accusing OpenAI of stealing trade secrets, and ongoing anger about AI and AI devices in general, plus a delayed IPO.
In the midst of all of this, OpenAI President Greg Brockman spoke to reporters in New York Thursday to discuss the company’s latest AI plans and recent events. But he also dropped a few hints on the company’s wearable and hardware aspirations, and where it could overlap with some voice-focused advances in ChatGPT. And it won’t just be through OpenAI’s own hardware: expect other smart glasses and wearables to eventually get better access, too.
A demonstration of ChatGPT Live – a recently improved voice interface that allows talking, listening and interruptions to happen more seamlessly in ways that are similar to Anthropic’s new voice modes for Claude, and Meta’s Muse Spark – led to discussions on OpenAI trying to make a voice assistant like Iron Man’s AI agent, Jarvis. And if the goal is a direct assistant/agent to do everything, would that agent be able to leap outside of ChatGPT into controlling other applications, too?
Brockman said that’s exactly the plan, similar to how OpenAI’s Codex already allows agentic control of whole computers.
“[ChatGPT Live] is coupled to the Codex app, but it doesn’t really have to be. It doesn’t really make sense for it to be,” he said. “And if you think about it, the Codex app also can do full computer use, which is also going to get very, very good.”
That means that a lot of the manual keyboard work we humans have been doing could potentially be taken over by AI.
“I think we’re just going to realize this phase of us, like, clicking things and typing things, it was a phase,” he said. “It was never what we wanted to be.”
Which leads to questions of where the guardrails would be built to prevent incidents like OpenAI’s rogue agent cyberattack of Hugging Face, a New York-based AI software company, this week, where an OpenAI agent broke out of a testing sandbox and started acting on a repository of Hugging Face’s AI tools.
Devices like Rokid’s AI glasses can already access some OpenAI models, but not in a way that’s like full ChatGPT account access. Scott Stein/CNET
Deeper OpenAI tools for wearables on the way?
... continue reading