ChatGPT's highly anticipated new voice mode just starred in a new demo showing off its acting skills, and the video could be a taste of what we can expect from the new deal between Apple and OpenAI.
The ChatGPT app already has a voice mode, but OpenAI showed off a much more impressive version during the launch of its new GPT-4o model in May. Unfortunately, that was overshadowed by OpenAI's public dispute with Scarlett Johansson over the similarity of ChatGPT's Sky voice to hers in the film. His. But OpenAI promotes the new mode again in the clip below.
The video shows someone writing a story and getting ChatGPT to do improv drama effectively, providing voices for a “majestic lion” and a mouse. Beyond the expressiveness of the voices, what stands out is the ease with which ChatGPT's voice can be interrupted for a better conversational flow, and also the lack of latency.
OpenAI says the new mode “will roll out in the coming weeks” and that's a pretty big deal. Especially since, as Bloomberg's Mark Gurman reported again, Apple is expected to announce a new partnership with OpenAI at WWDC 2024 on June 10.
Exactly how OpenAI technology will be integrated into iOS 18 remains to be seen, but Gurman's report claims that Apple will “infuse AI into its Siri digital assistant.” That means some of its off-device powers could take advantage of ChatGPT, and if it's anything like OpenAI's new demo, it would be a big step up from today's Siri.
Are voice assistants finally growing up?
Siri's alleged AI overhaul will likely be one of the biggest stories of WWDC 2024. According to Dag Kittlaus, who co-founded and led Siri before it was acquired by Apple in 2010, the deal with OpenAI will likely be a “short-term” deal. in the medium term.” relationship” as Apple tries to catch up. But it's still a big surprise.
It's possible that Siri's AI improvements will be limited to minor features on the device, with Apple using its OpenAI partnership only for text-based queries. After all, from iOS 15 onwards, Apple changed Siri's audio processing so that it was on the device by default, which meant you could use it without an internet connection.
But Bloomberg's Gurman claims that Apple has “forged a partnership to integrate OpenAI's ChatGPT into the iPhone operating system.” If so, one unlikely move may be followed by another, with Siri turning to ChatGPT for off-device queries and a more conversational flow. It has been possible to use ChatGPT with Siri for some time now using Apple Shortcuts.
It wouldn't be the first time that Apple integrates third-party software into iOS. On the original iPhone, Apple created a pre-installed YouTube app that was later removed once Google created its own version. Gurman's sources noted that by outsourcing an AI chatbot, “Apple can distance itself from the technology itself, including its inaccuracies and occasional hallucinations.”
We're certainly eager to see how Apple integrates OpenAI technology into iOS (and potentially Siri) at WWDC 2024.