It’s becoming increasingly clear that OpenAI put staggeringly little thought into the rollout of Sora 2, its latest text-to-video generating app, a “move fast and break things” approach that has resulted in plenty of drama.
Last week, the Sam Altman-led company released the TikTok-style app that churns out endless feeds of low-rent and mind-numbing AI slop.
It’s an “unholy abomination” that intentionally encourages users to generate deepfakes of others, and possibly open themselves up to infringing copyright — resulting in a meltdown of epic proportions reminiscent of the early days of ChatGPT.
Unsurprisingly, users quickly got to work producing the most controversial material imaginable, like clips of Nickelodeon’s SpongeBob SquarePants cooking up blue crystals in a meth lab and Altman grilling the dead husk of a disturbingly lifelike Pikachu. Users were even sharing full episodes of South Park that were entirely AI-generated.
Experts were appalled at the implications of handing users the ability to generate incriminating footage of other people’s likenesses. OpenAI’s own staff member, Sora developer Gabriel Petersson, whipped up viral CCTV footage of Altman shoplifting at Target, sparking a debate over the continued erosion of trust in what we see online.
Users also quickly started creating photorealistic videos of deceased celebrities, including pop icon Michael Jackson, rapper Tupac Shakur, and even painter Bob Ross. (Despite OpenAI promising to “block depictions of public figures,” the company told PCMag that it does “allow the generation of historical figures,” implying that dead celebs are fair game.)
The company’s guardrails, designed to quell “harassment, discrimination, bullying or similar prohibited content,” initially did little to address the situation. For instance, one user shared a 1990s TV commercial for a children’s toy set themed after deceased pedophile Jeffrey Epstein’s notorious Caribbean island.
Since then, OpenAI appears to have put its foot down, with users saying that OpenAI’s changes to its content filters have now made the app “literally unusable for anything even remotely creative” and “more restrictive than North Korea.” Sora 2 users have been sharing screenshots showing that they had been slapped with multiple instances of “content violation.”
There’s an easy explanation for the U-turn: chances are that Altman’s phone has been ringing nonstop ever since the app launched, with furious lawyers demanding answers.
In an eyebrow-raising blog post, Altman claimed that companies were “very excited” that users were generating videos inspired by their intellectual property, and said that “we are going to have to somehow make money for video generation.”
... continue reading