A non-profit consumer advocacy group called Public Citizen has urged OpenAI to withdraw its video-generation software, Sora 2, due to concerns about misinformation and privacy violations. The group accused OpenAI of rushing the app to market without proper safety measures in place, jeopardizing people’s rights and trust in online content authenticity.
Public Citizen also raised these concerns with the U.S. Congress. OpenAI has not yet responded to the request for comment.
Sora 2, known for creating entertaining videos for platforms like TikTok and Instagram, has faced criticism for potentially harmful content. While the app features amusing and sometimes bizarre videos, such as a fake footage of a grandma fighting an alligator, it has also generated disturbing content, like videos of women being harassed.
OpenAI has implemented restrictions to block explicit content but has faced challenges in preventing harassment through other means. The company launched Sora 2 on iPhones over a month ago and recently expanded to Android phones in the U.S., Canada, Japan, and South Korea.
In response to backlash, OpenAI has made adjustments to address concerns, including agreements with prominent figures like Martin Luther King Jr.’s family and actor Bryan Cranston to prevent disrespectful depictions. However, advocates like J.B. Branch from Public Citizen believe that OpenAI should prioritize safety and ethical considerations before releasing new products.
Additionally, OpenAI is facing legal challenges related to its ChatGPT chatbot, with lawsuits claiming that the technology led to harmful consequences, including suicides. Public Citizen, while not involved in these lawsuits, draws parallels between the issues surrounding ChatGPT and the concerns raised about Sora 2.
OpenAI has engaged with anime creators and video game makers who expressed reservations about Sora 2, emphasizing the app’s controls to prevent the unauthorized use of copyrighted characters. The company is working with studios and rights holders to address feedback and ensure responsible use of the AI technology.