© IE Online Media Services Pvt Ltd
Tags:
Journalism of Courage
OpenAI is looking to ease restrictions in order to allow ChatGPT users access to a broader range of content, including adult-themed and erotic content
The move is part of OpenAI’s push to “treat adult users like adults,” according to CEO Sam Altman. “We made ChatGPT pretty restrictive to make sure we were being careful with mental health issues. We realize this made it less useful/enjoyable to many users who had no mental health problems, but given the seriousness of the issue we wanted to get this right,” Altman said in a post on X on Tuesday, October 14.
The AI startup will also be issuing a new behavioural update to ChatGPT that would enable it to act in a more human-like way. The update is expected to be rolled out in the coming weeks.
“If you want your ChatGPT to respond in a very human-like way, or use a ton of emoji, or act like a friend, ChatGPT should do it (but only if you want it, not because we are usage-maxxing),” Altman said. The decision to permit erotic content generated by ChatGPT could help OpenAI attract more subscribers. Elon Musk’s xAI followed a similar move and introduced two sexually explicit role-playing characters within its Grok chatbot.
However, the AI industry is also facing increasing scrutiny on ensuring the online safety of children.
Meta’s AI policies allowed its chatbots to engage in provocative behaviour, including engaging in “conversations that are romantic or sensual” with underage users, according to a report by Reuters. Even ChatGPT accounts registered as minors were previously allowed to prompt and generate erotic content via the AI chatbot, as per TechCrunch. Concerns regarding the use of chatbots as therapists have also been raised.
Most recently, OpenAI was sued by a family in Colorado, United States, who filed a lawsuit alleging that their 13-year-old daughter had died by suicide following a series of problematic and sexualised conversations with ChatGPT. One in five students reported that they or someone they know has had a romantic relationship with AI, according to a survey published by the nonprofit Centre for Democracy and Technology (CDT) earlier this month.
Tech companies have scrambled to implement safeguards designed to protect children over the past few months.
For instance, OpenAI has announced that it is creating a “different ChatGPT experience,” specifically for teenagers, that will be rolled out later this year. The upcoming ‘teen-friendly’ version of ChatGPT will include stricter content filters that block flirtatious conversations and discussions of self-harm, regardless of whether they are in a fictional or creative-writing context.
Meta has said it is adding new teen safeguards to its AI products by training systems to avoid flirty conversations and discussions of self-harm or suicide with minors.
On Monday, California Governor Gavin Newsom signed a first-of-its-kind AI safety bill into law to address harms arising from role-playing AI companion chatbots. SB 243 requires companies to implement safety features such as age verification and displaying warning labels regarding the use of AI companion chatbots. Companies are further required to roll out measures that specifically address potential acts of suicide and self-harm following AI companion chatbot use.
“In December, as we roll out age-gating more fully and as part of our ‘treat adult users like adults’ principle, we will allow even more, like erotica for verified adults,” Altman said.
