‘Should I break up with my boyfriend?’: ChatGPT to stop giving direct relationship advice; here’s why

OpenAI clarified that the tool will now refrain from answering high-stakes personal questions directly, including those about relationships, and will instead offer support that helps users reach their own conclusions. “New behaviour for high-stakes personal decisions is rolling out soon. We’ll keep tuning when and how they show up so they feel natural and helpful,” the company said in a statement.

To further support this shift, OpenAI is forming an advisory group comprising experts in human-computer interaction, youth development, and mental health. “We hold ourselves to one test: if someone we love turned to ChatGPT for support, would we feel reassured? Getting to an unequivocal ‘yes’ is our work,” said the company’s blog post, The Guardian reported.

Back in May, Altman noted that ChatGPT had become “annoying” and overly sycophantic after users complained about the platform feeding the users to continue the conversation. “The last couple of GPT-4o updates have made the personality too sycophant-y and annoying (even though there are some very good parts of it). We are working on fixes asap, some today and some this week. At some point we will share our learnings from this, it’s been interesting,” Altman said.