A manager at artificial intelligence firm OpenAI caused consternation recently by writing that she just had "a quite emotional, personal conversation" with her firm's viral chatbot ChatGPT.
"Never tried therapy before but this is probably it?" Lilian Weng posted on X, formerly Twitter, prompting a torrent of negative commentary accusing her of downplaying mental illness.
However, Weng's take on her interaction with ChatGPT may be explained by a version of the placebo effect outlined this week by research in the Nature Machine Intelligence journal.
A team from Massachusetts Institute of Technology (MIT) and Arizona State University asked more than 300 participants to interact with mental health AI programmes and primed them on what to expect.
Some were told the chatbot was empathetic, others that it was manipulative and a third group that it was neutral.
Those who were told they were talking with a caring chatbot were far more likely than the other groups to see their chatbot therapists as trustworthy.
"From this study, we see that to some extent the AI is the AI of the beholder," said report co-author Pat Pataranutaporn.
Buzzy startups have been pushing AI apps offering therapy, companionship and other mental health support for years now -- and it is big business.
But the field remains a lightning rod for controversy.
We are now on WhatsApp. Click to join.
Like every other sector that AI is threatening to disrupt, critics are concerned that bots will eventually replace human workers rather than complement them.
And with mental health, the concern is that bots are unlikely to do a great job.
"Therapy is for mental well-being and it's hard work," Cher Scarlett, an activist and programmer, wrote in response to Weng's initial post on X.
Read more on tech.hindustantimes.com