AI chatbots offering health tips: The risks and challenges

It should also be noted that the application of AI in the healthcare sector has several legal issues involved, since there are no specific laws to deal with it in India.

There are many AI videos on social media which suggest home remedies and, in some cases, also offer symptoms and cure for certain diseases. (Video screengrab)

Listen to this article

00:00

1x 1.5x 1.8x

Artificial Intelligence (AI) is rapidly transforming and people are experimenting with it. Generative AI tools are now being used to seek medical advice too.

Recently, the National Eating Disorders Association (NEDA) of the US took down an artificial intelligence chatbot, ‘Tessa’, after reports that the chatbot was providing harmful advice to its users. In a statement, Liz Thompson, NEDA’s CEO, said the chatbot was not meant to replace the helpline but was rather created as a separate programme. Thompson clarified that the chatbot is not run by ChatGPT and is “not a highly functional AI system”.

Facts About Fiction | Beyond the pixels: How to identify fake, AI-generated images

AI health tips provide users with a variety of information such as the symptoms, diagnosis and even the treatment and prevention. Through various videos, posts and reels these health tips from the Large Language Models (LLMs) are presented as if these are human-written tips, which make these look more credible. However, there are a number of potential risks associated with using these AI health tips.

AI doctors sharing chatbot advice as health remedies

A video on a Facebook page shows a doctor sharing tips on eating healthy food to gain weight. Another AI-generated video shares a ‘remedy’ to keep gums and teeth healthy. These are among the many AI videos which suggest home remedies and, in some cases, also offer symptoms and cure for certain diseases.

So how are these videos created? Making such videos is simple and there are tutorials available on YouTube. The creators usually generate an AI image, animate it, and add visuals and voice.

It should also be noted that the application of AI in the healthcare sector has several legal issues involved, since there are no specific laws to deal with it in India.

But do these videos offer accurate advice and should you trust them? Here’s what Google Bard and ChatGPT have to say:

Story continues below this ad

Google Bard: It is important to be critical of AI health tips and to consult with a healthcare professional before following any advice.

ChatGPT: AI health tips can be safe and useful tools for health information, but users should approach them with critical thinking, verify the sources, and consult with healthcare professionals for any medical concerns or questions.

Doctors and experts, however, caution against following these health tips.

“These remedies that the videos show are all age-old remedies. Many use it as a primary remedy before consulting doctors. I don’t think there is enough research and data regarding these health tips. It is not safe to follow anything blindly. Instead of relying on AI’s fed brilliance, we should embrace doctor’s knowledge which can be tailor made for the patients,” said Dr Vandana Kate, President, Indian Medical Association (IMA), Nagpur.

Story continues below this ad

Clinical dietician Malvvika Fulwani said, “I would recommend using these tips, if you read anything verify it with scientific evidence. If these tips are accompanied with a research paper then maybe you can use them, else not.” She also suggests seeing a doctor instead of using these health tips.

Ankita Deshkar

Ankita Deshkar is a Deputy Copy Editor and a dedicated fact-checker at The Indian Express. Based in Maharashtra, she specializes in bridging the gap between technical complexity and public understanding. With a deep focus on Cyber Law, Information Technology, and Public Safety, she leads "The Safe Side" series, where she deconstructs emerging digital threats and financial scams. Ankita is also a certified trainer for the Google News Initiative (GNI) India Training Network, specializing in online verification and the fight against misinformation. She is also an AI trainer with ADiRA (AI for Digital Readiness and Advancement) Professional Background & Expertise Role: Fact-checker & Deputy Copy Editor, The Indian Express Experience: Started working in 2016 Ankita brings a unique multidisciplinary background to her journalism, combining engineering logic with mass communication expertise. Her work often intersects regional governance, wildlife conservation, and digital rights, making her a leading voice on issues affecting Central India, particularly the Vidarbha region. Key focus areas include: Fact-Checking & Verification: As a GNI-certified trainer, she conducts workshops on debunking deepfakes, verifying viral claims, and using OSINT (Open Source Intelligence) tools. Cyber Law & IT: With postgraduate specialization in Cyber Law, she decodes the legalities of data privacy, digital fraud, and the evolving landscape of intellectual property rights. Public Safety & Health: Through her "The Safe Side" column, she provides actionable intelligence on avoiding "juice jacking," "e-SIM scams," and digital extortion. Regional Reporting: She provides on-ground coverage of high-stakes issues in Maharashtra, from Maoist surrenders in Gadchiroli to critical healthcare updates and wildlife-human conflict in Nagpur. Education & Credentials Ankita is currently pursuing her PhD in Mass Communication and Journalism, focusing on the non-verbal communication through Indian classical dance forms. Her academic foundation includes: MA in Mass Communication (RTM Nagpur University) Bachelors in Electrical Engineering (RTM Nagpur University) Post Graduate Diploma (PGTD) in Cyber Law and Information Technology Specialization in Intellectual Property Rights Recent Notable Coverage Ankita’s reportage is recognized for its investigative depth and emphasis on accountability: Cyber Security: "Lost money to a scam? Act within the 'golden hour' or risk losing it all" — A deep dive into the critical window for freezing fraudulent transactions. Public Health: "From deep coma to recovery: First fully recovered Coldrif patient discharged" — Investigating the aftermath of pharmaceutical toxins and the healthcare response. Governance & Conflict: "Gadchiroli now looks like any normal city: SP Neelotpal" — An analysis of the socio-political shift in Maoist-affected regions. Signature Beat Ankita is best known for her ability to translate "technical jargon into human stories." Whether she is explaining how AI tools like MahaCrimeOS assist the police or exposing the dire conditions of wildlife transit centres, her writing serves as a bridge between specialized knowledge and everyday safety. Contact & Follow X (Twitter): @ankita_deshkar Email: ankita.deshkar@indianexpress.com ... Read More