Can you trust AI for health advice?

Mar 11 1:36pm | Colleen Young, Connect Director | @colleenyoung | Comments (86)

Man working on computer at home with dog

Written by: Mayo Clinic Staff

AI can answer health questions in seconds. But should you trust it with your symptoms? Here's what to know before you rely on it.

Imagine you've been feeling tired for weeks. Your usual strategies, like rest and extra coffee, aren't helping. Before deciding whether to schedule an appointment with a healthcare professional, you open an artificial intelligence (AI)-powered chat tool and type, "What health conditions cause fatigue?"

Within seconds, a list of answers appears. It includes stress, anemia, thyroid issues, depression, chronic illness and cancer. The information feels organized and sounds accurate — and a little scary.

But is this answer trustworthy? And what should you do with this information?

AI-created health information is widely used

Nearly 8 in 10 adults in the U.S. turn to the internet for answers to health questions. Instead of scrolling through websites, many people find answers in the AI-generated summary that appears at the top of their search results. (1)

But it doesn't stop there. More than 1 in 5 adults worldwide are turning directly to AI chatbots, like ChatGPT and Gemini, to ask health questions. (2) It's fast, convenient and free. But Mayo Clinic experts warn that AI-generated information isn't always reliable or accurate.

Why you can't always trust AI

When it comes to using AI for health information, there are a few key limitations to keep in mind:

1. Diagnosing and treating illness is too complex for a machine

AI tools don't have access to your full medical record — and you shouldn’t upload or share it with them. These tools can't examine you or run tests the way a healthcare professional can. They don't have the ability to reason like a human or explain how they came to a conclusion. (3) These qualities are necessary for making safe and accurate medical decisions.

2. AI can be wrong, even when it sounds confident

AI chatbots give answers based on patterns in data. They don't "know" facts in the way a health professional does. Sometimes AI information sounds true but is completely incorrect. This is known as hallucination. (4, 5) For example, when asked how to get more minerals from food, AI has been known to recommend eating rocks. (6)

3. AI-created information may be biased

AI systems are trained on large amounts of data that may contain bias or gaps. That means it may not reflect everyone's experience fairly. (7, 8) For example, an AI system that learned from information about people in the United States and parts of Europe might miss signs of depression. That's because it doesn't know that in some cultures, people show sadness through physical symptoms like headaches or tiredness, rather than talking about their feelings.

4. AI spreads misinformation

AI doesn't know what's true and what's not. (6) It may pull answers from flawed or misleading sources it finds online. When people see alarming health stories online, they often forward or repost them — even if they know the information may not be true. As false information spreads, there’s more of it online. AI may then repeat that false information. (9)

5. People and AI don't communicate well together

One study found that people seeking health information don't tend to give AI chatbots enough specific information for clear, accurate answers. (4) And small differences in how symptoms are described can completely change the answer from AI, making it less accurate. (4,5) For example, when two people asked about the same symptoms but used different words, AI told only one of them the correct answer, which was to get emergency care. (4)

How to use AI more safely and effectively

If you still want to use AI to learn about a health topic, here are practical steps to reduce risk:

  • Use AI for general education, not diagnosis. AI is best suited for explaining medical terms or giving general wellness advice. For example, you might ask, "What does hypertension mean in plain language?" or "How can I add more movement into my day?"
  • Cross-check everything. Verify information with trusted sources, like websites for Mayo Clinic or the American Medical Association. Most importantly, review what you learn with your healthcare team. (6)
  • Ask clear, specific questions. Instead of asking, "Is coughing a bad sign?" try, "What are common causes of chronic dry cough in adults?" Clear, focused questions tend to produce more useful and balanced answers. (6) Remember: Healthcare professionals are trained to ask the right follow-up questions. AI isn't. (4)
  • Protect your privacy. Don't share personal information, like your full name, date of birth, address, medical records or insurance details. Even health details should be shared cautiously, especially on public or free platforms. (6)

The bottom line

Think of AI as a research assistant, not as your healthcare professional. It can be a helpful tool for summarizing ideas or getting big-picture information. AI can be extremely useful in preparing questions to ask your care team. But when it comes to your health, the safest and most effective decisions are still made with a trusted healthcare professional.

Related links:

References

  1. Many in U.S. consider AI-generated health information useful and reliable. Annenberg Public Policy Center. https://www.annenbergpublicpolicycenter.org/many-in-u-s-consider-ai-generated-health-information-useful-and-reliable/. Accessed Feb. 10, 2026.
  2. Yun HS, et al. Online health information-seeking in the era of large language models: Cross-sectional web-based survey study. Journal of Medical Internet Research. 2025; doi:10.2196/68560.
  3. Ullah E, et al. Challenges and barriers of using large language models (LLM) such as ChatGPT for diagnostic medicine with a focus on digital pathology — A recent scoping review. Diagnostic Pathology. 2024; doi:10.1186/s13000-024-01464-7.
  4. Bean AM, et al. Reliability of LLMs as medical assistants for the general public: A randomized preregistered study. Nature Medicine. 2026; doi:10.1038/s41591-025-04074-y.
  5. Giorgi S, et al. Evaluating generative AI responses to real-world drug-related questions. Psychiatry Research. 2024; doi:10.1016/j.psychres.2024.116058.
  6. What doctors wish patients knew about using AI for health tips. American Medical Association. ama-assn.org/practice-management/digital-health/what-doctors-wish-patients-knew-about-using-ai-health-tips. Accessed Feb. 17, 2026.
  7. Yoon SC, et al. Digital psychiatry with chatbot: Recent advances and limitations. Clinical Psychopharmacology and Neuroscience. 2025; doi:10.9758/cpn.25.1346.
  8. Thakkar A, et al. Artificial intelligence in positive mental health: A narrative review. Frontiers in Digital Health. 2024; doi:10.3389/fdgth.2024.1280235.
  9. Saeidnia HR, et al. Generative AI and health misinformation: Production, propagation, and mitigation — A systematic review. BMC Public Health. 2026; doi:10.1186/s12889-025-26148-9.

Interested in more newsfeed posts like this? Go to the About Connect: Who, What & Why blog.

I do use it for information, It does help me formulate the questions I ask my medical team.. And they are always helpful in answering what I read..

REPLY

I use Microsoft Co-Pilot. The site says in written caveat "A.I. can make mistakes."

I was surprised by one answer on Co-Pilot. It listed the discussions of those on Mayo Community Connect.

What Co-pilot does is list the medical institution (if you are doing medical questions) the sources they used for the answer. Then you can go on that web site and research.

I did put a question in about AFIB and VFIB type feelings that seemed to come an hour after I ate. A.I. said stomach can move up and put pressure and heart react. Also can divert blood to digestion. Seems the Vagus never gets involved. So I have tried to sit upright when eat and eat smaller meals. Still get the PACs and PVCs but much less.

I also read that sleeping on right side is best for organs placement and can help with night time PACs and PVCs. So I tried this and it did help.

So I use is but I will caveat that with I always follow up with my medical doctors if I am considering changing any instruction they have given me or adding or deleting and OTC supplement.

I did smile when I read something like "Those on Mayo Community Connect" report this or that.

REPLY

Thank you for posting this. It is greatly appreciated., especially in conjunction with the Community Guidelines.

REPLY

This is great that this subject was brought up.

Am in medical field. Much of medicine is "art" - doctors and nurses use hunches, creative thinking, individualized treatments.

Every person's medical experience MUST be individualized.

Ai isn't good at art. Don't forget medicine is above all else an art with scientific evidence.

I ALWAYS use professional journals and peer rated medical journals for medical answers. This is because not every patient fits in an Ai generated "box".

REPLY

I would caution everyone to verify if accuracy matters. For the most part I pay attention to sources the material is referencing. And I find they are almost always included in the narrative. I usually go to the primary source and read it for myself. Or I go to sources I trust such as NIH - to see if they have a recent study on the topic.

Don’t take everything you read as gospel. But neither should we throw it out just because AI surfaces it…

REPLY

Hi, Colleen. Thank you for this excellent article. Now a days, it feels like Dr. Google is what a lot of people turn to. With AI, it's faster - still I can't take a computer for its words over an actual trained doctor. I did use AI when I got some lab reports back. It made me think and write down questions when I would next see my doctor. I like to have some knowledge of what I'm facing. I see it (AI) as a positive in this regard. However; as health expenses continue to rise - a lot of people, especially without insurance, will call on Dr. Google, AI.

Thank you, again.
Jane

REPLY
Profile picture for Pug, Volunteer Mentor @ckscoville

I agree with others who have posted here. This is an excellent cautionary posting. In researching some of my own health issues, I have noted the effects of poorly structured (or overly general) questions on the AI answers and results.

Jump to this post

Well said Pug. Just my opinion, but anyone relying on AI alone for health info is foolish and reckless.

Most of the chatbots have a disclaimer on medical "advice" anyway - basically, it's not advice.

That said, I have found it very helpful in researching a medical question. But AI still "hallucinates" and makes mistakes. People should understand this. With almost any AI application, there needs to be an HITL (human in the loop). In this case, it would be a Dr.

Joe

REPLY
Profile picture for heyjoe415 @heyjoe415

Well said Pug. Just my opinion, but anyone relying on AI alone for health info is foolish and reckless.

Most of the chatbots have a disclaimer on medical "advice" anyway - basically, it's not advice.

That said, I have found it very helpful in researching a medical question. But AI still "hallucinates" and makes mistakes. People should understand this. With almost any AI application, there needs to be an HITL (human in the loop). In this case, it would be a Dr.

Joe

Jump to this post

@heyjoe415 I completely agree. Even though I know that doctors are also not infallible, I have more trust in a well-educated physician. Perhaps being the son of a brilliant physician, I am a little biased myself! 🙂

REPLY

Just to share,…I asked my doctor and he said that he uses it - chatGPt and another one specifically for doctors. He said that if provides alternatives that he may not have thought of as well as reinforcing his diagnosis.

I personally copied my blood test results into ChatGPT. It provided an easy-to-understand explanation of each test AND the results. And guess what?,…it was similar to what the doctor told me when I later discussed with him. That was reassuring.

That said, I would never suggest a person use it by itself or self-diagnose. Yet it’s a tool to consider - like having a second opinion!

REPLY

I don't know if we've gotten to the point where advertising (often masked as objective research) is influencing AI results.

But beware; with so much advertising out there (especially medical) that is wantonly deceptive, that's coming! Woe to those who blindly trust it.

REPLY
Please sign in or register to post a reply.