@nose That's a very good question! And the answer is, "It depends."
Here is some guidance from Mayo Clinic:
https://connect.mayoclinic.org/blog/about-connect/newsfeed-post/can-you-trust-ai-for-health-advice/
Treat AI just like you would any other internet query and "look under the hood" to see where the answer came from. Then go to the source material and read. There is no other way to know whether to trust a specific answer.

If there is no specific source noted, the answer is a general summary, which may have come from ANYWHERE ON THE WEB - scientific or medical sources, Facebook, chat groups, blogs, promotional sites... In that case, give it the same weight as an answer you might get from friends, neighbors and coworkers...

Also, please do not make changes to your treatment plan based on an AI response without consulting your health care provider(s).