Google Is Using A.I. to Answer Your Health Questions. Should You Trust It?

Do you have a headache or is it a sinus infection? What does a stress fracture feel like? Should you be worried about the pain in your chest? If you Google those questions now, the answers may be written by artificial intelligence.

In May, Google rolled out a new feature called A.I. Overviews that uses generative A.I., a type of machine-learning technology that is trained on information from across the internet and produces conversational answers to some search questions in a matter of seconds.

In the weeks since the tool launched, users have encountered a wide array of inaccuracies and odd answers on a range of subjects. The company later appeared to roll back the feature for some searches as it tried to minimize those errors.

When it comes to the A.I. answers to health questions, experts said the stakes were particularly high. The technology could point people toward healthier habits or needed medical care, but it also has the potential to give inaccurate information. The A.I. can sometimes fabricate facts. And if its answers are shaped by websites that aren’t grounded in science, it might offer advice that goes against medical guidance or poses a risk to a person’s health.

The system has already been shown to produce bad answers seemingly based on flawed sources. When asked “how many rocks should I eat,” for example, A.I. Overviews told some users to eat at least one rock a day for vitamins and minerals. (The advice was scraped from The Onion, a satirical site.)

“You can’t trust everything you read,” said Dr. Karandeep Singh, chief health A.I. officer at UC San Diego Health. In health, he said, the source of your information is essential.