Study: Medical Chatbots Not Ready Yet For Patient Care
A new study published yesterday provided a sobering look at whether A.I. chatbots are actually good at providing medical advice to the general public.
Researchers found that the chatbots were no better than Google at guiding users toward the correct diagnoses or helping them figure out what to do next. The technology also posed unique risks, sometimes presenting false information or dramatically changing its advice depending on slight changes in the wording of the questions.
None of the models evaluated were “ready for deployment in direct patient care,” the researchers concluded in the first randomized study of its kind.
Since A.I. chatbots were made publicly available, health questions have become one of the most common topics users ask about. Major A.I. companies, including Amazon and OpenAI, have rolled out products specifically aimed at answering health questions.
Creating an AI solution that could have dangerous consequences is one way to postpone that inevitable AI market crash. Granted, the models have passed medical licensing exams and have outperformed doctors on challenging diagnostic problems. But there's a reason why student doctors need clinical experience.