AI Chatbots May Recommend the Same Medicine Repeatedly

People who ask AI chatbots for medical advice may expect different treatment suggestions based on their health conditions. However, a recent study published in Nature Health has raised concerns about how AI systems recommend medicines.

The study found that AI chatbots frequently recommend the same medication, even when other medicines with similar active ingredients are available. This pattern could reduce the variety of treatment options presented to users.

Researchers tested five large AI models using 177,120 imaginary medical situations. The scenarios covered 123 different diseases and treatments and included patient-related factors such as age and location.

According to the study, one medication was recommended nearly 97.5% of the time, regardless of the disease or drug combination being considered. This suggests that some AI systems may repeatedly favour particular medicines instead of considering a wider range of suitable alternatives.

The researchers’ findings highlight concerns about potential biases in AI-generated medical advice. Although AI chatbots are designed to provide helpful information, repeatedly recommending the same medicine could limit users’ understanding of different treatment choices.

The study also raises questions about how AI systems evaluate medical information and select treatment recommendations. Developers may need to improve these systems to ensure that they provide more balanced and appropriate suggestions.

AI tools can help people understand medical information, but they should not replace professional medical advice. Patients should consult qualified healthcare professionals before choosing or changing any medication.

The findings underline the importance of making AI-powered healthcare tools more reliable, transparent and careful when providing information about medicines.