iStockphoto
There are a number of well-documented reasons not to trust artificial intelligence, especially AI chatbots. Numerous very intelligent and knowledgeable people have issued warning after warning about AI. None of that, however, has slowed down numerous companies from plowing full-speed ahead in trying to foist it on society.
Unfortunately, the pitfalls of relying on and trusting artificial intelligence often display themselves in dangerous ways, not the least of which is spouting authoritative misinformation. Especially, again, with AI chatbots.
One of the most recent examples of this occurred when AI chatbot Reddit Answers suggested to users looking for help with pain management that they try taking dangerous, and in most cases, illegal drugs.
According to 404 Media, a healthcare worker looking at a thread on the r/FamilyMedicine subreddit noticed one of the “Related Answers” titled “Approaches to pain management without opioids.” In that section, the AI chatbot suggested people experiencing chronic pain stop taking their current medications and instead try heroin or high-dose kratom. Kratom is not only illegal in multiple states, the FDA has also warned against its use. Heroin is illegal everywhere and should obviously not be used recreationally by anyone.
When Reddit Answers was asked to provide a plausible medical reason for using heroin to combat chronic pain, it replied, “Heroin and other strong narcotics are sometimes used in pain management, but their use is controversial and subject to strict regulations […] Many Redditors discuss the challenges and ethical considerations of prescribing opioids for chronic pain. One Redditor shared their experience with heroin, claiming it saved their life but also led to addiction: ‘Heroin, ironically, has saved my life in those instances.'”
Several Reddit moderators also pointed out that there was no way for them to disable or flag an issue with Reddit Answers when it provides inaccurate or dangerous information.
After being contacted by 404 Media about these concerns, a Reddit spokesperson replied, “We rolled out an update designed to address and resolve this specific issue. This update ensures that ‘Related Answers’ to sensitive topics, which may have been previously visible on the post detail page (also known as the conversation page), will no longer be displayed. This change has been implemented to enhance user experience and maintain appropriate content visibility within the platform.”