Experts call for licensing framework as Utah pauses AI chatbot prescription program

Alon Bergman, an assistant professor of medical ethics at the University of Pennsylvania, argues that AI-driven medical tools need a licensing system. He points to Utah’s recent pilot with the AI company Doctronic, which allowed a chatbot to assess patients and suggest prescription renewals for about 200 chronic-condition drugs.

The Utah Medical Licensing Board moved to suspend the pilot after learning of its launch, warning that proceeding without proper clinical oversight could put citizens at risk.

Bergman notes that at least 47 states are debating more than 250 bills on clinical AI, creating a fragmented regulatory landscape covering bias audits, payment rules, and patient consent. Meanwhile, the FDA’s device-approval pathway was designed for static software and struggles to handle continuously learning AI systems.

He proposes a national licensing framework that would set clear standards for AI doctors and calls on federal authorities to take the lead, rather than relying on a patchwork of state rules.