AI Prescription Autonomy — Utah's Automated Refill Program and Broader Autonomy Questions
CONCEPTUtah's healthcare AI sandbox has approved AI systems to write prescriptions with varying degrees of human physician involvement, creating a real-world experiment in AI clinical autonomy. August AI's FDA-authorized prescription renewal system and Nolla Health's AI-issued acne prescriptions represent the frontier of autonomous clinical decision-making. The autonomy spectrum in Utah's pilots: (1) AI-assisted renewals where AI proposes and physician approves, (2) AI-issued renewals for routine medications where physician reviews post-issuance, and (3) AI-issued initial prescriptions for limited conditions (acne) without direct physician review. These pilots raise fundamental questions about clinical liability, accountability, and the appropriate role of AI in prescribing decisions. When an AI system issues a prescription that results in patient harm, who is liable? The vendor? The health system? The AI system's developers? Current legal frameworks provide limited guidance. Third-party auditing, which Utah has added to its expanded sandbox framework, represents an attempt to bridge the accountability gap. Independent evaluation of AI system safety claims could provide validation that pure vendor claims cannot. However, the adequacy of third-party auditing as a governance mechanism remains unproven. ---
Subscribe to read full wiki analysis
Full wiki content — including source provenance, contradiction tracking, related pages, and analyst notes — is available to Subscriber members.
View Plans & SubscribeNew users get a 7-day trial — no credit card required.