Dr. Sean Kelly of Imprivata stated that an autonomous AI agent with excessive permissions could access sensitive patient information, enter incorrect medical record data, or alter medication dosages.

Overview Debates Related claims Topics Sources

In 2021, NHS England raised serious patient safety concerns regarding Oxevision's usage and capability claims with the Medicines and Healthcare products Regulatory Agency.

Lio Health head of patient safety Laura Cozens stated at the Lampard Inquiry that Oxevision technology assists staff in critical safety interventions and should not be deemed unsafe.

Epic Systems chief security officer Stirling Martin participated in Anthropic's Project Glasswing program to test how attackers could utilize open-source artificial intelligence agents to access confidential health records.

A report by the European Academies Science Advisory Council and the Federation of European Academies of Medicine recommended that high-risk artificial intelligence systems in healthcare remain under strict human supervision.

Pope Leo XIV published the encyclical Magnifica Humanitas in May 2026 calling for artificial intelligence to serve human dignity, social justice, and vulnerable populations.

Epic Systems identified software flaws in certain MyChart configurations that could allow unauthorized individuals to view patient records without appearing in audit logs, using Anthropic's Claude Mythos model.

US regulatory guidance OCC Bulletin 2026-13, issued jointly by the OCC, Federal Reserve Board, and FDIC on April 17, 2026, explicitly excluded generative and agentic AI models from its scope.

The American Medical Association's framework focuses on four questions covering clinical functions, evidence of performance, conditions of permission, and risk accountability.

The Financial Stability Board declined to framing AI systems as synthetic employees, citing concerns that the analogy obscures unpredictable autonomous decisions.

The American Medical Association released a new governance framework on October 15, 2026, to guide the safe deployment of agentic AI assuming clinical functions in healthcare.

Bank of England Governor Andrew Bailey described frontier AI threat capabilities as the most immediate cyber risk facing global financial systems in an August 31, 2026 letter.

In a survey of 250 U.S. healthcare leaders, 28% reported deploying agentic AI tools and 72% reported that agentic AI is occasionally implemented without IT approval.

In a survey of 250 U.S. healthcare leaders, 44% of respondents reported conducting pilots or proof-of-concept projects with agentic AI tools.

A Department for Education spokesperson stated the UK government is developing screen-time guidance for children aged five to 18 and consulting on artificial intelligence and edtech safety.

Suki plans to use its Series E funding to develop autonomous AI agents to manage post-visit healthcare tasks including referrals, prior authorizations for new medications, filling orders, and scheduling follow-ups.

Suki's planned AI agents will utilize clinical information gathered from the company's existing documentation and point-of-care tools to execute post-visit healthcare tasks.

Suki plans to use its Series E funding to deepen integration with its more than 30 existing health technology partners, including Optum, Zoom, and athenahealth, by embedding new AI agent capabilities.

The risk of clinician deskilling outweighs the efficiency gains of diagnostic AI tools

The Lancet series authors call for coordinated international regulation of technology business models, safety standards for platform design, and independent oversight of AI harms to youth.

Autonomous AI prescription renewals pose an unacceptable risk to patients with chronic conditions