The American Medical Association (AMA) released a governance framework for safe and effective use of AI agents in healthcare. The framework says agents performing clinical functions must be supported by evidence and maintain high-quality performance. It sets out four questions about which tasks an AI tool should perform, under what conditions, what evidence supports its capability and what happens if it fails, and who is accountable for its risks and outcomes.

The AMA says the framework will guide its work with other organizations as AI agents are used in clinical care, including ambient documentation, diagnostics and patient monitoring. Because these systems can complete complex, multi-step tasks autonomously without human oversight, inaccurate or biased decisions could harm patients before a clinician intervenes. The AMA says physicians should remain central to the technology’s development and deployment. The framework states that evidence, authority, oversight and accountability must remain aligned in service of better patient care.

A survey of 250 U.S. healthcare leaders found that about 28% said their organization had deployed agentic AI tools, while 44% reported pilots or proof-of-concept projects. A majority expected the technology to have a “transformative” impact on clinical workflows. Meanwhile, 72% said the tools are occasionally implemented without IT approval. More than half cited potential compliance or regulatory violations and unauthorized access to protected health information as major concerns.

Federal AI regulation remains limited, while states have adopted differing approaches to AI-based care. According to legal and consulting firm Manatt, 47 states introduced over 250 AI bills affecting healthcare in 2025.

The American Medical Association (AMA) released a governance framework for safe and effective use of AI agents in healthcare. The framework says agents performing clinical functions must be supported by evidence and maintain high-quality performance. It sets out four questions about which tasks an AI tool should perform, under what conditions, what evidence supports its capability and what happens if it fails, and who is accountable for its risks and outcomes.

The AMA says the framework will guide its work with other organizations as AI agents are used in clinical care, including ambient documentation, diagnostics and patient monitoring. Because these systems can complete complex, multi-step tasks autonomously without human oversight, inaccurate or biased decisions could harm patients before a clinician intervenes. The AMA says physicians should remain central to the technology’s development and deployment. The framework states that evidence, authority, oversight and accountability must remain aligned in service of better patient care.

A survey of 250 U.S. healthcare leaders found that about 28% said their organization had deployed agentic AI tools, while 44% reported pilots or proof-of-concept projects. A majority expected the technology to have a “transformative” impact on clinical workflows. Meanwhile, 72% said the tools are occasionally implemented without IT approval. More than half cited potential compliance or regulatory violations and unauthorized access to protected health information as major concerns.

Federal AI regulation remains limited, while states have adopted differing approaches to AI-based care. According to legal and consulting firm Manatt, 47 states introduced over 250 AI bills affecting healthcare in 2025.