Provider Groups Urge FDA to Hold Tech Developers Accountable for Generative AI Medical Devices

Medical provider organizations are actively lobbying the United States Food and Drug Administration to shift regulatory responsibility for generative artificial intelligence medical devices away from clinicians and directly onto the technology companies that build them.

The Argument for Developer Accountability

According to provider groups, the developers and manufacturers of artificial intelligence tools are uniquely positioned and best equipped to thoroughly evaluate the safety, accuracy, and overall performance of their products. Rather than placing the burden of validation on frontline healthcare providers, advocacy groups argue that the liability for algorithmic flaws should remain with the creators of the software.

Challenges in Clinical Settings

As health systems increasingly adopt artificial intelligence applications to assist with diagnostics, documentation, and administrative workflows, clinicians face growing challenges in vetting complex algorithms. Provider organizations emphasize that healthcare professionals lack the specialized technical resources required to audit underlying code and detect sophisticated generative errors, making developer-led oversight a critical safety necessity.

• Technology developers possess the technical expertise to evaluate generative models.
• Clinicians face significant challenges in auditing complex artificial intelligence software.
• Regulatory frameworks must adapt to address emerging software-as-a-medical-device technologies.