They Deployed Health AI on Us: We’re Bringing the Rights & Red Teams
Introduces the Patient AI Rights framework and a community-driven red teaming methodology to stress test clinical AI models and chatbots for bias and failure modes.
Summary
Deployment of AI in Clinical Healthcare
Artificial intelligence models, diagnostic algorithms, and clinical chatbots are rapidly being deployed across healthcare environments. However, many systems enter clinical workflows without rigorous independent testing, patient consent, or comprehensive algorithmic auditing.
The Patient AI Rights Framework
The Patient AI Rights Initiative establishes a patient-authored ethical framework defining core rights regarding health data privacy, algorithmic transparency, and protection against automated clinical harm.
Community Red Teaming for Health AI
Applying offensive security testing methodologies to healthcare AI involves systematically evaluating models for failure modes, algorithmic bias, prompt injection vulnerabilities, and unauthorized data leakage from patient records.
Building an Open-Source Health AI Red Team Toolkit
Developing community-driven evaluation toolkits empowers security researchers, bioethicists, and patient advocates to audit clinical AI implementations and advocate for robust safety guardrails.
Related talks
Creator Stage·26 min
Patrick Walsh · Bob Wall
Explains embedding inversion attacks against generative AI vector databases and introduces open-source vector encryption for private search.
Biohacking Village·26 min
Mixæl Laufer
Four Thieves Vinegar Collective founder Mixæl Laufer shares open-source medicine projects, decentralized hardware, and grassroots biohacking initiatives.
Biohacking Village·30 min
Michelle Holko
Explores digital health data collection and privacy considerations within the NIH All of Us Research Program.


