Fawkes: Facial Recognition Privacy Protection
Examines Fawkes, an image cloaking tool that adds pixel-level perturbations to photos to deceive facial recognition models.
Summary
In this community discussion from the DEF CON Safe Mode AI Village, researchers and participants explore Fawkes, an adversarial machine learning privacy framework developed by the University of Chicago to counter unauthorized facial recognition surveillance. Opening at 00:01, the panel introduces the software's mission to protect individuals against mass scraping by commercial facial recognition vendors.
At 02:00, the speakers explain the concept of "adversarial examples for good," showing how Fawkes introduces imperceptible pixel-level perturbations ("cloaks") into portrait photos. These perturbations shift internal feature representations in deep neural networks, causing facial recognition models to incorrectly classify the subject without distorting the image for human viewers.
At 15:00 and 39:00, the panel evaluates the system's real-world resilience, analyzing how cloaked images poison training pipelines when scraped from public social media profiles. The session concludes by discussing model transferability, perturbation boundaries, and defensive countermeasures against image pre-filtering. (AI summary — Gemini Flash)
Related talks
Main Stage·46 min
Bill Swearingen
Bill Swearingen explores whether adversarial patterns printed on everyday clothing can effectively fool commercial and municipal facial recognition algorithms.
RSAC Cybersecurity·47 min
Security researchers examine technical aspects of In Your Face! The Privacy and Security Implications from Facial Recognition.
AI Village·43 min
Jason Mancuso
Privacy risks and implications of machine learning models trained on sensitive data.


