Skip to content

Secrets & Shadows: Leveraging Big Data for Vulnerability Discovery

Bill Demirkapi

Scalable big-data pipeline and query methodologies to uncover zero-day vulnerabilities across millions of applications and endpoints.

Summary

Limitations of Conventional Target Scopes

When we consider the conventional approaches to vulnerability discovery, be it in software or websites, we tend to confine ourselves to a specific target or platform. In the case of software, we might reverse engineer an application's attack surfaces for untrusted input, aiming to trigger edge cases. For websites, we might enumerate a domain for related assets and seek out unpatched, less defended, or occasionally abandoned resources.

Building a Big Data Analysis Pipeline

This presentation explores the untapped potential of scaling security research by leveraging unconventional data sources. We'll walk through design flaws that enable two examples: forgotten cloud assets and leaked secrets. Instead of starting with a target and finding vulnerabilities, we'll find vulnerabilities and relate them to our targets. We won't just stop at discovery. We'll also discuss the incentives that create them and how to solve the ecosystem issues as an industry.

Automating Discovery Across Large Scale Datasets

While you can't easily scale every issue, this project has led to tens of thousands of highly significant yet seemingly trivial weaknesses in some of the world's largest organizations. Prepare to shift your perspective on vulnerability discovery, learn scalable approaches to address commonly overlooked bugs, and understand how even the simplest misconfiguration can have a devastating impact.

Related talks

Main Stage·20 min

  • DEF CON
  • Recon
  • Date: Aug 2025
  • Location: Las Vegas

HD Moore

Metasploit creator HD Moore introduces SSHamble, a state-machine-driven scanning and analysis tool to uncover obscure implementation flaws across SSH servers.

sshreconnetwork-scanning+2

Recon Village·16 min

  • DEF CON
  • Recon
  • Date: Aug 2021
  • Location: Las Vegas

Tushar Verma

Tushar Verma breaks down a structured reconnaissance methodology for bug bounty hunters, covering subdomain enumeration, content discovery, and asset tracking.

bug-bountyreconsubdomain-enumeration+2