Can AI models find software security holes faster than people?
In 2026 two AI labs held back their most capable cyber models, and an independent test found one headline bug was also spotted by eight open-source models.
Guess first
?
Which one is it?
Some AI models are now good at finding software security holes, but how much faster than people is disputed and depends on who measured it. A security hole, called a , is a bug that creates a security risk. Patches fix known ones, but unknown ones, called , can still be exploited.
Step 1: A bug creates a security risk
Called a .
Step 2: Someone finds it
A person, or increasingly an AI model.
Step 3: A is written and rolled out
Step 4: Risk peaks just after disclosure
Attackers can build faster than patches spread.
In April 2026, Anthropic said it was not releasing its Claude Mythos Preview model to the public, citing its ability to find software vulnerabilities, and gave some companies access to scan critical software. In June 2026 it released a related model for general use with safeguards that, according to the company, hand flagged cybersecurity requests to a less capable model. Two weeks after that limited release, Mozilla announced it had found and patched 271 security vulnerabilities in Firefox using the model. According to an encyclopedia account, Mozilla engineers also wrote that a few months earlier AI-generated bug reports had mostly been unwanted slop.
Not everyone agrees on what the numbers mean. Anthropic said the model found vulnerabilities in every major operating system and browser, but an independent security researcher cast doubt, saying the claims could not be verified outside promotional documents. Another independent test found that one of the headline vulnerabilities was also found by 8 of 8 tested models.
The same skill can be used to attack. In 2026, according to an encyclopedia account, a financially motivated actor used AI agents to automate an attack campaign against online retailers. Because attackers can build faster than a is rolled out, defenders and attackers are in a race, and both sides are using AI.
Quiz me
0/3
Recap
Treat big AI-security numbers as dated claims: who measured, how, and could anyone check?
💡 A trick to remember it · Finding a hole is only half the race; the other half is who patches first.
Surprising fact · Mozilla said it found and patched 271 Firefox vulnerabilities using a restricted AI model.
Connects to
- 🕵️ Why do companies pay people to break into them?
- 🕳️ What is a software vulnerability, and why does every program have some?
- 🤖 What turns a chatbot into an AI agent?
- 🕳️ What is a zero-day, and why do companies pay hackers to find bugs?
- 💬 How does a large language model write a sentence, one piece at a time?
Sources (4)
No source, no claim. Every fact in this lesson (14 claims) cites at least one of these.