SecurityAIIdentityRegulated Environments

When AI Becomes the Attacker's Intelligence Analyst

The consequential use of LLMs in cyberattacks may not be writing malware. It may be deciding which stolen identities matter, why, and what to do next.

CT
Cyblox Team
·
1 Nov 2026
·
5 min read

When people picture AI in a cyberattack, they often picture generated phishing emails or AI-written malware.

Those uses get attention because they are easy to see. But another use may be more consequential: giving an attacker a way to make sense of everything they have already stolen.

An infostealer can collect browser data, saved credentials, session artifacts, and personal information from many devices. Collecting it is one problem. Figuring out which records are worth pursuing is another.

That second job used to demand time and judgment. Someone had to sift through the noise, connect fragments of identity, and decide whether a particular account led anywhere valuable.

An LLM can now help do that sorting.

The shift is from using AI to create attack content to using AI to choose the target and shape the next move.


Stolen data is not the same as actionable intelligence

Imagine a dump containing thousands of browser profiles. One entry includes a personal email address, a work login, and an old VPN configuration.

On its own, none of that tells an attacker how valuable the person is. The work account could belong to a temporary contractor or an administrator with access to sensitive systems. The VPN profile might be obsolete. The session could be expired.

Historically, filtering those possibilities took human attention. That friction mattered. A criminal operation could steal far more data than it could carefully analyze.

LLMs change the economics of this stage. They can summarize messy records, group related accounts, identify likely roles from contextual clues, and rank leads for further investigation. Even imperfect assessments can help an operator decide which handful of records deserve a closer look.

The model does not need to be right every time to be useful. It needs to reduce the cost of finding the few entries that might pay off.


From credential theft to target appraisal

A stolen password answers a narrow question: what secret was present?

An attacker wants to answer broader questions:

  • Who does this identity appear to belong to?
  • What organizations and systems might they touch?
  • Do the artifacts suggest privileged access or a path into another environment?
  • Is there enough context to make a convincing follow-up attempt?

Personal and professional traces can become useful in combination. A delivery receipt is not a security credential. A job title is not an access grant. A saved connection is not proof of a working route. But taken together, such fragments can help an attacker form a hypothesis about the person behind the device.

That is why the emerging role of the LLM is closer to an intelligence analyst than a malware author. It turns a pile of artifacts into a shortlist of people, possible access paths, and questions to investigate next.

For a state agency, that distinction is especially important. Two exposed employees may look similar in a credential dump, while one supports a routine office workflow and the other has access spanning a public service, a vendor, and a county network. The attacker is looking for that difference.


The bottleneck moves from collection to selection

Infostealers already made data collection cheap and broad. AI makes selection cheaper.

This changes more than speed. It changes who can operate at scale. An attacker with limited expertise can use a model to organize unfamiliar technical artifacts and produce plausible leads. A more capable operator can use the same process to sift through a much larger volume of stolen material before investing human effort.

The result is not necessarily a fully autonomous attack. A model can hallucinate an access path, mistake an expired token for a live one, or infer authority from a job title that no longer applies. An operator still has to validate what works.

But that limitation does not erase the advantage. If AI makes the first pass cheap enough, the attacker can afford to investigate more candidates and discard the bad ones.

This is a familiar pattern in cybercrime: automation does not have to replace expertise to amplify it. It only has to remove the slowest part of the workflow.


What changes for the people being targeted

The risk is not just that more people receive generic phishing emails. It is that the attacker may arrive with a working theory of who a person is, what they do, and which access or relationships might be useful.

An exposed browser profile could inform a tailored approach to a privileged employee. A connection to a contractor could make a lower-profile identity more interesting than an executive. A collection of mundane personal details could make social engineering feel less generic.

None of these outcomes follows automatically from a stolen record. They depend on the quality of the data, whether access is still valid, and the attacker's ability to act. But the effort required to reach a plausible target hypothesis is falling.

That is the deeper change. AI is not only helping attackers write faster. It is helping them decide where to spend their time.

And when the scarce resource in an attack is human attention, making that decision cheaper can be as consequential as making the attack itself more sophisticated.

CT

Cyblox Team

The Cyblox team writes about infrastructure governance, security operations, and building regulated enterprise technology from India.

More posts