AegisAI Perspectives · 017

How does generative AI phishing make threat actors' emails more convincing?

Threat actors use generative AI to write error-free, personal phishing lures, copy executives and send one template to many organizations, the data shows.

How does generative AI phishing make threat actors' emails more convincing?

In generative AI phishing, threat actors use language models to write error-free, personal lures and send one template to many organizations. AegisAI's Q3 2026 State of the AI Attack report found phishing rose 49% this quarter1.

AegisAI reads each message for what it asks the reader to do and where its links lead. The FBI warns that criminals use AI-generated text to appear believable to a reader in furtherance of social engineering12. The same report counts the AI-written slice of confirmed phishing: AI Dragnet attacks grew their share 11.6x in one quarter2.

What you can do by the end

  • Separate what FBI reports, the Verizon DBIR and production mail data each measure about AI in phishing.
  • Check an AI-written lure for the signals that clean grammar does not hide.
  • Explain how a mail system flags AI-written phishing and how fast that share grew.

How does generative AI phishing work, step by step?

A generative AI phishing campaign runs in six steps, and AI does the work in the first four. Each step below names the header, protocol or request type it touches.

  1. Profile the target.

    An AI agent collects the target's name and role from public pages and writes them into the greeting and the Subject line. In one lab study, the AI-gathered information was accurate and useful in 88% of cases22.

  2. Translate and clean the text.

    Criminals use generative AI tools to assist with language translations to limit grammatical or spelling errors14. Both MIME parts of the message, plain text and HTML, then read cleanly.

  3. Copy an official voice.

    Chat generators can quickly create official-sounding emails mimicking a company's CEO or other officials17. The From display name is set to match that person.

  4. Write one template and send it wide.

    AI Dragnet attacks blast one AI-written template at as many organizations as possible. The FBI notes that criminals create messages faster, which lets them reach a wider audience with believable content13.

  5. Send from a hijacked account.

    AI Dragnet attacks from hijacked accounts went from 0.2% to 7.7%, 38x more3. Mail sent from a real mailbox on its own domain passes SPF, DKIM and DMARC, which is why DMARC-passing emails can still be phishing.

  6. Ask for one action.

    The lure asks for a login, a reply or a change to payment details, the pattern of business email compromise (BEC). In 2025, businesses reported losses over $30 million to BEC scams involving AI16.

Steps 2 to 4 remove the spelling mistakes and odd phrasing that readers once used to spot a fake. Steps 5 and 6 decide whether the message gets through and what it costs.

How AegisAI handles this

AegisAI gives each inbox one agent, and four specialists read every message to reach one explainable verdict10. The phishing prevention page explains how each message is investigated: every link, file and QR code is opened in a sandbox, followed to the end and judged on what it finds there9. Redirect chains are followed hop by hop in an isolated browser, and the chain is recorded in the verdict11.

What does an AI-written lure still give away?

The request and the link destination still give it away, and so does the template behind the text. The Q3 2026 report scores each confirmed message on stylistic signals common in language-model output, plus hard artifacts such as unfilled template placeholders6.

Check these signals on any message that asks for money, a login or a file:

  • A placeholder left in the text. A greeting or field that was never filled is a hard artifact of a template.
  • The same body at many organizations. One template sent to as many organizations as possible is the AI Dragnet pattern. Search the subject line across your tenant and ask partners whether they received it.
  • A known sender with a new request. A supplier or colleague who has never asked for a bank change before is the profile of a hijacked account.
  • A link that lands somewhere new. Open the destination in an isolated browser and compare it with the brand the text names.
  • A payment or credential request with no second channel. The FBI advises hanging up, researching the contact of the organization and calling the number directly25.

What AI Dragnet phishing is and why mass AI email is harder to detect covers the template pattern in more detail.

What do the numbers show about generative AI phishing?

Production mail data and FBI complaint data both show growth, and they count different things. The Q3 2026 report counts confirmed phishing in more than 100 million emails sent to over 1 million mailboxes, from July 1 to September 2, 20265. The FBI's IC3 counts complaints in which victims reported AI-related information15. A lab study counts clicks from people who agreed to take part21.

What is measuredFigureWho measured itFact
Change in phishing, Q3 2026Rose 49%Q3 2026 State of the AI Attack report
AI Dragnet share of confirmed phishing0.5% to 5.8%, 11.6xQ3 2026 State of the AI Attack report
AI Dragnet attacks from hijacked accounts0.2% to 7.7%, 38xQ3 2026 State of the AI Attack report
Mail behind the reportMore than 100 million emails, over 1 million mailboxesQ3 2026 State of the AI Attack report
Complaints reporting AI-related information, 2025More than 22,000FBI IC3 2025 annual report
Business losses to BEC scams involving AI, 2025Over $30 millionFBI IC3 2025 annual report
Click-through on fully AI-automated phishing, 101 participants54%, against 12% for the control groupResearch study, arXiv 2412.00586

Read the rows by what each source sees. The report sees mail that reached protected mailboxes. The IC3 sees what victims chose to report. For the wider set of figures with their sources, see email threat statistics for 2026 with sources.

What does one AI-written campaign look like in a mailbox?

One campaign shows every step above in a single message.

Illustrative example, figures are fictional. Harbor Lane Logistics runs 640 mailboxes. On a Tuesday, 212 of them receive the same invoice reminder from a supplier's real mailbox, taken over by an attacker the week before. The message passes sender authentication because it comes from the supplier's own domain. The English is clean and the tone matches the supplier's account manager. The payment link points to a page registered two days earlier. One copy still opens with "Hi [First Name]", a template field that was never filled. The security team searches the subject line and finds the same body at 3 partner firms. They pull all 212 copies and call the supplier on the number in the contract, who confirms the account was hijacked. Two users had clicked, and both reset their passwords within the hour.

What is generative AI phishing, and why is 2026 an inflection point?

Generative AI phishing is phishing whose text a language model writes, edits or translates, and 2026 is the year that share became measurable in production mail. AI Dragnet attacks went from 0.5% to 5.8% of confirmed phishing in one quarter. Those sent from hijacked accounts went from 0.2% to 7.7%.

Primary sources describe the same shift. Verizon's 2026 Data Breach Investigations Report says threat actors use AI to work faster at every stage, from spotting security gaps to writing malware19.

Which attack vectors come with it, from prompt injection and deepfakes to AI detection bypass?

Three vectors travel with AI-written email: cloned voices that back up the message, hidden text aimed at AI assistants, and clean text that removes the old spelling cues. Each one needs its own check.

Deepfakes. The FBI warns that criminals can use AI-generated audio to impersonate well-known, public figures or personal relations to elicit payments24. A call that confirms an email request proves nothing on its own. Call back on a number you already hold.

Prompt injection. An email can carry instructions written for the AI assistant that summarizes the inbox. How prompt injection reaches the AI assistant reading your inbox walks through the mechanism.

AI detection bypass. Generative AI limits grammatical and spelling errors, so any check that leaned on those errors loses its signal. The report's method scores stylistic signals and template artifacts instead.

What do real-world generative AI phishing examples and data show?

They show AI-written lures perform as well as expert ones and now appear in reported losses. In the 101-person study, fully AI-automated phishing emails reached a 54% click-through rate, on par with human experts, against 12% for the control group.

A second study found LLM-generated lateral phishing emails as effective as those written by communications professionals23. In 2025, the IC3 received more than 22,000 complaints reporting AI-related information. One documented case is how a Midnight Blizzard-linked actor automated device code phishing with AI.

How do you avoid generative AI phishing?

Judge each message by its request, and confirm every payment or credential request on a second channel. Grammar and tone no longer separate real mail from fake.

  • Verify out of band. Hang up, research the contact of the organization and call the number directly.
  • Hold payment changes. Route any change to bank details through a call-back to a number already on file, because AI-written BEC targets that step.
  • Search for the template. When one user reports a lure, search the subject line and body across the tenant, because AI Dragnet sends one template widely.
  • Retrain on current lures. Replace spelling-error examples in awareness training with clean, personal ones like those in the study.

How much AI phishing reaches the inbox and how many people click shows where the misses sit.

How to measure it in 30 days

Track three numbers for 30 days and compare them with the report's quarter.

  • Reported lures that carry a template artifact. Count user reports with an unfilled placeholder or a body seen at another organization. They live in your reporting mailbox. Compare the share with the AI Dragnet share of 5.8%.
  • Payment or credential requests verified by call-back. Count them in the finance team's change log. Any change made without a call-back is a gap in step 6.
  • Copies of one campaign pulled per report. Count them in your message trace or investigation tool. A count above one means the template reached several users, the AI Dragnet pattern.

Questions people ask

What is AI-based phishing?

AI-based phishing is phishing whose text, translation or targeting is produced with generative AI. The FBI says criminals use AI-generated text to appear believable to a reader. AI Dragnet is one form: one AI-written template sent to as many organizations as possible.

Can you provide some examples of AI phishing attacks?

Yes. AI Dragnet sends one AI-written template widely and grew 11.6x in share in one quarter. Hijacked-account versions rose from 0.2% to 7.7%. The IC3 describes chat generators that create official-sounding emails mimicking a company's CEO.

How are threat actors using generative AI to write more convincing phishing emails?

They profile targets and remove grammar errors. They copy an executive's voice and send one template to many organizations. In a 101-person study, fully AI-automated emails reached a 54% click-through rate.

Can staff still spot generative AI phishing by its spelling?

Not by spelling alone. Criminals use generative AI to limit grammatical or spelling errors. Teach staff to check what the message asks for and where its link leads. Before any payment change, they call back on a known number.

How does a mail system tell an email was written by AI?

The Q3 2026 report's classifier scores each confirmed message on stylistic signals common in language-model output. It also looks for hard artifacts such as unfilled template placeholders.

What data is the Q3 2026 report based on?

It is based on more than 100 million emails sent to over 1 million mailboxes, from July 1 to September 2, 2026. It found phishing rose 49% in the quarter.

Sources

  1. AegisAI Q3 2026 State of the AI Attack Report
  2. Phishing Prevention: Link, Attachment and QR Detonation, AegisAI
  3. Criminals Use Generative Artificial Intelligence to Facilitate Financial Fraud, FBI IC3 PSA I-120324-PSA
  4. IC3 2025 Annual Report, FBI
  5. 2026 Data Breach Investigations Report, Verizon
  6. Evaluating Large Language Models' Capability to Launch Fully Automated Spear Phishing Campaigns: Validated on Human Subjects, arXiv 2412.00586
  7. Lateral Phishing With Large Language Models: A Large Organization Comparative Study, arXiv 2401.09727

Recent posts

Every email, investigated.