Risk · R-070 · Model & Application Security

AI-enabled social engineering of staff

Attackers use generated voice, video and text to impersonate executives, customers or suppliers convincingly enough to defeat staff verification.

Severity
High
Audience
Board · Heads-of · Practitioner
Frameworks
Principle 1 · AML.T0052 · AML.T0088
Lifecycle stage
Reviewed
2026-11-10

What it is

This is a risk from other people's AI. Generative tools produce fluent, personalised messages in any language, clone a voice from a short recording, and render a face in a live video call. The cues staff were trained to notice, such as poor grammar, an unfamiliar voice or reluctance to appear on camera, no longer indicate anything. Impersonation aimed at customers is covered separately under Generative Content.

How it happens

  • A cloned voice of a senior executive telephones with an urgent payment instruction.
  • A video call includes generated likenesses of known colleagues.
  • Phishing messages are tailored to each recipient from public information.
  • A supplier's writing style is imitated to change bank details.

Why it matters

Controls that depend on recognising a person are weakened across the organisation at once. Losses from a single successful impersonation can be large and are rarely recovered.

Warning signs

  • Verification procedures accept voice or video as proof of identity.
  • Payment or access changes can be authorised on one channel.
  • Executives' voices and images are widely available.
  • Staff training describes phishing as it looked several years ago.

Who owns it

The chief information security officer owns the threat and the awareness programme. Owners of payment and access processes are accountable for verification that does not depend on recognition.

In practice

A finance officer joins a video call with what appear to be the finance director and two colleagues, who ask for an urgent transfer to complete an acquisition. Everyone else on the call is generated. The same pattern generalises to any process in which seeing or hearing someone is treated as authentication.

Mitigating controls

Primary controls

Deepfake-resistant verification Preventive
Removes reliance on voice, image or video alone for identity and instructions. Identity and instruction verification never rests on voice, image or video alone, and high-value actions require confirmation through a separate, pre-agreed channel.

Supporting controls

AI incident classification and playbooks Corrective
Gives responders a defined path when an impersonation is suspected. The kinds of AI failure are defined in the incident process with severity criteria, each has a playbook, and responders are trained and exercised in using them.
Role-based AI training Directive
Staff learn to expect convincing synthetic impersonation. Reviewers, developers, risk and assurance staff, approvers and front-line teams receive training specific to their AI responsibilities, with competence assessed and completion tracked.

Framework and clause references

FrameworkClauseTitle
Code of Practice for the Cyber Security of AIPrinciple 1Raise awareness of AI security threats and risks Awareness of AI-enabled threats.
MITRE ATLASAML.T0052Phishing Phishing assisted by generative AI.
MITRE ATLASAML.T0088Generate Deepfakes Generation of deepfakes.

Sources

MITRE ATLAS MITRE · framework

Related terms

How to cite

Axiom Verity (2026). AI-enabled social engineering of staff. Reference Library, R-070. https://axiom-verity.com/risks/ai-enabled-social-engineering. Reviewed 2026-11-10.