Risk · R-070 · Model & Application Security
AI-enabled social engineering of staff
Attackers use generated voice, video and text to impersonate executives, customers or suppliers convincingly enough to defeat staff verification.
- Severity
- High
- Audience
- Board · Heads-of · Practitioner
- Frameworks
- Principle 1 · AML.T0052 · AML.T0088
- Responsible AI domain
- Lifecycle stage
- Reviewed
- 2026-11-10
What it is
This is a risk from other people's AI. Generative tools produce fluent, personalised messages in any language, clone a voice from a short recording, and render a face in a live video call. The cues staff were trained to notice, such as poor grammar, an unfamiliar voice or reluctance to appear on camera, no longer indicate anything. Impersonation aimed at customers is covered separately under Generative Content.
How it happens
- A cloned voice of a senior executive telephones with an urgent payment instruction.
- A video call includes generated likenesses of known colleagues.
- Phishing messages are tailored to each recipient from public information.
- A supplier's writing style is imitated to change bank details.
Why it matters
Controls that depend on recognising a person are weakened across the organisation at once. Losses from a single successful impersonation can be large and are rarely recovered.
Warning signs
- Verification procedures accept voice or video as proof of identity.
- Payment or access changes can be authorised on one channel.
- Executives' voices and images are widely available.
- Staff training describes phishing as it looked several years ago.
Who owns it
The chief information security officer owns the threat and the awareness programme. Owners of payment and access processes are accountable for verification that does not depend on recognition.
In practice
A finance officer joins a video call with what appear to be the finance director and two colleagues, who ask for an urgent transfer to complete an acquisition. Everyone else on the call is generated. The same pattern generalises to any process in which seeing or hearing someone is treated as authentication.
Mitigating controls
Primary controls
- Deepfake-resistant verification Preventive
- Removes reliance on voice, image or video alone for identity and instructions. Identity and instruction verification never rests on voice, image or video alone, and high-value actions require confirmation through a separate, pre-agreed channel.
Supporting controls
- AI incident classification and playbooks Corrective
- Gives responders a defined path when an impersonation is suspected. The kinds of AI failure are defined in the incident process with severity criteria, each has a playbook, and responders are trained and exercised in using them.
- Role-based AI training Directive
- Staff learn to expect convincing synthetic impersonation. Reviewers, developers, risk and assurance staff, approvers and front-line teams receive training specific to their AI responsibilities, with competence assessed and completion tracked.
Framework and clause references
| Framework | Clause | Title |
|---|---|---|
| Code of Practice for the Cyber Security of AI | Principle 1 | Raise awareness of AI security threats and risks Awareness of AI-enabled threats. |
| MITRE ATLAS | AML.T0052 | Phishing Phishing assisted by generative AI. |
| MITRE ATLAS | AML.T0088 | Generate Deepfakes Generation of deepfakes. |
Sources
- MITRE ATLAS MITRE · framework
Related terms
How to cite
Axiom Verity (2026). AI-enabled social engineering of staff. Reference Library, R-070. https://axiom-verity.com/risks/ai-enabled-social-engineering. Reviewed 2026-11-10.
Found an error or a better source? Report a correction.