Risk · R-130 · Third-Party & Supply Chain
Vendor reuse of organisation data
A provider uses the organisation's prompts, documents or outputs to train or improve its own models, or keeps and reviews them, beyond what the organisation intended.
- Severity
- High
- Audience
- Heads-of · Practitioner
- Frameworks
- Article 30 · Data Privacy · Chapter 6 · Article 5
- Responsible AI domain
- Lifecycle stage
- Reviewed
- 2026-11-11
What it is
What an organisation sends to an AI provider is valuable to the provider as training material. Terms differ by provider, by product tier and over time: some exclude customer data from training by default, some include it unless the customer opts out, some permit human review of conversations for safety or quality. The risk is that data is reused under terms nobody read, or under terms that changed. Once data has been used to train a model it cannot practically be withdrawn.
How it happens
- Staff use a consumer tier whose terms allow training on inputs.
- The default setting permits reuse and nobody changed it.
- The provider amends its terms and the notice goes unremarked.
- A supplier passes data to its own model provider under different terms.
Why it matters
Confidential information may be learned by a model that competitors also use. For personal data, the organisation has enabled a new purpose with no lawful basis and no transparency. Contractual and professional duties of confidentiality to others may be breached.
Warning signs
- Nobody can state the data-use terms for each AI provider.
- Training opt-outs have not been checked in product settings.
- Different teams use different tiers of the same product.
- The contract permits the provider to change terms on notice.
Who owns it
The owner of the supplier relationship is accountable for the terms. Legal and the data protection officer review them. IT administrators apply the settings. Procurement tracks changes.
In practice
A law firm's staff use the free version of a transcription tool for meetings with the people it acts for. The tool's terms allow recordings to be used to improve the product. The same pattern generalises to any AI product adopted for its convenience before anyone read what it does with what it is given.
Mitigating controls
Primary controls
- AI contract terms Directive
- Prohibits or limits the provider's use of the organisation's data for training. Contracts with AI suppliers cover data use, change notification, information and audit rights, sub-contracting, incident notification, liability and exit.
Supporting controls
- Prompt and context data loss prevention Preventive
- Limits what reaches the provider at all. Prompts, uploads and retrieved context are inspected before they reach a model, and blocked, redacted or flagged where they contain personal or restricted data.
- Third-party model and vendor due diligence Directive
- Establishes the provider's default data practices before signing. Before an AI supplier, model or dataset is adopted, it is assessed against AI-specific criteria to a depth set by how material the use is, with evidence for the answers.
Framework and clause references
| Framework | Clause | Title |
|---|---|---|
| Digital Operational Resilience Act (DORA) | Article 30 | Key contractual provisions Key contractual provisions. |
| NIST Generative AI Profile (NIST AI 600-1) | Data Privacy | Data Privacy The data privacy risk. |
| SS2/21: Outsourcing and Third-Party Risk Management | Chapter 6 | Outsourcing agreements Data terms in outsourcing agreements. |
| UK General Data Protection Regulation | Article 5 | Principles relating to processing of personal data Purpose limitation. |
Sources
- SS2/21: Outsourcing and Third-Party Risk Management Bank of England PRA · official text
- NIST Generative AI Profile NIST · framework
Related terms
How to cite
Axiom Verity (2026). Vendor reuse of organisation data. Reference Library, R-130. https://axiom-verity.com/risks/vendor-reuse-of-organisation-data. Reviewed 2026-11-11.
Found an error or a better source? Report a correction.