Risk · R-130 · Third-Party & Supply Chain

Vendor reuse of organisation data

A provider uses the organisation's prompts, documents or outputs to train or improve its own models, or keeps and reviews them, beyond what the organisation intended.

Severity
High
Audience
Heads-of · Practitioner
Frameworks
Article 30 · Data Privacy · Chapter 6 · Article 5
Reviewed
2026-11-11

What it is

What an organisation sends to an AI provider is valuable to the provider as training material. Terms differ by provider, by product tier and over time: some exclude customer data from training by default, some include it unless the customer opts out, some permit human review of conversations for safety or quality. The risk is that data is reused under terms nobody read, or under terms that changed. Once data has been used to train a model it cannot practically be withdrawn.

How it happens

  • Staff use a consumer tier whose terms allow training on inputs.
  • The default setting permits reuse and nobody changed it.
  • The provider amends its terms and the notice goes unremarked.
  • A supplier passes data to its own model provider under different terms.

Why it matters

Confidential information may be learned by a model that competitors also use. For personal data, the organisation has enabled a new purpose with no lawful basis and no transparency. Contractual and professional duties of confidentiality to others may be breached.

Warning signs

  • Nobody can state the data-use terms for each AI provider.
  • Training opt-outs have not been checked in product settings.
  • Different teams use different tiers of the same product.
  • The contract permits the provider to change terms on notice.

Who owns it

The owner of the supplier relationship is accountable for the terms. Legal and the data protection officer review them. IT administrators apply the settings. Procurement tracks changes.

In practice

A law firm's staff use the free version of a transcription tool for meetings with the people it acts for. The tool's terms allow recordings to be used to improve the product. The same pattern generalises to any AI product adopted for its convenience before anyone read what it does with what it is given.

Mitigating controls

Primary controls

AI contract terms Directive
Prohibits or limits the provider's use of the organisation's data for training. Contracts with AI suppliers cover data use, change notification, information and audit rights, sub-contracting, incident notification, liability and exit.

Supporting controls

Prompt and context data loss prevention Preventive
Limits what reaches the provider at all. Prompts, uploads and retrieved context are inspected before they reach a model, and blocked, redacted or flagged where they contain personal or restricted data.
Third-party model and vendor due diligence Directive
Establishes the provider's default data practices before signing. Before an AI supplier, model or dataset is adopted, it is assessed against AI-specific criteria to a depth set by how material the use is, with evidence for the answers.

Framework and clause references

FrameworkClauseTitle
Digital Operational Resilience Act (DORA)Article 30Key contractual provisions Key contractual provisions.
NIST Generative AI Profile (NIST AI 600-1)Data PrivacyData Privacy The data privacy risk.
SS2/21: Outsourcing and Third-Party Risk ManagementChapter 6Outsourcing agreements Data terms in outsourcing agreements.
UK General Data Protection RegulationArticle 5Principles relating to processing of personal data Purpose limitation.

Sources

SS2/21: Outsourcing and Third-Party Risk Management Bank of England PRA · official text
NIST Generative AI Profile NIST · framework

Related terms

How to cite

Axiom Verity (2026). Vendor reuse of organisation data. Reference Library, R-130. https://axiom-verity.com/risks/vendor-reuse-of-organisation-data. Reviewed 2026-11-11.