Risk · R-147 · Intellectual Property & Legal Liability

Infringing AI outputs

Generated text, code or images reproduce protected material, and the organisation publishes, sells or ships them.

Severity
High
Audience
Heads-of · Practitioner
Frameworks
Article 53 · Intellectual Property
Responsible AI domain
Reviewed
2026-11-11

What it is

A model can reproduce what it was trained on: a passage of a book, a distinctive image, a block of source code with its licence terms removed. It can also produce work in the recognisable style of a living artist, or featuring a protected character or trade mark. The user usually cannot tell. The organisation that then publishes the image, ships the code or prints the text is the one that has copied, whatever the provider's role. Memorisation as a privacy matter is covered in training data memorisation and regurgitation.

How it happens

  • A prompt asks for content in the manner of a named work or creator.
  • A code assistant emits a substantial fragment of an open source project.
  • Marketing uses a generated image containing a recognisable character or logo.
  • Nobody checks generated material for similarity before release.

Why it matters

Infringement does not depend on intent. Copied code under a reciprocal licence can place obligations on the product that contains it. Takedown, reprinting or recall is costly, and a claim against published work is public.

Warning signs

  • Generated assets are used commercially with no similarity check.
  • Code assistants are used with reference filters switched off.
  • Prompts in use name specific artists, authors or brands.
  • The provider's terms place responsibility for outputs on the customer.

Who owns it

The owner of the published work or product is accountable. Legal sets the review standard. Engineering applies similarity and licence scanning to generated code.

In practice

A games studio generates background art with an image model. One piece closely reproduces a well-known illustration, signature fragment included. It ships in the release build. The same pattern generalises to any commercial use of generated material that nobody compared with what already exists.

Mitigating controls

Primary controls

Intellectual property and licence clearance Preventive
Reviews significant outputs for protected material before release. Training data, models, components and significant outputs are checked for rights and licence terms before they are used, published or shipped.

Supporting controls

AI contract terms Directive
Secures provider indemnity for outputs. Contracts with AI suppliers cover data use, change notification, information and audit rights, sub-contracting, incident notification, liability and exit.
AI incident classification and playbooks Corrective
Covers takedown and notification when infringement is found. The kinds of AI failure are defined in the incident process with severity criteria, each has a playbook, and responders are trained and exercised in using them.
Output validation and guardrails Preventive
Filters outputs closely matching known works. Every model output is validated against a schema and sanitised by deterministic code before any downstream system, tool or user interface acts on it.
Review of AI-generated code Detective
Checks generated code for copied or licence-encumbered material. Code produced with an AI assistant passes the same human review, security scanning and dependency checks as any other code before it is merged.

Framework and clause references

FrameworkClauseTitle
EU AI ActArticle 53Obligations for providers of general-purpose AI models Providers' copyright duties bear on output risk.
NIST Generative AI Profile (NIST AI 600-1)Intellectual PropertyIntellectual Property The intellectual property risk.

Sources

EU AI Act: Regulation (EU) 2024/1689 European Union (EUR-Lex) · official text
NIST Generative AI Profile NIST · framework

How to cite

Axiom Verity (2026). Infringing AI outputs. Reference Library, R-147. https://axiom-verity.com/risks/infringing-ai-outputs. Reviewed 2026-11-11.