For Heads-of · Practitioner
Fine-Tuning
The process of adapting a pre-trained model to a specific task or domain by training it on a smaller, task-specific dataset.
- fine-tuning
- model adaptation
- training
- customization
Process
Start with a model already trained on broad data, then train it further on domain-specific examples. Requires far less data and compute than training from scratch.
Use Cases
Adapting a general LLM for legal document analysis, medical coding, specific writing styles, or proprietary business language.
Governance Implications
Fine-tuning introduces new risks: the fine-tuning dataset may encode bias, and the model may forget safety guardrails from base training. Quality of fine-tuning data is critical.