Fine-tuning is the process of taking a pre-trained machine learning model and training it further on a smaller, task- or domain-specific dataset so that it performs better for a particular purpose. Unlike training a model from scratch, fine-tuning starts with an existing model that has already learned general patterns.
Fine-tuning can adapt a model to specific behaviours, terminology, writing styles, domains, or tasks. It is commonly used with language, vision, and other generative models where the base model already provides general capabilities but needs additional training for a particular use case.
From a testing perspective, fine-tuning introduces a key challenge: improving performance on the target task does not necessarily mean the overall model has improved. A fine-tuned model may perform better on expected examples while becoming worse on edge cases, unrelated tasks, or behaviours that previously worked well.
This regression of previously learned capabilities is sometimes referred to as catastrophic forgetting. A model can therefore improve locally while regressing globally. Testing should compare the fine-tuned model against a retained and versioned base model using a fixed evaluation set that covers both the target task and existing capabilities.
Testers should evaluate accuracy, consistency, robustness, safety, bias, and regression across expected and unexpected inputs rather than focusing only on examples similar to the fine-tuning data. Changes in behaviour outside the target domain are particularly important because they may not be visible in task-specific evaluation.
Fine-tuning can also introduce overfitting, where the model becomes too closely adapted to its training examples and performs poorly on new inputs. Data quality matters as well: biased, incorrect, duplicated, or poorly labelled training data can become reflected in the model's behaviour.
Fine-tuning can also weaken safety behaviours or guardrails established in the base model, even when the fine-tuning data itself is not unsafe. Safety testing should therefore cover the model's broader behaviour, not just its intended domain.
A fine-tuned model can appear significantly better in its target area while silently losing capabilities elsewhere. A useful testing question is not simply “Did fine-tuning improve the target task?”, but “What changed across the model's behaviour, and what might have regressed as a result?”
