thinQmaster Virtual testing partner Adaptive practice exams that find your weak spots and drill them. Every answer explained. From $69
Enroll

thinQmaster

Find your exam

Five questions free, before you decide.

Step 1 · choose a vendor

In one of our camps? Your practice exams come with the tuition — they are on your study page already.

AI & Machine Learning · Advanced

Continued Pretraining

Further self-supervised training of a foundation model on large unlabeled domain data.

Definition

Continued (domain-adaptive) pretraining teaches vocabulary and knowledge of a specialized field, such as legal or biomedical text, using unlabeled corpora. Amazon Bedrock supports continued pretraining for some models.

Exam tip

Unlabeled domain corpus means continued pretraining; labeled prompt-response pairs mean fine-tuning.

Related terms