thinQmaster Virtual testing partner Adaptive practice exams that find your weak spots and drill them. Every answer explained. From $69
Enroll

thinQmaster

Find your exam

Five questions free, before you decide.

Step 1 · choose a vendor

In one of our camps? Your practice exams come with the tuition — they are on your study page already.

AI & Machine Learning · Advanced

QLoRA

LoRA fine-tuning on top of a base model quantized to 4-bit precision, sharply reducing memory.

Definition

QLoRA stores the frozen base model in 4-bit NormalFloat, trains LoRA adapters in higher precision and uses paged optimizers, enabling fine-tuning of large models on a single GPU.

Exam tip

QLoRA is the answer when a large model must be fine-tuned on a single GPU with limited memory.

Related terms