thinQmaster Virtual testing partner Adaptive practice exams that find your weak spots and drill them. Every answer explained. From $69
Enroll

thinQmaster

Find your exam

Five questions free, before you decide.

Step 1 · choose a vendor

In one of our camps? Your practice exams come with the tuition — they are on your study page already.

AI & Machine Learning · Advanced

Vision Transformer (ViT)

A transformer that processes an image as a sequence of fixed-size patches embedded like tokens.

Definition

ViTs split images into patches (for example 16x16 pixels), embed them and apply self-attention. With large-scale pretraining they match or exceed CNNs and serve as vision encoders in many multimodal models.

Exam tip

ViT treats image patches like tokens, showing transformers are not limited to text.

Related terms