thinQmaster Virtual testing partner Adaptive practice exams that find your weak spots and drill them. Every answer explained. From $69
Enroll

thinQmaster

Find your exam

Five questions free, before you decide.

Step 1 · choose a vendor

In one of our camps? Your practice exams come with the tuition — they are on your study page already.

AI & Machine Learning · Intermediate

Encoder-Decoder Architecture

A transformer with an encoder that reads the input and a decoder that generates output while attending to the encoder.

Definition

Encoder-decoder models such as T5 and BART use cross-attention from decoder to encoder outputs, which suits translation and summarization where input and output differ.

Exam tip

Encoder-decoder models suit tasks that transform one sequence into another, such as translation.

Related terms