thinQmaster Virtual testing partner Adaptive practice exams that find your weak spots and drill them. Every answer explained. From $69
Enroll

thinQmaster

Find your exam

Five questions free, before you decide.

Step 1 · choose a vendor

In one of our camps? Your practice exams come with the tuition — they are on your study page already.

Data & Analytics · Foundational

Data Pipeline

An automated series of steps that moves data from sources through transformations to destinations.

Definition

Pipelines can be batch or streaming and include ingestion, validation, transformation, loading and monitoring. Good pipelines are idempotent, observable, testable and recoverable. In Microsoft Fabric and Data Factory, 'pipeline' also names the orchestration item that runs activities.

Exam tip

Design pipelines to be idempotent so reruns after a failure don't create duplicates.

Related terms