thinQmaster Virtual testing partner Adaptive practice exams that find your weak spots and drill them. Every answer explained. From $69
Enroll

thinQmaster

Find your exam

Five questions free, before you decide.

Step 1 · choose a vendor

In one of our camps? Your practice exams come with the tuition — they are on your study page already.

Data & Analytics · Intermediate

Data Orchestration

Coordinating the scheduling, dependencies, retries and monitoring of data pipeline tasks.

Definition

Orchestrators include Apache Airflow (and the managed Cloud Composer and Amazon MWAA), AWS Step Functions, Azure Data Factory and Fabric pipelines, Databricks Lakeflow Jobs, Dagster and Prefect.

Exam tip

Multi-step, cross-service pipelines with dependencies need an orchestrator, not just cron.

Related terms