thinQmaster Virtual testing partner Adaptive practice exams that find your weak spots and drill them. Every answer explained. From $69
Enroll

thinQmaster

Find your exam

Five questions free, before you decide.

Step 1 · choose a vendor

In one of our camps? Your practice exams come with the tuition — they are on your study page already.

Data & Analytics · Intermediate

Micro-Batch Processing

A streaming approach that processes incoming data in very small, frequent batches.

Definition

Spark Structured Streaming uses micro-batches by default, trading a little latency for throughput and fault tolerance. Triggers such as processingTime='1 minute' or availableNow control batch timing.

Exam tip

trigger(availableNow=True) processes all available data in micro-batches and then stops, which suits incremental batch jobs.

Related terms