Delta Live Tables was renamed SDP. This mini-course goes deeper than the Associate and Professional touch on the topic — Expectations, declarative medallion, YAML configuration with Pydantic, Unity Catalog volumes and schemas. Built bilingual from day one.
Same idea, broader scope: declarative pipelines that handle dependencies, quality, and operational concerns for you.
Databricks renamed Delta Live Tables to Spark Declarative Pipelines (SDP) and opened the runtime. Same declarative model — you define what the pipeline does, not how — with broader engine support. If you used DLT, the mental model carries over. If you didn't, this is the cleanest place to start.
Each lesson has a notebook + study guide + scenario quiz, in PT and EN.
Why Delta is the storage layer that makes everything else work. Transaction log, ACID, partitioning, time travel.
The foundation of streaming-ish pipelines. Schema enforcement, schema evolution, file notification mode.
How SDP works under the hood, how it decides what to compute, what's declarative and what's not.
expect / expect_or_drop / expect_or_fail. Where to set them, how they affect lineage, how to alert on violations.
Designing Bronze with SDP. When to use streaming tables vs materialized views. Schema and metadata patterns.
Cleaning, deduplication, current-state tables, CDC-style transformations with SDP primitives.
Modeling Gold for BI consumption with SDP: facts, dimensions, key aggregations.
Configure pipelines via YAML, validate config with Pydantic, environment-aware configs.
How SDP interacts with UC. Volumes for raw landing, schemas for governance, permissions and lineage.
SDP is part of our 6-course family. It's the natural technical upsell after the Associate.
Yes — DLT was renamed SDP and got broader. The patterns you used in DLT mostly carry over. We start from the new SDP API, so you learn what's relevant going forward.
Not strictly. You should be comfortable with PySpark, Delta, and the medallion idea. If you don't have that yet, take PySpark Free + Associate first.
SDP appears briefly in the Associate exam. This mini-course goes 10x deeper than what the exam tests. Worth it if you'll use SDP in your job; overkill if you just want to pass.
Most of the course runs on Free. A few advanced features (compute classes, some serverless options) require a paid workspace. We tell you which lessons need what.