DP-203 Certification Practice Question #54

Question

You have an Azure Databricks workspace that contains a Delta Lake dimension table named Table1.
Table1 is a Type 2 slowly changing dimension (SCD) table.
You need to apply updates from a source table to Table1.
Which Apache Spark SQL operation should you use?

Accepted Answer

A Type 2 SCD workflow needs to compare source and target rows, expire current versions when changes occur, and insert new versions. In Delta Lake on Azure Databricks, the Spark SQL operation designed for that upsert-style pattern is `MERGE`. The strong community consensus and Microsoft’s Delta Lake guidance both support `MERGE`.

More DP-203 practice questions