Your MERGE statements are scanning too much data
The MERGE statement is a performance trap that lures engineers into thinking they are performing a...
Tag archive
The MERGE statement is a performance trap that lures engineers into thinking they are performing a...
Most Silver-to-Gold jobs I've seen start the same way: re-read the whole Silver table, recompute...
Sooner or later a source system adds a column, renames one, or someone runs a bad overwrite on a...

On September 1, 2026, Databricks made automatic change data feed (Auto CDF) generally available. The...
Most Delta tables don't get slow because of one bad query. They get slow because nobody looks after...
Before Lakeflow Connect, ingesting data from an external SaaS application into a Delta table often...
Most Delta Lake explanations start from the feature list - ACID, time travel, schema enforcement -...
You ship the job. It passes CI. Then, a source system upstream changes its naming convention, or a...
If you work with data, you will be asked this sooner or later: what is a lakehouse, and why not just...
MERGE INTO is the workhorse of almost every Delta Lake pipeline on Azure Databricks. It's also one of...
Data teams waste roughly 30% of their compute spend on recurring OPTIMIZE jobs that move data around...
Most articles about Iceberg and Delta Lake start by comparing features. That is the wrong place to...