Tag archive
Almost every PySpark job ends with a write, and that write is where a lot of quiet damage happens:...
Databricks NEAREST BY brings batch vector search into SQL with a fused Photon GEMM operator and IVF indexes in Delta tables. How it works, when to use it.
How Databricks unifies federation, Lakeflow, Unity Catalog, Lakebase, AI Search and agents on one governed lakehouse, with real-time patterns and limits.
Every Kafka cluster I've worked on had the same problem. Not throughput. Disk. The business wants a...
On September 1, 2026, Databricks made automatic change data feed (Auto CDF) generally available. The...
Author's Note: This article was originally written and published by me in English on the AWS Builder...
"Should I cache this DataFrame?" is one of those questions that sounds simple in an interview and...
The Databricks Certified Generative AI Engineer Associate exam is less about LLM theory and more...
Databricks’ current exam guide for the Certified Data Engineer Associate covers the exam version as...
Databricks bought Neon and turned it into Lakebase, so an agent can get its own branch of production in seconds and the rows it writes land in a governed table you can query. I walk through what that gives you, where it stops (nothing merges back), and what it means for getting an agent past read-only.
Photo: Solømen on Unsplash 24 of Databricks' 29 reported design questions are classic system...
Almost every Azure Databricks project I've seen starts the same way: files land in ADLS Gen2, and...