Declaring a quality rule is not blocking the data. In Delta, NOT NULL and CHECK block; in Lakeflow, an expectation with no action retains the row; keys and unique only declare; MERGE ignores the new column. See what each layer does, how to build a quarantine and how to read the count, with an example run locally.
The deploy went green, and a full refresh wiped the bronze table that Kafka could no longer replay. In Databricks Lakeflow, the bundle carries the code from dev to prod, but state stays in each environment: the deployment record, the streaming checkpoints, the tables themselves and the identity that runs the pipeline. This article shows the four states the bundle does not carry, what each command can delete and the guards you declare in the bundle before the first production deploy.
The bottleneck of enterprise AI is not the model, it is governed business context. How Unity Catalog Metric Views, Genie Ontology and Fabric IQ form a single semantic layer over one copy of the data — with an FSI use case, cost model and roadmap.
When it comes to organizing a lakehouse, the Medallion architecture has become the market standard in Databricks. It solves a classic problem: how to transform raw, messy data into reliable…