[Future Data] Multi-statement Transactions in the Databricks Lakehouse

Speaker:

Ryan Johnson

System:

Delta Lake

Video:

YouTube

The data lake architecture originally focused on self-standing tables in cloud storage, with catalogs as mere discovery aids. Modern lakehouse architectures add an ever-growing set of data warehousing capabilities to that original value proposition. Historically a key missing piece was multi-statement transactions -- Delta Lake supported single-statement single-table transactions, with ACID properties for changes made to that table. Sophisticated MERGE... Read More