Achieve Multi-Table Transactions On Delta tables

Achieve Multi-Table Transactions On Delta tables

Description

Data engineers typically need to implement custom logic in scripts to guarantee two or more data assets (tables) are updated synchronously. This logic often requires extensive rewrites or periods during which data is unavailable or not synchronized.

We will demonstrate a way to run data transformation in isolation across multiple tables, without ever creating a copy of the tables, and once completed – atomically promote all the changes to production.

LakeFS

  • Get Started
    Get Started
  • Git for Data - What, How and Why Now?

    Read the article
    +