How to Master the Medallion Architecture with lakeFS Against Your Cloud
Join us for an engaging and insightful workshop as we delve into the Medallion Architecture implementation using lakeFS to enable version control across different data layers (Gold, Silver, Bronze).
In this session we will cover:
- Introduction to the Medallion Architecture: Gain a solid understanding of the architecture and its significance
- Overview of lakeFS: Explore the features and functionalities of lakeFS, an open source data lake management platform that empowers organizations to maintain data integrity, scalability and collaboration
- Deep Dive into Medallion with lakeFS: Dive into the intricacies of integrating Medallion Architecture with lakeFS. Discover how to leverage lakeFS to capture and manage metadata, track data lineage across different tiers and enable efficient rollbacks and reproducibility of data pipeline changes
In this demo, we will showcase a step-by-step example of setting up a Medallion Architecture on different storage buckets, and tracking a pipeline with lakeFS across those buckets.
If you are a data engineer, data architect, or involved in managing complex data pipelines, this webinar is a must. Gain a profound understanding of how Medallion Architecture, in conjunction with lakeFS, can revolutionize your data pipeline version control practices.