Prefect is a workflow orchestration tool empowering developers to build, observe, and react to data pipelines.
lakeFS is a scalable data version control system providing version control over the data lake, using Git-like semantics to create and access those versions.
When using lakeFS with Prefect orchestrated pipelines, you’ll be able to quickly analyze and troubleshoot failed/erroneous pipelines, improving data reliability and reducing time to resolution.
In this webinar, we’ll demonstrate how to create an isolated environment of the data to run production pipelines, in a way that ensures only quality data is exposed to production.
During this session, we will discuss:
- Run pipelines in isolation
- Execute Git actions on big data scale within Flows
- Troubleshoot pipelines
- Get a snapshot of the data at the time of failure
This is an interactive session showing you first-hand how to troubleshoot and reproduce data with Prefect and lakeFS.
Buckle your seatbelts — this ride will be wild!
