What if you could manage your data lake just like you manage code? With rollback, versioning, and branching capabilities on top of your existing data lake?
lakeFS is an open-source project that provides a Git-like version control interface for data lakes, with seamless integration to most data tools and frameworks. lakeFS enables you to easily implement parallel pipelines for experimentation, reproducibility, and CI/CD for data.
And now you can start playing around with lakeFS in a fully functional lakeFS environment, with your own data and all the tools that you are already using. Get your isolated environment, integrate it with the tools you use, and see how it works in an environment similar to your own.
Please note: playground environments will be deleted after one week.
See these features in action:
- Full reproducibility of data and code
- Git-like operations: branch, commit, merge and revert
- Instant reversion of changes to data
- Petabytes scale version control
- Zero-copy branching for frictionless experimentation
- Seamless integration with most data tools and frameworks (Spark, Hive, AWS Athena, Presto)
- Support for AWS S3, Azure Blob Storage, and Google Cloud Storage (GCS)
Start playing here (no email or any additional information required)
One you have experienced the value in lakeFS, go ahead and install lakeFS open source, or sign up for lakeFS Cloud Beta. And don’t forget to share your feedback with us via our community on Slack or GitHub – this is the best way to let us know if any feature you need is missing!Read Related Articles.
How Epcor Built CI/CD for Data Pipelines
It is no secret that modern businesses run on big data. If your business was a car, big data would be the engine that powers
Top Data Engineering Conferences & Events You Don’t Want to Miss in the Fall of 2022!
As the Covid-19 pandemic loosens its grip on the world, we’re all eager to start travelling and meeting in person again. The great news is
Data versioning as your ‘Get out of jail’ card – DVC vs. Git-LFS vs. dolt vs. lakeFS
Data Versioning at Scale: Solutions Overview Back when I was a 23-year-old student, I worked at an Israeli networking company as a BI analyst in
