This tutorial aims to give you a fast start with lakeFS and use it’s git-like terminology in spark. It covers the following: Quick start to install lakeFS using Docker Compose. How to create a repository, add files to it, create a branch and make changes to the repository using spark jobs. How to review changes …
When we first thought about a tagline for lakeFS, our recently released OSS project, we instinctively used terms such as “Data versioning”, “Manage data the way you manage code”, “It’s git for data”, and any random variation of the three that is a grammatically correct sentence in english. We were very pleased with ourselves for …
Data Versioning – Does it mean what you think it means? Read More »
lakeFS is an open source platform that delivers resilience and manageability to your existing object-storage based data lake. With lakeFS you can build repeatable, atomic and versioned data lake operations – from complex ETL jobs to data science and analytics.