Ready to dive into the lake?

lakeFS is currently only
available on desktop.

For an optimal experience, provide your email below and one of our lifeguards will send you a link to start swimming in the lake!

lakeFS Community

Barak Amar

Tutorials Use Cases

How to Build an Isolated Testing Environment for Data with lakeFS

Barak Amar

Overview Our routine work with data includes developing code, choosing and upgrading compute infrastructure, and testing new and changed data pipelines. Usually, this requires running our tested pipelines in parallel to production, in order to test the changes we wish to apply. Every data engineer knows that this convoluted process requires copying data, manually updating …

How to Build an Isolated Testing Environment for Data with lakeFS Read More »

Go

Building Rich CLI Applications with Go’s Built-in Templating

Barak Amar

Overview The templating package text/template implements data-driven templates for generating textual output. Although we do not benefit from executing the template output more than once, we found it easy to use and helpful for outputting text with colors, marshaling data, and rendering tabular information. By mapping additional functions by name, it is possible to extend …

Building Rich CLI Applications with Go’s Built-in Templating Read More »

Go Project

Loosely Coupled Monolith vs Tightly Coupled Microservices

Barak Amar

TL;DR With some thoughtful engineering, we can achieve a lot of the benefits that come with a microservice oriented architecture, while retaining the simplicity and low operating cost of being a monolith. What is lakeFS? lakeFS is an open source tool that delivers resilience and manageability to object-storage based data lakes. lakeFS provides Git-like capabilities …

Loosely Coupled Monolith vs Tightly Coupled Microservices Read More »

Data Engineering Project

Building A Data Development Environment with lakeFS

Barak Amar

Overview As part of our routine work with data we develop code, choose and upgrade compute infrastructure, and test new data. Usually, this requires running parts of our production pipelines in parallel to production, testing the changes we wish to apply. Every data engineer knows that this convoluted process requires copying data, manually updating configuration, …

Building A Data Development Environment with lakeFS Read More »

Go Project

In-process Caching In Go: Scaling lakeFS to 100k Requests/Second

Barak Amar

This is a first in a series of posts describing our journey of scaling lakeFS. In this post we describe how adding an in-process cache to our Go server speed up our authorization flow. Background lakeFS is an open-source layer that delivers resilience and manageability to object-storage based data lakes. With lakeFS you can build …

In-process Caching In Go: Scaling lakeFS to 100k Requests/Second Read More »

Ready to Dive In?

Try without installing

Talk to a lakeFS engineer

© Copyright 2022 | All Rights Reserved | Privacy Policy | Terms of Use

Git for Data – lakeFS

  • Get Started
    Get Started

    • The annual State of Data Engineering Report is now available. Find out what’s new in 2023 -

    +