Barak Amar

Go

Working with Embed in Go 1.16 Version

Barak Amar
January 27, 2021

The new Golang v1.16 embed directive helps us keep a single binary and bundle out static content. This post will cover how to work with embed directive by applying it to a demo application.  Why Embed One of the benefits of using Go is having your application compiled into a single self-contained binary. Having a …

Working with Embed in Go 1.16 Version Read More »

Go Project

Loosely Coupled Monolith vs Tightly Coupled Microservices

Barak Amar
December 14, 2020

TL;DR With some thoughtful engineering, we can achieve a lot of the benefits that come with a microservice oriented architecture, while retaining the simplicity and low operating cost of being a monolith. What is lakeFS? lakeFS is an open source tool that delivers resilience and manageability to object-storage based data lakes. lakeFS provides Git-like capabilities …

Loosely Coupled Monolith vs Tightly Coupled Microservices Read More »

Data Engineering Project

Building A Data Development Environment with lakeFS

Barak Amar
December 30, 2020

Overview As part of our routine work with data we develop code, choose and upgrade compute infrastructure, and test new data. Usually, this requires running parts of our production pipelines in parallel to production, testing the changes we wish to apply. Every data engineer knows that this convoluted process requires copying data, manually updating configuration, …

Building A Data Development Environment with lakeFS Read More »

Go Project

In-process caching in Go: scaling lakeFS to 100k requests/second

Barak Amar
December 1, 2020

This is a first in a series of posts describing our journey of scaling lakeFS. In this post we describe how adding an in-process cache to our Go server speed up our authorization flow. Background lakeFS is an open-source layer that delivers resilience and manageability to object-storage based data lakes. With lakeFS you can build …

In-process caching in Go: scaling lakeFS to 100k requests/second Read More »

LakeFS

  • Get Started
    Get Started