lakeFS Blog

Data Engineering

Diary of a Data Engineer

Oz Katz
May 19, 2021

A glimpse into the life of a data engineer. Day 1: Finally, an easy one Got a pretty simple task for a change – read a new type of event stream generated by sales, and publish it to the data lake. Sounds like a straightforward ETL. I estimate this as one day of work. I …

Diary of a Data Engineer Read More »

Data Engineering

How to Pick the Right Postgres for your Application

Ariel Shaqed (Scolnicov)
March 8, 2021

Lots of applications require a Postgres database. Before you can install them, you will need a Postgres database. How do you pick the right Postgres for your application? There are a bewildering variety of possible ways to acquire a database running on a Postgres instance, but the biggest choice is “build or buy”: whether to …

How to Pick the Right Postgres for your Application Read More »

Data Engineering Project

The Quick Guide for Running Presto Locally on S3

Guy Hardonag
May 19, 2021

This post aims to cover our experience running Presto in a local environment with the ability to query Amazon S3 and other S3 Compatible Systems. We will: Describe the components needed and how to configure them. Provide a dockerized environment you could run. Show an example of running the provided environment and querying a publicly …

The Quick Guide for Running Presto Locally on S3 Read More »

LakeFS

  • Get Started
    Get Started
  • Git for Data - What, How and Why Now?

    Read the article
    +