15 Data Engineering Best Practices to Follow in 2025

Einat Orr, PhD
May 18, 2023

The software engineering world has profoundly transformed in the past decades. This was possible thanks to the emergence of methodologies and tools that helped establish and apply new successful engineering…

Applying Engineering Best Practices to Data Lakes

Einat Orr, PhD
May 3, 2023

In the last 30 years, agile development methodology played a significant part in the digital transformation the world is undergoing. What stands as the basis of the methodology is the…

Thought Leadership

MLOps Is Overfitting: Here’s Why

Einat Orr, PhD
April 5, 2023

VC surveys show that the MLOps category has significantly expanded in the past few years, with hundreds of companies defining themselves as part of this dynamically evolving niche. MLOps systems…

Data Version Control – A Data Engineering Best Practice You Must Adopt

Einat Orr, PhD
December 1, 2022

Imagine the software engineering world before distributed version control systems like Git became widespread. This is where the data world is currently at. The explosion in the volume of generated…

Git for Data – What, How and Why Now?

Einat Orr, PhD
November 24, 2022

Git, the Source Control, aka Code Version Control When we wish for “Git for Data”, we already know what code version control is, and that Git is the standard tool…

Data Manageability: The revolution that is turning Data Trust into the New North Star

Einat Orr, PhD
August 17, 2022

A few weeks ago, I was looking at a dashboard in our internal BI system. It’s a simple system. Redash over PostgreSQL that has just a few hundreds of thousands…

Data versioning as your ‘Get out of jail’ card – DVC vs. Git-LFS vs. dolt vs. lakeFS

Einat Orr, PhD
July 25, 2022

Data Versioning at Scale: Solutions Overview Back when I was a 23-year-old student, I worked at an Israeli networking company as a BI analyst in the Operations department. My job…

Proudly announcing lakeFS Cloud

Einat Orr, PhD, Oz Katz
June 27, 2022

What is lakeFS? As data practitioners, we use many different terms to talk about what we do – we call it business intelligence, analytics, data pipelines, or insights. But there’s…

The State of Data Engineering 2022

Einat Orr, PhD
June 20, 2022

A year has passed since we shared the State of Data Engineering 2021. And since we released that article last May, not much has changed in the data landscape. In…

Data Engineering

Closing the Gap: Lifecycle Management for Data Products

Einat Orr, PhD
February 28, 2022

As data practitioners, we use many different terms to talk about what we do – we call it business intelligence, analytics, data pipelines, or insights. But there’s one term that…

Data Engineering

Data Versioning – Does It Mean What You Think It Means?

Einat Orr, PhD
November 22, 2021

Introduction When we first thought about a tagline for our open source project lakeFS, we instinctively gravitated to terms like “Data versioning”, “Manage data the way you manage code”, “Git…

Thought Leadership

lakeFS in Search of a Role Model

Einat Orr, PhD
September 20, 2021

Who needs a role model? When we first launched lakeFS in August of 2020, we asked ourselves a simple question: What does success look like? And how will we know…

Pick up the Slack with lakeFS