The State of Data Engineering 2024

Einat Orr, PhD
May 21, 2024

Since 2021 we’ve been releasing the annual State of Data Engineering Report, a compilation of all the relevant categories that have a direct impact on data engineering infrastructure. In 2024,…

Best Practices

DataOps use case: How to reduce storage costs with a data version control system

Einat Orr, PhD
May 13, 2024

Someone in the organization owns the data lake or data lake house. The owner’s title may change, but the task at hand remains the same. Whether you’re a DataOps team,…

Machine Learning

27 MLOps Tools for 2026: Key Features & Benefits

Einat Orr, PhD
May 1, 2024

MLOps is a method for managing machine learning projects at scale. It improves collaboration across development, operations, and data science teams to accelerate model deployment, increase team productivity, and reduce…

Building A Data Lake For The GenAI And ML Era

Einat Orr, PhD
April 18, 2024

Despite data technology advancements, many organizations still struggle to access outdated mainframe data. Most of the time, you’re looking at siloed data architecture that just doesn’t align with their strategic…

Why Is DataOps So Hard and What Tools Make It Easier?

Einat Orr, PhD
April 2, 2024

TL;DR: DataOps complexity arises from unclear R&Rs, a lack of standardization in interfaces, distributed technology complexities, and difficulties in implementing engineering best practices. The solution is to define clear responsibilities,…

Hive Metastore – Did We Replace It With A Vendor Lock?

Oz Katz, Einat Orr, PhD
January 18, 2024

A data lake is often implemented using object storage, and our data resides in objects (files) that we can access through the storage API. Data professionals in analytics and ML…

Jupyter Notebook & 15 Alternatives: Data Notebook Review [2025]

Einat Orr, PhD
September 11, 2023

The tech industry responded to the needs of data practitioners with various IDE solutions for developing code and presenting findings in a data science and machine learning context. One of…

Metadata Management In Data Lakes

Einat Orr, PhD
August 3, 2023

4 Metadata Management Challenges And How To Solve Them Modern data architectures support an increasing number and variety of business use cases. Product creation, tailored customer experiences, fraud detection, regulatory…

Best 17 Vector Databases for 2025 [Top Picks]

Einat Orr, PhD
July 31, 2023

In the real world, teams may have to deal with data that isn’t neatly organized into rows and columns. That’s especially true when you’re working with complex, unstructured data such…

Data Governance: Guide to Enterprise Data Architecture

Einat Orr, PhD
July 10, 2023

Organizations need data governance for many reasons, not just to comply with a rising number of data privacy and protection rules, such as the GDPR of the European Union and…

lakeFS Cloud is Now Self-Service on Microsoft Azure

Einat Orr, PhD
June 26, 2023

We are pleased to announce that lakeFS Cloud is now available as a self service on Azure. lakeFS Cloud is a fully-managed lakeFS platform, providing version control for your data…

The State of Data Engineering 2023

Einat Orr, PhD
May 21, 2023

A lot has happened since 2022, from the rise of Generative AI to the economic slowdown and job losses impacting data practitioners in 2023. In fact, it’s safe to say…

Pick up the Slack with lakeFS