Top 17 Data Orchestration Tools for 2025: Ultimate Review

The lakeFS Team
June 19, 2023

According to Gartner, over 87% of businesses fail to make the most of their data. The primary reasons behind such a low level of business intelligence and analytics maturity are…

Product

New in lakeFS Version 0.100.0

The lakeFS Team
May 10, 2023

lakeFS is celebrating its version release 0.100.0! We’re excited to announce the 0.100.0 version release! It’s thanks to you, the community that we’ve reached this milestone and: Managed to run…

Case Studies

Improving Our Research Velocity With lakeFS

The lakeFS Team
March 20, 2023

This post was originally published in the Enigma blog. In every software engineering problem I’ve worked on, I’ve noticed a recurring tension between two highly desirable properties: flexibility and robustness….

Product

Testing Data Pipelines: Overview, Challenges & Importance

The lakeFS Team
March 15, 2023

What’s not to love about data pipeline testing? Adding user acceptance testing and contract acceptance testing to your data pipelines makes them less likely to cause errors and ensures that…

Product

lakeFS Product Offerings Overview

The lakeFS Team
February 28, 2023

What is lakeFS? lakeFS is a platform that helps data engineers build scalable and resilient data lakes running on object storage. It provides version control, branching, and merging capabilities for…

Best Practices

How To Maintain Data Quality In Your Data Lake

The lakeFS Team
February 15, 2023

Enterprises use more and more data as the foundation for their decisions and operations. The sheer number of digital goods that collect, analyze, and use data to feed decision-making algorithms…

Big Data Testing: Benefits, Challenges & Tools

The lakeFS Team
January 23, 2023

When testing ETLs for big data applications, data engineers usually face a challenge that originates in the very nature of data lakes. Since we’re writing or streaming huge volumes of…

Write-Audit-Publish for Data Pipelines: The Shortest Path to Your Destination with lakeFS

The lakeFS Team
December 4, 2022

Overview Continuous integration (CI) of data is the process of exposing data to consumers only after ensuring it adheres to best practices such as format, schema, and PII governance. Continuous…

Data Engineering

Data Reproducibility and other Data Lake Best Practices

The lakeFS Team
November 20, 2022

Overview Data changes frequently, making the task of keeping track of its exact state over time difficult. Oftentimes, people maintain only one state of their data––its current state. Data lake…

Top Data Engineering Conferences & Events You Don’t Want to Miss in the Fall of 2022!

The lakeFS Team
August 23, 2022

As the Covid-19 pandemic loosens its grip on the world, we’re all eager to start travelling and meeting in person again. The great news is that in persone conferences are…

Data Mesh: What is it and What Does it Mean for Data Engineers?

The lakeFS Team
August 10, 2022

Organizations have practically always needed data analytics, and they jumped on the analytics bandwagon as soon as the first computers appeared on the scene. In the 80s, businesses built data…

Data Engineering

What is a Data Product? Examples & How to Build It

The lakeFS Team
August 1, 2022

Have you ever heard the phrase “data is the new oil” before? Of course, you have. As more businesses use and benefit from data, it becomes a valuable currency. Using…

Pick up the Slack with lakeFS