Product

How We Optimized lakeFS Mount for Deep Learning

Oz Katz
June 27, 2024

I am happy to share that lakeFS Mount is now available. lakeFS Mount allows for mounting a repository (or a specific path within one) as a local filesystem. Why lakeFS…

Best Practices

dbt Data Quality Checks: Types, Benefits & Best Practices

Idan Novogroder
June 20, 2024

Decisions based on data can only make a positive impact as long as the data itself is accurate, consistent, and dependable. High data quality is critical, and data quality checks…

Product

What measures does lakeFS take to guarantee data security?

Oz Katz
June 11, 2024

You need data version control capabilities for your data lake but you’re not sure what safeguards lakeFS has in place? If this sounds familiar, this article is for you. Keep…

Data Lake Implementation: 12-Step Checklist

Idan Novogroder
June 3, 2024

In today’s data-driven world, organizations face enormous challenges as data grows exponentially. One of them is data storage. Traditional data storage methods in analytical systems are expensive and can result…

Data Pipelines in Python: Frameworks & Building Processes

Amit Kesarwani
May 30, 2024

Data pipelines are critical for organizing and processing data in modern organizations. A data pipeline consists of linked components that process data as it moves through the system. These components…

How to Build Data Pipelines in Databricks with Examples

Tal Sofer
May 28, 2024

Building a data pipeline is a smart move for data engineers in any organization. A strong data pipeline guarantees that the information is clean, consistent, and dependable. It automates discovering…

The State of Data Engineering 2024

Einat Orr, PhD
May 21, 2024

Since 2021 we’ve been releasing the annual State of Data Engineering Report, a compilation of all the relevant categories that have a direct impact on data engineering infrastructure. In 2024,…

Top 26 Data Catalog Tools to Consider in 2025

Idan Novogroder
May 16, 2024

Many businesses are dealing with increasing volumes of data spread over several databases and repositories across on-premises systems, cloud services, and IoT technology. This complicates data management and data quality,…

Best Practices

DataOps use case: How to reduce storage costs with a data version control system

Einat Orr, PhD
May 13, 2024

Someone in the organization owns the data lake or data lake house. The owner’s title may change, but the task at hand remains the same. Whether you’re a DataOps team,…

Data Version Control for Hugging Face Datasets

Idan Novogroder
May 6, 2024

Hugging Face Datasets (???? Datasets) is a library that allows easy access and sharing of datasets for audio, computer vision, and natural language processing (NLP). It takes only a single…

lakectl local: How to work with lakeFS locally using Git

Oz Katz
April 25, 2024

The massive increase in generated data presents a serious challenge to organizations looking to unlock value from their data sets. Data practitioners have to deal with many consequences of the…

The lakeFS Blog