Distributed Data Management: Key Concepts, Tools & Best Practices

Idan Novogroder
October 19, 2025

Ask any data team, and you’ll quickly learn that nobody out there manages all the organization’s data in a single centralized location. Most teams operate across various clouds, locations, and…

Machine Learning

AI Data Infrastructure: Components, Challenges & Best Practices

Tal Sofer
October 15, 2025

A solid AI data infrastructure is a key enabler for teams looking to efficiently deploy ML applications. It delivers the fundamental features required to enable the whole machine learning lifecycle,…

Machine Learning

What is a Data Registry? Benefits, Use Cases & Best Practices

Tal Sofer
September 29, 2025

One of the major pain points in ML is the lack of transparency, consistency, and control over data assets. Without a centralized system, teams often struggle with fragmented datasets, unclear…

Bound by Physics: Why Data Version Control is Critical for Real-World AI

Vince Antinozzi, Yoav Yetinson
September 23, 2025

TL;DR Software-only systems can be rerun from the source, but physics-bound workflows face a tougher challenge. Once a moment is gone, it’s gone. Sensor drift, hardware changes, and environmental uniqueness…

Versioning Data Labels: Integrating Labeling Tools with lakeFS

Iddo Avneri
September 10, 2025

In this post, we explore how lakeFS can integrate with popular data labeling solutions, the differences between labeling tools’ built-in dataset management and lakeFS data version control, and why combining…

Unified Data Management: Types, Challenges & Best Practices

Idan Novogroder
September 2, 2025

Historically, companies have developed their IT systems on an ad hoc basis, installing various software and taking on data management approaches as their needs changed. The resulting organization is diverse,…

What is Metadata Filtering? Benefits, Best Practices & Tools

Idan Novogroder
August 21, 2025

Vector databases are a critical enabler for expanding the use of LLMs. They power applications such as Retrieval Augmented Generation (RAG), pattern matching, anomaly detection, and recommendation systems by retrieving…

How lakeFS Helps Ensure Data Compliance

Tal Sofer
August 18, 2025

Data compliance is all about adhering to laws, regulations, standards, and internal policies regarding data use. Organizations must comply with regulations like the General Data Protection Regulation (GDPR), the Health…

Versioned Data with Apache Iceberg Using lakeFS Iceberg REST Catalog

Amit Kesarwani
August 14, 2025

lakeFS Enterprise offers a fully standards-compliant implementation of the Apache Iceberg REST Catalog, enabling Git-style version control for structured data at scale. This integration allows teams to use Iceberg-compatible tools…

What is Data Compliance? Tools, Benefits & Key Metrics

Tal Sofer
August 13, 2025

Organizations deal with ever-increasing volumes of data. More data translates into more risk, as hackers have a larger target area. This is where data compliance comes in. It helps mitigate…

OpenAI’s Open Source Revolution: Why Enterprise AI Infrastructure Matters More Than Ever

Gottfried Sehringer
August 6, 2025

Yesterday, OpenAI launched gpt-oss-120b and gpt-oss-20b, marking the company’s first open-weight models since GPT-2 in 2019. This strategic shift represents far more than a product release—it signals a fundamental transformation…

The lakeFS Blog